[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 15:03:16 dist-test-slave-8n49 krb5kdc[20409](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 15:03:16 dist-test-slave-8n49 krb5kdc[20409](info): set up 2 sockets
Aug 11 15:03:16 dist-test-slave-8n49 krb5kdc[20409](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260811 15:03:17.790997 20401 mini_kdc.cc:121] Time spent starting KDC: real 1.122s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/krb5kdc/test-user.keytab.
Aug 11 15:03:17 dist-test-slave-8n49 krb5kdc[20409](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460597, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T15:03:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T15:03:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.236.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.236.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.236.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab.
Entry for principal kudu/127.19.236.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab.
I20260811 15:03:17.924350 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:37455
--webserver_interface=127.19.236.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab
--principal=kudu/127.19.236.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:45155
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.236.126:37455
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:03:18.039361 20424 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:03:18.039671 20424 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:03:18.039748 20424 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:03:18.043741 20424 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:03:18.043838 20424 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:03:18.043879 20424 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:03:18.043936 20424 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:03:18.043975 20424 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:03:18.049144 20424 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:45155
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.236.126:37455
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab
--principal=kudu/127.19.236.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:37455
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.236.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20424
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:03:18.050241 20424 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:03:18.051318 20424 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:03:18.060256 20430 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:18.060230 20429 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:18.060238 20424 server_base.cc:1034] running on GCE node
W20260811 15:03:18.060307 20432 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:18.061146 20424 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:03:18.062294 20424 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:03:18.063503 20424 hybrid_clock.cc:648] HybridClock initialized: now 1786460598063514 us; error 68 us; skew 500 ppm
Aug 11 15:03:18 dist-test-slave-8n49 krb5kdc[20409](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460598, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:03:18.066385 20424 init.cc:377] Logged in from keytab as kudu/127.19.236.126@KRBTEST.COM (short username kudu)
I20260811 15:03:18.067261 20424 webserver.cc:460] Webserver started at http://127.19.236.126:44707/ using document root <none> and password file <none>
I20260811 15:03:18.067843 20424 fs_manager.cc:359] Metadata directory not provided
I20260811 15:03:18.067942 20424 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:03:18.068197 20424 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:03:18.070399 20424 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/minicluster-data/master-0/data/instance:
uuid: "a4ab83be0e63488588b4fcf43e6d42a9"
format_stamp: "Formatted at 2026-08-11 15:03:18 on dist-test-slave-8n49"
server_key: "8433c616de9c7cb41f225343a1910774"
server_key_iv: "c4f5b68fa354672f76e2a2a5a4a5fc20"
server_key_version: "encryptionkey@0"
I20260811 15:03:18.070994 20424 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/minicluster-data/master-0/wal/instance:
uuid: "a4ab83be0e63488588b4fcf43e6d42a9"
format_stamp: "Formatted at 2026-08-11 15:03:18 on dist-test-slave-8n49"
server_key: "8433c616de9c7cb41f225343a1910774"
server_key_iv: "c4f5b68fa354672f76e2a2a5a4a5fc20"
server_key_version: "encryptionkey@0"
I20260811 15:03:18.074957 20424 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 15:03:18.077411 20440 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:18.078740 20424 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260811 15:03:18.078900 20424 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/minicluster-data/master-0/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/minicluster-data/master-0/wal
uuid: "a4ab83be0e63488588b4fcf43e6d42a9"
format_stamp: "Formatted at 2026-08-11 15:03:18 on dist-test-slave-8n49"
server_key: "8433c616de9c7cb41f225343a1910774"
server_key_iv: "c4f5b68fa354672f76e2a2a5a4a5fc20"
server_key_version: "encryptionkey@0"
I20260811 15:03:18.079023 20424 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:03:18.101263 20424 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:03:18.104933 20424 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:03:18.105175 20424 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:03:18.113081 20424 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.126:37455
I20260811 15:03:18.113097 20499 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.126:37455 every 8 connection(s)
I20260811 15:03:18.114110 20424 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
I20260811 15:03:18.117101 20500 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:03:18.122013 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 20424
I20260811 15:03:18.122198 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/minicluster-data/master-0/wal/instance
I20260811 15:03:18.123502 20500 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a4ab83be0e63488588b4fcf43e6d42a9: Bootstrap starting.
I20260811 15:03:18.123921 20401 external_mini_cluster.cc:1428] Setting key ae19ec3cf4b6569e350879698bbb2d5e
I20260811 15:03:18.126768 20500 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a4ab83be0e63488588b4fcf43e6d42a9: Neither blocks nor log segments found. Creating new log.
I20260811 15:03:18.127664 20500 log.cc:824] T 00000000000000000000000000000000 P a4ab83be0e63488588b4fcf43e6d42a9: Log is configured to *not* fsync() on all Append() calls
I20260811 15:03:18.130066 20500 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a4ab83be0e63488588b4fcf43e6d42a9: No bootstrap required, opened a new log
I20260811 15:03:18.134491 20500 raft_consensus.cc:348] T 00000000000000000000000000000000 P a4ab83be0e63488588b4fcf43e6d42a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a4ab83be0e63488588b4fcf43e6d42a9" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 37455 } }
I20260811 15:03:18.134706 20500 raft_consensus.cc:374] T 00000000000000000000000000000000 P a4ab83be0e63488588b4fcf43e6d42a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:03:18.134788 20500 raft_consensus.cc:729] T 00000000000000000000000000000000 P a4ab83be0e63488588b4fcf43e6d42a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4ab83be0e63488588b4fcf43e6d42a9, State: Initialized, Role: FOLLOWER
I20260811 15:03:18.135264 20500 consensus_queue.cc:260] T 00000000000000000000000000000000 P a4ab83be0e63488588b4fcf43e6d42a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a4ab83be0e63488588b4fcf43e6d42a9" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 37455 } }
I20260811 15:03:18.135393 20500 raft_consensus.cc:388] T 00000000000000000000000000000000 P a4ab83be0e63488588b4fcf43e6d42a9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 15:03:18.135492 20500 raft_consensus.cc:482] T 00000000000000000000000000000000 P a4ab83be0e63488588b4fcf43e6d42a9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 15:03:18.135619 20500 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a4ab83be0e63488588b4fcf43e6d42a9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:03:18.136631 20500 raft_consensus.cc:504] T 00000000000000000000000000000000 P a4ab83be0e63488588b4fcf43e6d42a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a4ab83be0e63488588b4fcf43e6d42a9" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 37455 } }
I20260811 15:03:18.136986 20500 leader_election.cc:302] T 00000000000000000000000000000000 P a4ab83be0e63488588b4fcf43e6d42a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a4ab83be0e63488588b4fcf43e6d42a9; no voters:
I20260811 15:03:18.137338 20500 leader_election.cc:288] T 00000000000000000000000000000000 P a4ab83be0e63488588b4fcf43e6d42a9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 15:03:18.137422 20505 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a4ab83be0e63488588b4fcf43e6d42a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:03:18.137638 20505 raft_consensus.cc:686] T 00000000000000000000000000000000 P a4ab83be0e63488588b4fcf43e6d42a9 [term 1 LEADER]: Becoming Leader. State: Replica: a4ab83be0e63488588b4fcf43e6d42a9, State: Running, Role: LEADER
I20260811 15:03:18.137944 20505 consensus_queue.cc:237] T 00000000000000000000000000000000 P a4ab83be0e63488588b4fcf43e6d42a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a4ab83be0e63488588b4fcf43e6d42a9" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 37455 } }
I20260811 15:03:18.138681 20500 sys_catalog.cc:564] T 00000000000000000000000000000000 P a4ab83be0e63488588b4fcf43e6d42a9 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:03:18.139751 20506 sys_catalog.cc:455] T 00000000000000000000000000000000 P a4ab83be0e63488588b4fcf43e6d42a9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a4ab83be0e63488588b4fcf43e6d42a9. Latest consensus state: current_term: 1 leader_uuid: "a4ab83be0e63488588b4fcf43e6d42a9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a4ab83be0e63488588b4fcf43e6d42a9" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 37455 } } }
I20260811 15:03:18.139760 20507 sys_catalog.cc:455] T 00000000000000000000000000000000 P a4ab83be0e63488588b4fcf43e6d42a9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a4ab83be0e63488588b4fcf43e6d42a9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a4ab83be0e63488588b4fcf43e6d42a9" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 37455 } } }
I20260811 15:03:18.139995 20507 sys_catalog.cc:458] T 00000000000000000000000000000000 P a4ab83be0e63488588b4fcf43e6d42a9 [sys.catalog]: This master's current role is: LEADER
I20260811 15:03:18.140038 20506 sys_catalog.cc:458] T 00000000000000000000000000000000 P a4ab83be0e63488588b4fcf43e6d42a9 [sys.catalog]: This master's current role is: LEADER
W20260811 15:03:18.144362 20524 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a4ab83be0e63488588b4fcf43e6d42a9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 15:03:18.144450 20524 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
Aug 11 15:03:18 dist-test-slave-8n49 krb5kdc[20409](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460597, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
I20260811 15:03:18.144522 20516 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:03:18.145535 20516 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:03:18.151822 20502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:18.127713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59588 (local address 127.19.236.126:37455)
0811 15:03:18.128263 (+ 550us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:18.128286 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:18.129485 (+ 1199us) server_negotiation.cc:407] Connection header received
0811 15:03:18.133061 (+ 3576us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:18.133081 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:18.133391 (+ 310us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:18.133758 (+ 367us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:18.136220 (+ 2462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:18.137418 (+ 1198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:18.139107 (+ 1689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:18.139983 (+ 876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:18.140146 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:18.145551 (+ 5405us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:18.145557 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:18.145572 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:18.145646 (+ 74us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:18.147687 (+ 2041us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:18.148374 (+ 687us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:18.148380 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:18.148385 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:18.148575 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:18.149000 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:18.149004 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:18.149005 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:18.149613 (+ 608us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:18.149853 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:18.150548 (+ 695us) server_negotiation.cc:299] Negotiation successful
0811 15:03:18.150836 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":357,"thread_start_us":143,"threads_started":1}
I20260811 15:03:18.151965 20516 catalog_manager.cc:1347] Generated new cluster ID: e771406469a74628a0dd1a928f2b6d9d
I20260811 15:03:18.152009 20516 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:03:18.157784 20516 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 15:03:18.158704 20516 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:03:18.167327 20516 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a4ab83be0e63488588b4fcf43e6d42a9: Generated new TSK 0
I20260811 15:03:18.168054 20516 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.236.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.236.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.236.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.65.keytab.
Entry for principal kudu/127.19.236.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.65.keytab.
I20260811 15:03:18.201828 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.65:0
--local_ip_for_outbound_sockets=127.19.236.65
--webserver_interface=127.19.236.65
--webserver_port=0
--tserver_master_addrs=127.19.236.126:37455
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.65.keytab
--principal=kudu/127.19.236.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:45155
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:03:18.318794 20530 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:03:18.319130 20530 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:03:18.319223 20530 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:03:18.323383 20530 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:03:18.323489 20530 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:03:18.323589 20530 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.65
I20260811 15:03:18.329620 20530 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:45155
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.65.keytab
--principal=kudu/127.19.236.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.236.65
--webserver_port=0
--tserver_master_addrs=127.19.236.126:37455
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20530
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.65
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:03:18.330929 20530 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:03:18.332144 20530 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:03:18.342686 20539 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:18.342716 20535 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:18.342810 20530 server_base.cc:1034] running on GCE node
W20260811 15:03:18.342692 20537 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:18.343443 20530 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:03:18.344129 20530 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:03:18.345324 20530 hybrid_clock.cc:648] HybridClock initialized: now 1786460598345310 us; error 35 us; skew 500 ppm
Aug 11 15:03:18 dist-test-slave-8n49 krb5kdc[20409](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460598, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:03:18.348140 20530 init.cc:377] Logged in from keytab as kudu/127.19.236.65@KRBTEST.COM (short username kudu)
I20260811 15:03:18.349162 20530 webserver.cc:460] Webserver started at http://127.19.236.65:41421/ using document root <none> and password file <none>
I20260811 15:03:18.349754 20530 fs_manager.cc:359] Metadata directory not provided
I20260811 15:03:18.349851 20530 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:03:18.350106 20530 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:03:18.352173 20530 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/minicluster-data/ts-0/data/instance:
uuid: "78640cc8200f424da0c794ce5a319a0e"
format_stamp: "Formatted at 2026-08-11 15:03:18 on dist-test-slave-8n49"
server_key: "fce23e8949f74ca26409ca7d572e8dc4"
server_key_iv: "a887d3b5c4f2c81a1e9395e8249e4a58"
server_key_version: "encryptionkey@0"
I20260811 15:03:18.352825 20530 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/minicluster-data/ts-0/wal/instance:
uuid: "78640cc8200f424da0c794ce5a319a0e"
format_stamp: "Formatted at 2026-08-11 15:03:18 on dist-test-slave-8n49"
server_key: "fce23e8949f74ca26409ca7d572e8dc4"
server_key_iv: "a887d3b5c4f2c81a1e9395e8249e4a58"
server_key_version: "encryptionkey@0"
I20260811 15:03:18.356724 20530 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 15:03:18.359215 20547 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:18.360478 20530 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 15:03:18.360644 20530 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/minicluster-data/ts-0/wal
uuid: "78640cc8200f424da0c794ce5a319a0e"
format_stamp: "Formatted at 2026-08-11 15:03:18 on dist-test-slave-8n49"
server_key: "fce23e8949f74ca26409ca7d572e8dc4"
server_key_iv: "a887d3b5c4f2c81a1e9395e8249e4a58"
server_key_version: "encryptionkey@0"
I20260811 15:03:18.360777 20530 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:03:18.385849 20530 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:03:18.389122 20530 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:03:18.389346 20530 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:03:18.389991 20530 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:03:18.390870 20530 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:03:18.390946 20530 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:18.391019 20530 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:03:18.391065 20530 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:18.400518 20530 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.65:39109
I20260811 15:03:18.400565 20672 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.65:39109 every 8 connection(s)
I20260811 15:03:18.401587 20530 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
I20260811 15:03:18.409690 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 20530
I20260811 15:03:18.409777 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/minicluster-data/ts-0/wal/instance
I20260811 15:03:18.410049 20401 external_mini_cluster.cc:1428] Setting key d6c814a363dd66884e23e0577d04a7ee
Aug 11 15:03:18 dist-test-slave-8n49 krb5kdc[20409](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460598, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.65@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
I20260811 15:03:18.415448 20502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:18.403536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.65:42681 (local address 127.19.236.126:37455)
0811 15:03:18.403709 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:18.403713 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:18.404766 (+ 1053us) server_negotiation.cc:407] Connection header received
0811 15:03:18.405625 (+ 859us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:18.405628 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:18.405677 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:18.405756 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:18.406884 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:18.407419 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:18.408527 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:18.408837 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:18.408924 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:18.411473 (+ 2549us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:18.411481 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:18.411484 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:18.411531 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:18.413384 (+ 1853us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:18.413913 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:18.413919 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:18.413923 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:18.414011 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:18.414357 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:18.414361 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:18.414363 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:18.414547 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:18.414659 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:18.415140 (+ 481us) server_negotiation.cc:299] Negotiation successful
0811 15:03:18.415263 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260811 15:03:18.416199 20675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:18.403885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:37455 (local address 127.19.236.65:42681)
0811 15:03:18.404568 (+ 683us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:18.404650 (+ 82us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:18.405399 (+ 749us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:18.405919 (+ 520us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:18.405925 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:18.406269 (+ 344us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:18.406741 (+ 472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:18.406753 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:18.407538 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:18.407541 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:18.408388 (+ 847us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:18.408396 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:18.408979 (+ 583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:18.408982 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:18.409115 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:18.409785 (+ 670us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:03:18.409812 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:18.411302 (+ 1490us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:18.413516 (+ 2214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:18.413522 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:18.413533 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:18.413780 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:18.414110 (+ 330us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:18.414113 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:18.414115 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:18.414253 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:18.414657 (+ 404us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:18.414664 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:18.414896 (+ 232us) client_negotiation.cc:769] Sending connection context
0811 15:03:18.415094 (+ 198us) client_negotiation.cc:240] Negotiation successful
0811 15:03:18.415395 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":477,"thread_start_us":132,"threads_started":1}
I20260811 15:03:18.417615 20673 heartbeater.cc:347] Connected to a master server at 127.19.236.126:37455
I20260811 15:03:18.417878 20673 heartbeater.cc:464] Registering TS with master...
I20260811 15:03:18.418370 20673 heartbeater.cc:511] Master 127.19.236.126:37455 requested a full tablet report, sending...
I20260811 15:03:18.419981 20458 ts_manager.cc:194] Registered new tserver with Master: 78640cc8200f424da0c794ce5a319a0e (127.19.236.65:39109)
WARNING: no policy specified for kudu/127.19.236.66@KRBTEST.COM; defaulting to no policy
I20260811 15:03:18.421255 20458 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.236.65@KRBTEST.COM'} at 127.19.236.65:42681
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.236.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.236.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.66.keytab.
Entry for principal kudu/127.19.236.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.66.keytab.
I20260811 15:03:18.440348 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.66:0
--local_ip_for_outbound_sockets=127.19.236.66
--webserver_interface=127.19.236.66
--webserver_port=0
--tserver_master_addrs=127.19.236.126:37455
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.66.keytab
--principal=kudu/127.19.236.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:45155
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:03:18.554770 20679 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:03:18.555101 20679 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:03:18.555184 20679 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:03:18.559209 20679 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:03:18.559314 20679 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:03:18.559413 20679 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.66
I20260811 15:03:18.564898 20679 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:45155
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.66.keytab
--principal=kudu/127.19.236.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.236.66
--webserver_port=0
--tserver_master_addrs=127.19.236.126:37455
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20679
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.66
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:03:18.566022 20679 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:03:18.567123 20679 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:03:18.576961 20686 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:18.576998 20687 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:18.576993 20690 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:18.577194 20679 server_base.cc:1034] running on GCE node
I20260811 15:03:18.577759 20679 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:03:18.578445 20679 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:03:18.579648 20679 hybrid_clock.cc:648] HybridClock initialized: now 1786460598579640 us; error 32 us; skew 500 ppm
Aug 11 15:03:18 dist-test-slave-8n49 krb5kdc[20409](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460598, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:03:18.582638 20679 init.cc:377] Logged in from keytab as kudu/127.19.236.66@KRBTEST.COM (short username kudu)
I20260811 15:03:18.583629 20679 webserver.cc:460] Webserver started at http://127.19.236.66:43117/ using document root <none> and password file <none>
I20260811 15:03:18.584292 20679 fs_manager.cc:359] Metadata directory not provided
I20260811 15:03:18.584389 20679 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:03:18.584714 20679 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:03:18.586946 20679 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/minicluster-data/ts-1/data/instance:
uuid: "bd262631d25a4ebb854682d376fd6648"
format_stamp: "Formatted at 2026-08-11 15:03:18 on dist-test-slave-8n49"
server_key: "47b19b281d8cb9229a27b92f2c885bc5"
server_key_iv: "c991a48069b524d73d2c9e2d59466c0b"
server_key_version: "encryptionkey@0"
I20260811 15:03:18.587559 20679 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/minicluster-data/ts-1/wal/instance:
uuid: "bd262631d25a4ebb854682d376fd6648"
format_stamp: "Formatted at 2026-08-11 15:03:18 on dist-test-slave-8n49"
server_key: "47b19b281d8cb9229a27b92f2c885bc5"
server_key_iv: "c991a48069b524d73d2c9e2d59466c0b"
server_key_version: "encryptionkey@0"
I20260811 15:03:18.591395 20679 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.006s
I20260811 15:03:18.593953 20698 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:18.595153 20679 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 15:03:18.595297 20679 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/minicluster-data/ts-1/wal
uuid: "bd262631d25a4ebb854682d376fd6648"
format_stamp: "Formatted at 2026-08-11 15:03:18 on dist-test-slave-8n49"
server_key: "47b19b281d8cb9229a27b92f2c885bc5"
server_key_iv: "c991a48069b524d73d2c9e2d59466c0b"
server_key_version: "encryptionkey@0"
I20260811 15:03:18.595418 20679 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:03:18.619441 20679 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:03:18.623052 20679 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:03:18.623279 20679 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:03:18.623944 20679 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:03:18.624908 20679 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:03:18.624984 20679 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:18.625057 20679 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:03:18.625108 20679 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:18.634536 20679 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.66:33171
I20260811 15:03:18.634562 20833 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.66:33171 every 8 connection(s)
I20260811 15:03:18.635463 20679 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
I20260811 15:03:18.637118 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 20679
I20260811 15:03:18.637245 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/minicluster-data/ts-1/wal/instance
I20260811 15:03:18.637549 20401 external_mini_cluster.cc:1428] Setting key 6d9bb10237a69308b00d930506a271ef
Aug 11 15:03:18 dist-test-slave-8n49 krb5kdc[20409](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460598, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.66@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.19.236.67@KRBTEST.COM; defaulting to no policy
I20260811 15:03:18.650476 20502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:18.637537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.66:38507 (local address 127.19.236.126:37455)
0811 15:03:18.637682 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:18.637685 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:18.638893 (+ 1208us) server_negotiation.cc:407] Connection header received
0811 15:03:18.640119 (+ 1226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:18.640122 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:18.640176 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:18.640276 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:18.641756 (+ 1480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:18.642296 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:18.643474 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:18.643713 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:18.643827 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:18.646780 (+ 2953us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:18.646784 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:18.646786 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:18.646812 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:18.648349 (+ 1537us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:18.648944 (+ 595us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:18.648947 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:18.648948 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:18.649087 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:18.649440 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:18.649442 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:18.649443 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:18.649627 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:18.649704 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:18.650219 (+ 515us) server_negotiation.cc:299] Negotiation successful
0811 15:03:18.650331 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.236.67@KRBTEST.COM" created.
I20260811 15:03:18.651300 20836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:18.637950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:37455 (local address 127.19.236.66:38507)
0811 15:03:18.638727 (+ 777us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:18.638781 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:18.639875 (+ 1094us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:18.640528 (+ 653us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:18.640535 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:18.640985 (+ 450us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:18.641599 (+ 614us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:18.641615 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:18.642433 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:18.642437 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:18.643331 (+ 894us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:18.643340 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:18.643884 (+ 544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:18.643888 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:18.644088 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:18.644849 (+ 761us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:03:18.644868 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:18.646573 (+ 1705us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:18.648464 (+ 1891us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:18.648469 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:18.648482 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:18.648820 (+ 338us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:18.649189 (+ 369us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:18.649192 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:18.649193 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:18.649328 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:18.649716 (+ 388us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:18.649721 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:18.649955 (+ 234us) client_negotiation.cc:769] Sending connection context
0811 15:03:18.650110 (+ 155us) client_negotiation.cc:240] Negotiation successful
0811 15:03:18.650363 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":534,"thread_start_us":138,"threads_started":1}
I20260811 15:03:18.652648 20834 heartbeater.cc:347] Connected to a master server at 127.19.236.126:37455
I20260811 15:03:18.652953 20834 heartbeater.cc:464] Registering TS with master...
I20260811 15:03:18.653450 20834 heartbeater.cc:511] Master 127.19.236.126:37455 requested a full tablet report, sending...
I20260811 15:03:18.654592 20458 ts_manager.cc:194] Registered new tserver with Master: bd262631d25a4ebb854682d376fd6648 (127.19.236.66:33171)
I20260811 15:03:18.655470 20458 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.236.66@KRBTEST.COM'} at 127.19.236.66:38507
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.236.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.67.keytab.
Entry for principal kudu/127.19.236.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.67.keytab.
I20260811 15:03:18.668123 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.67:0
--local_ip_for_outbound_sockets=127.19.236.67
--webserver_interface=127.19.236.67
--webserver_port=0
--tserver_master_addrs=127.19.236.126:37455
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.67.keytab
--principal=kudu/127.19.236.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:45155
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:03:18.783703 20840 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:03:18.784027 20840 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:03:18.784104 20840 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:03:18.788153 20840 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:03:18.788257 20840 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:03:18.788357 20840 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.67
I20260811 15:03:18.793824 20840 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:45155
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.67.keytab
--principal=kudu/127.19.236.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.236.67
--webserver_port=0
--tserver_master_addrs=127.19.236.126:37455
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20840
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.67
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:03:18.795012 20840 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:03:18.796085 20840 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:03:18.806255 20851 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:18.806288 20848 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:18.806270 20849 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:18.806633 20840 server_base.cc:1034] running on GCE node
I20260811 15:03:18.807150 20840 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:03:18.807796 20840 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:03:18.808996 20840 hybrid_clock.cc:648] HybridClock initialized: now 1786460598808975 us; error 34 us; skew 500 ppm
Aug 11 15:03:18 dist-test-slave-8n49 krb5kdc[20409](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460598, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:03:18.812042 20840 init.cc:377] Logged in from keytab as kudu/127.19.236.67@KRBTEST.COM (short username kudu)
I20260811 15:03:18.813071 20840 webserver.cc:460] Webserver started at http://127.19.236.67:44973/ using document root <none> and password file <none>
I20260811 15:03:18.813676 20840 fs_manager.cc:359] Metadata directory not provided
I20260811 15:03:18.813772 20840 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:03:18.814046 20840 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:03:18.816186 20840 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/minicluster-data/ts-2/data/instance:
uuid: "c68887d390eb4239b8b7ae91904a2a99"
format_stamp: "Formatted at 2026-08-11 15:03:18 on dist-test-slave-8n49"
server_key: "755fbe5d3d4bba93f66c2e8f9b579ec6"
server_key_iv: "59f7af4db9e2716385ec74e2ccd7ddf8"
server_key_version: "encryptionkey@0"
I20260811 15:03:18.816776 20840 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/minicluster-data/ts-2/wal/instance:
uuid: "c68887d390eb4239b8b7ae91904a2a99"
format_stamp: "Formatted at 2026-08-11 15:03:18 on dist-test-slave-8n49"
server_key: "755fbe5d3d4bba93f66c2e8f9b579ec6"
server_key_iv: "59f7af4db9e2716385ec74e2ccd7ddf8"
server_key_version: "encryptionkey@0"
I20260811 15:03:18.820528 20840 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260811 15:03:18.822960 20859 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:18.824349 20840 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 15:03:18.824455 20840 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/minicluster-data/ts-2/wal
uuid: "c68887d390eb4239b8b7ae91904a2a99"
format_stamp: "Formatted at 2026-08-11 15:03:18 on dist-test-slave-8n49"
server_key: "755fbe5d3d4bba93f66c2e8f9b579ec6"
server_key_iv: "59f7af4db9e2716385ec74e2ccd7ddf8"
server_key_version: "encryptionkey@0"
I20260811 15:03:18.824653 20840 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:03:18.835011 20840 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:03:18.838017 20840 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:03:18.838227 20840 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:03:18.838943 20840 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:03:18.839946 20840 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:03:18.840039 20840 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:18.840111 20840 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:03:18.840145 20840 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:18.849509 20840 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.67:38105
I20260811 15:03:18.849663 20988 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.67:38105 every 8 connection(s)
I20260811 15:03:18.850533 20840 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
I20260811 15:03:18.855149 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 20840
I20260811 15:03:18.855286 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786460596631409-20401-0/minicluster-data/ts-2/wal/instance
I20260811 15:03:18.855590 20401 external_mini_cluster.cc:1428] Setting key 5f759477176190b9dc4604a5b17db4ec
Aug 11 15:03:18 dist-test-slave-8n49 krb5kdc[20409](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460598, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.67@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
I20260811 15:03:18.865634 20502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:18.852469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.67:60873 (local address 127.19.236.126:37455)
0811 15:03:18.852674 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:18.852680 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:18.853782 (+ 1102us) server_negotiation.cc:407] Connection header received
0811 15:03:18.854656 (+ 874us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:18.854659 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:18.854711 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:18.854792 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:18.856469 (+ 1677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:18.857224 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:18.858788 (+ 1564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:18.859043 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:18.859129 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:18.861788 (+ 2659us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:18.861793 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:18.861795 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:18.861822 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:18.863198 (+ 1376us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:18.863799 (+ 601us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:18.863804 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:18.863811 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:18.863894 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:18.864306 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:18.864311 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:18.864313 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:18.864545 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:18.864726 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:18.865284 (+ 558us) server_negotiation.cc:299] Negotiation successful
0811 15:03:18.865440 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 15:03:18.866482 20992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:18.852936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:37455 (local address 127.19.236.67:60873)
0811 15:03:18.853613 (+ 677us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:18.853655 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:18.854435 (+ 780us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:18.855124 (+ 689us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:18.855136 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:18.855664 (+ 528us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:18.856303 (+ 639us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:18.856319 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:18.857389 (+ 1070us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:18.857396 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:18.858663 (+ 1267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:18.858673 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:18.859186 (+ 513us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:18.859188 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:18.859327 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:18.859975 (+ 648us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:03:18.859992 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:18.861587 (+ 1595us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:18.863335 (+ 1748us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:18.863342 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:18.863359 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:18.863668 (+ 309us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:18.864009 (+ 341us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:18.864013 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:18.864016 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:18.864171 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:18.864724 (+ 553us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:18.864733 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:18.865006 (+ 273us) client_negotiation.cc:769] Sending connection context
0811 15:03:18.865219 (+ 213us) client_negotiation.cc:240] Negotiation successful
0811 15:03:18.865578 (+ 359us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":474,"thread_start_us":115,"threads_started":1}
I20260811 15:03:18.867692 20989 heartbeater.cc:347] Connected to a master server at 127.19.236.126:37455
I20260811 15:03:18.867954 20989 heartbeater.cc:464] Registering TS with master...
I20260811 15:03:18.868511 20989 heartbeater.cc:511] Master 127.19.236.126:37455 requested a full tablet report, sending...
I20260811 15:03:18.869634 20458 ts_manager.cc:194] Registered new tserver with Master: c68887d390eb4239b8b7ae91904a2a99 (127.19.236.67:38105)
I20260811 15:03:18.870332 20458 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.236.67@KRBTEST.COM'} at 127.19.236.67:60873
I20260811 15:03:18.870500 20401 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 15:03:18 dist-test-slave-8n49 krb5kdc[20409](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460598, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 15:03:18 dist-test-slave-8n49 krb5kdc[20409](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460598, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.19.236.65@KRBTEST.COM
I20260811 15:03:18.899003 20997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:18.888858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37800 (local address 127.19.236.65:39109)
0811 15:03:18.889185 (+ 327us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:18.889201 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:18.889226 (+ 25us) server_negotiation.cc:407] Connection header received
0811 15:03:18.889347 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:18.889353 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:18.889548 (+ 195us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:18.889678 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:18.890339 (+ 661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:18.891122 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:18.892000 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:18.892403 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:18.892488 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:18.895076 (+ 2588us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:18.895085 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:18.895107 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:18.895132 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:18.896923 (+ 1791us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:18.897381 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:18.897386 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:18.897388 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:18.897470 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:18.897732 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:18.897734 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:18.897735 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:18.898043 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:18.898237 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:18.898535 (+ 298us) server_negotiation.cc:299] Negotiation successful
0811 15:03:18.898777 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":220,"thread_start_us":78,"threads_started":1}
W20260811 15:03:18.900131 20577 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37800
Aug 11 15:03:18 dist-test-slave-8n49 krb5kdc[20409](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460598, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 15:03:18 dist-test-slave-8n49 krb5kdc[20409](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460598, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.236.65@KRBTEST.COM
I20260811 15:03:18.932911 20997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:18.923402 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37814 (local address 127.19.236.65:39109)
0811 15:03:18.923619 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:18.923623 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:18.923669 (+ 46us) server_negotiation.cc:407] Connection header received
0811 15:03:18.923821 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:18.923824 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:18.923870 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:18.923943 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:18.924681 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:18.925241 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:18.926107 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:18.926346 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:18.926441 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:18.929522 (+ 3081us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:18.929526 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:18.929528 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:18.929557 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:18.931198 (+ 1641us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:18.931633 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:18.931637 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:18.931638 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:18.931722 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:18.932056 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:18.932058 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:18.932060 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:18.932232 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:18.932333 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:18.932668 (+ 335us) server_negotiation.cc:299] Negotiation successful
0811 15:03:18.932783 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99}
I20260811 15:03:18.934098 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 20530
I20260811 15:03:18.943553 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 20679
I20260811 15:03:18.954741 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 20840
I20260811 15:03:18.965255 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 20424
2026-08-11T15:03:18Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2330 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 15:03:19 dist-test-slave-8n49 krb5kdc[21004](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 15:03:19 dist-test-slave-8n49 krb5kdc[21004](info): set up 2 sockets
Aug 11 15:03:19 dist-test-slave-8n49 krb5kdc[21004](info): commencing operation
krb5kdc: starting...
W20260811 15:03:20.080716 20401 mini_kdc.cc:121] Time spent starting KDC: real 1.090s user 0.006s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/krb5kdc/test-user.keytab.
Aug 11 15:03:20 dist-test-slave-8n49 krb5kdc[21004](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460600, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T15:03:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T15:03:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.236.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.236.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.236.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab.
Entry for principal kudu/127.19.236.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab.
I20260811 15:03:20.215929 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:33579
--webserver_interface=127.19.236.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab
--principal=kudu/127.19.236.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:44337
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.236.126:33579
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:03:20.337996 21018 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:03:20.338543 21018 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:03:20.338642 21018 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:03:20.343918 21018 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:03:20.344019 21018 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:03:20.344054 21018 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:03:20.344098 21018 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:03:20.344137 21018 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:03:20.350010 21018 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:44337
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.236.126:33579
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab
--principal=kudu/127.19.236.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:33579
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.236.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21018
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:03:20.351287 21018 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:03:20.352468 21018 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:03:20.362200 21025 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:20.362247 21018 server_base.cc:1034] running on GCE node
W20260811 15:03:20.362205 21023 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:20.362206 21027 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:20.363135 21018 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:03:20.364349 21018 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:03:20.365590 21018 hybrid_clock.cc:648] HybridClock initialized: now 1786460600365565 us; error 60 us; skew 500 ppm
Aug 11 15:03:20 dist-test-slave-8n49 krb5kdc[21004](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460600, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:03:20.368844 21018 init.cc:377] Logged in from keytab as kudu/127.19.236.126@KRBTEST.COM (short username kudu)
I20260811 15:03:20.369892 21018 webserver.cc:460] Webserver started at http://127.19.236.126:36889/ using document root <none> and password file <none>
I20260811 15:03:20.370505 21018 fs_manager.cc:359] Metadata directory not provided
I20260811 15:03:20.370606 21018 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:03:20.370831 21018 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:03:20.373150 21018 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/minicluster-data/master-0/data/instance:
uuid: "0ad660171ebd42b4b570afa4d351a087"
format_stamp: "Formatted at 2026-08-11 15:03:20 on dist-test-slave-8n49"
server_key: "d4c4fd6d8c28c8e329025c55e85f1bca"
server_key_iv: "dfddd70485f7470744832d17d500f81d"
server_key_version: "encryptionkey@0"
I20260811 15:03:20.373756 21018 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/minicluster-data/master-0/wal/instance:
uuid: "0ad660171ebd42b4b570afa4d351a087"
format_stamp: "Formatted at 2026-08-11 15:03:20 on dist-test-slave-8n49"
server_key: "d4c4fd6d8c28c8e329025c55e85f1bca"
server_key_iv: "dfddd70485f7470744832d17d500f81d"
server_key_version: "encryptionkey@0"
I20260811 15:03:20.377846 21018 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 15:03:20.380298 21035 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:20.381640 21018 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 15:03:20.381793 21018 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/minicluster-data/master-0/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/minicluster-data/master-0/wal
uuid: "0ad660171ebd42b4b570afa4d351a087"
format_stamp: "Formatted at 2026-08-11 15:03:20 on dist-test-slave-8n49"
server_key: "d4c4fd6d8c28c8e329025c55e85f1bca"
server_key_iv: "dfddd70485f7470744832d17d500f81d"
server_key_version: "encryptionkey@0"
I20260811 15:03:20.381923 21018 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:03:20.399643 21018 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:03:20.403087 21018 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:03:20.403333 21018 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:03:20.410791 21018 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.126:33579
I20260811 15:03:20.410804 21098 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.126:33579 every 8 connection(s)
I20260811 15:03:20.411798 21018 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
I20260811 15:03:20.413714 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 21018
I20260811 15:03:20.413837 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/minicluster-data/master-0/wal/instance
I20260811 15:03:20.414122 20401 external_mini_cluster.cc:1428] Setting key feeed747a602e2c90328767fc27531e0
I20260811 15:03:20.415123 21100 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:03:20.421787 21100 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0ad660171ebd42b4b570afa4d351a087: Bootstrap starting.
Aug 11 15:03:20 dist-test-slave-8n49 krb5kdc[21004](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460600, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
I20260811 15:03:20.424441 21100 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0ad660171ebd42b4b570afa4d351a087: Neither blocks nor log segments found. Creating new log.
I20260811 15:03:20.425417 21100 log.cc:824] T 00000000000000000000000000000000 P 0ad660171ebd42b4b570afa4d351a087: Log is configured to *not* fsync() on all Append() calls
I20260811 15:03:20.427809 21100 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0ad660171ebd42b4b570afa4d351a087: No bootstrap required, opened a new log
I20260811 15:03:20.429193 21104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:20.415696 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35448 (local address 127.19.236.126:33579)
0811 15:03:20.416181 (+ 485us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:20.416196 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:20.416234 (+ 38us) server_negotiation.cc:407] Connection header received
0811 15:03:20.416963 (+ 729us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:20.416981 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:20.417298 (+ 317us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:20.417596 (+ 298us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:20.418518 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:20.419491 (+ 973us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:20.420735 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:20.421191 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:20.421311 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:20.424086 (+ 2775us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:20.424091 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:20.424105 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:20.424134 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:20.426112 (+ 1978us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:20.426551 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:20.426557 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:20.426562 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:20.426696 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:20.426955 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:20.426959 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:20.426961 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:20.427477 (+ 516us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:20.427668 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:20.427915 (+ 247us) server_negotiation.cc:299] Negotiation successful
0811 15:03:20.428240 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":343,"thread_start_us":153,"threads_started":1}
I20260811 15:03:20.431749 21100 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0ad660171ebd42b4b570afa4d351a087 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ad660171ebd42b4b570afa4d351a087" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 33579 } }
I20260811 15:03:20.432046 21100 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0ad660171ebd42b4b570afa4d351a087 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:03:20.432135 21100 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0ad660171ebd42b4b570afa4d351a087 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ad660171ebd42b4b570afa4d351a087, State: Initialized, Role: FOLLOWER
I20260811 15:03:20.432685 21100 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0ad660171ebd42b4b570afa4d351a087 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ad660171ebd42b4b570afa4d351a087" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 33579 } }
I20260811 15:03:20.432842 21100 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0ad660171ebd42b4b570afa4d351a087 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 15:03:20.432909 21100 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0ad660171ebd42b4b570afa4d351a087 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 15:03:20.433004 21100 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0ad660171ebd42b4b570afa4d351a087 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:03:20.434151 21100 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0ad660171ebd42b4b570afa4d351a087 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ad660171ebd42b4b570afa4d351a087" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 33579 } }
I20260811 15:03:20.434504 21100 leader_election.cc:302] T 00000000000000000000000000000000 P 0ad660171ebd42b4b570afa4d351a087 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0ad660171ebd42b4b570afa4d351a087; no voters:
I20260811 15:03:20.434844 21100 leader_election.cc:288] T 00000000000000000000000000000000 P 0ad660171ebd42b4b570afa4d351a087 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 15:03:20.435037 21106 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0ad660171ebd42b4b570afa4d351a087 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:03:20.435379 21106 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0ad660171ebd42b4b570afa4d351a087 [term 1 LEADER]: Becoming Leader. State: Replica: 0ad660171ebd42b4b570afa4d351a087, State: Running, Role: LEADER
I20260811 15:03:20.435702 21106 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0ad660171ebd42b4b570afa4d351a087 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ad660171ebd42b4b570afa4d351a087" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 33579 } }
I20260811 15:03:20.436133 21100 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0ad660171ebd42b4b570afa4d351a087 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:03:20.437623 21107 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0ad660171ebd42b4b570afa4d351a087 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0ad660171ebd42b4b570afa4d351a087" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ad660171ebd42b4b570afa4d351a087" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 33579 } } }
I20260811 15:03:20.437621 21108 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0ad660171ebd42b4b570afa4d351a087 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0ad660171ebd42b4b570afa4d351a087. Latest consensus state: current_term: 1 leader_uuid: "0ad660171ebd42b4b570afa4d351a087" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ad660171ebd42b4b570afa4d351a087" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 33579 } } }
I20260811 15:03:20.437805 21107 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0ad660171ebd42b4b570afa4d351a087 [sys.catalog]: This master's current role is: LEADER
I20260811 15:03:20.437806 21108 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0ad660171ebd42b4b570afa4d351a087 [sys.catalog]: This master's current role is: LEADER
I20260811 15:03:20.438328 21118 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:03:20.441540 21118 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:03:20.447532 21118 catalog_manager.cc:1347] Generated new cluster ID: 8510417c6fb14be4b379c6be6b0f7c23
I20260811 15:03:20.447630 21118 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:03:20.458926 21118 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 15:03:20.460253 21118 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:03:20.472796 21118 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0ad660171ebd42b4b570afa4d351a087: Generated new TSK 0
I20260811 15:03:20.473750 21118 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.236.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.236.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.236.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.65.keytab.
Entry for principal kudu/127.19.236.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.65.keytab.
I20260811 15:03:20.512090 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.65:0
--local_ip_for_outbound_sockets=127.19.236.65
--webserver_interface=127.19.236.65
--webserver_port=0
--tserver_master_addrs=127.19.236.126:33579
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.65.keytab
--principal=kudu/127.19.236.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:44337
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:03:20.626443 21128 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:03:20.626729 21128 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:03:20.626776 21128 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:03:20.631047 21128 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:03:20.631116 21128 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:03:20.631178 21128 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.65
I20260811 15:03:20.636762 21128 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:44337
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.65.keytab
--principal=kudu/127.19.236.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.236.65
--webserver_port=0
--tserver_master_addrs=127.19.236.126:33579
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21128
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.65
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:03:20.637995 21128 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:03:20.639082 21128 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:03:20.649266 21138 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:20.649250 21135 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:20.649369 21134 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:20.649741 21128 server_base.cc:1034] running on GCE node
I20260811 15:03:20.650178 21128 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:03:20.650894 21128 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:03:20.652184 21128 hybrid_clock.cc:648] HybridClock initialized: now 1786460600652161 us; error 64 us; skew 500 ppm
Aug 11 15:03:20 dist-test-slave-8n49 krb5kdc[21004](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460600, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:03:20.655546 21128 init.cc:377] Logged in from keytab as kudu/127.19.236.65@KRBTEST.COM (short username kudu)
I20260811 15:03:20.656646 21128 webserver.cc:460] Webserver started at http://127.19.236.65:34945/ using document root <none> and password file <none>
I20260811 15:03:20.657270 21128 fs_manager.cc:359] Metadata directory not provided
I20260811 15:03:20.657366 21128 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:03:20.657601 21128 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:03:20.659734 21128 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/minicluster-data/ts-0/data/instance:
uuid: "17eff7fd788b4de19cdfd3d5eb98aa20"
format_stamp: "Formatted at 2026-08-11 15:03:20 on dist-test-slave-8n49"
server_key: "0126ee11e6913f9fbe75212790076d93"
server_key_iv: "2cfd53d3ba7669063a8b06392addac98"
server_key_version: "encryptionkey@0"
I20260811 15:03:20.660349 21128 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/minicluster-data/ts-0/wal/instance:
uuid: "17eff7fd788b4de19cdfd3d5eb98aa20"
format_stamp: "Formatted at 2026-08-11 15:03:20 on dist-test-slave-8n49"
server_key: "0126ee11e6913f9fbe75212790076d93"
server_key_iv: "2cfd53d3ba7669063a8b06392addac98"
server_key_version: "encryptionkey@0"
I20260811 15:03:20.664372 21128 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.000s
I20260811 15:03:20.667265 21145 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:20.668776 21128 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 15:03:20.668918 21128 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/minicluster-data/ts-0/wal
uuid: "17eff7fd788b4de19cdfd3d5eb98aa20"
format_stamp: "Formatted at 2026-08-11 15:03:20 on dist-test-slave-8n49"
server_key: "0126ee11e6913f9fbe75212790076d93"
server_key_iv: "2cfd53d3ba7669063a8b06392addac98"
server_key_version: "encryptionkey@0"
I20260811 15:03:20.669051 21128 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:03:20.690745 21128 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:03:20.694227 21128 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:03:20.694557 21128 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:03:20.695212 21128 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:03:20.696085 21128 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:03:20.696159 21128 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:20.696234 21128 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:03:20.696288 21128 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:20.706027 21128 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.65:35891
I20260811 15:03:20.706063 21279 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.65:35891 every 8 connection(s)
I20260811 15:03:20.707015 21128 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
I20260811 15:03:20.709491 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 21128
I20260811 15:03:20.709623 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/minicluster-data/ts-0/wal/instance
I20260811 15:03:20.709885 20401 external_mini_cluster.cc:1428] Setting key 2b0cc43bccbb15b5945f0b0dba2d47b9
Aug 11 15:03:20 dist-test-slave-8n49 krb5kdc[21004](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460600, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.65@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.19.236.66@KRBTEST.COM; defaulting to no policy
I20260811 15:03:20.723356 21104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:20.709067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.65:46891 (local address 127.19.236.126:33579)
0811 15:03:20.709218 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:20.709222 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:20.710158 (+ 936us) server_negotiation.cc:407] Connection header received
0811 15:03:20.711788 (+ 1630us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:20.711792 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:20.711847 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:20.711944 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:20.713272 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:20.713963 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:20.715326 (+ 1363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:20.715580 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:20.715702 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:20.718766 (+ 3064us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:20.718770 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:20.718772 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:20.718800 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:20.720649 (+ 1849us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:20.721415 (+ 766us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:20.721418 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:20.721419 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:20.721514 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:20.722133 (+ 619us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:20.722136 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:20.722138 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:20.722357 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:20.722454 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:20.723025 (+ 571us) server_negotiation.cc:299] Negotiation successful
0811 15:03:20.723163 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.236.66@KRBTEST.COM" created.
I20260811 15:03:20.724337 21282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:20.709406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:33579 (local address 127.19.236.65:46891)
0811 15:03:20.709974 (+ 568us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:20.710033 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:20.711569 (+ 1536us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:20.712159 (+ 590us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:20.712167 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:20.712600 (+ 433us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:20.713114 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:20.713129 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:20.714103 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:20.714107 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:20.715179 (+ 1072us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:20.715190 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:20.715750 (+ 560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:20.715754 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:20.715939 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:20.716626 (+ 687us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:03:20.716652 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:20.718564 (+ 1912us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:20.720850 (+ 2286us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:20.720859 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:20.720882 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:20.721281 (+ 399us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:20.721698 (+ 417us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:20.721708 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:20.721709 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:20.721957 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:20.722477 (+ 520us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:20.722483 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:20.722770 (+ 287us) client_negotiation.cc:769] Sending connection context
0811 15:03:20.722953 (+ 183us) client_negotiation.cc:240] Negotiation successful
0811 15:03:20.723280 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":319,"thread_start_us":146,"threads_started":1}
I20260811 15:03:20.725791 21280 heartbeater.cc:347] Connected to a master server at 127.19.236.126:33579
I20260811 15:03:20.726078 21280 heartbeater.cc:464] Registering TS with master...
I20260811 15:03:20.726631 21280 heartbeater.cc:511] Master 127.19.236.126:33579 requested a full tablet report, sending...
I20260811 15:03:20.728448 21057 ts_manager.cc:194] Registered new tserver with Master: 17eff7fd788b4de19cdfd3d5eb98aa20 (127.19.236.65:35891)
I20260811 15:03:20.730312 21057 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.236.65@KRBTEST.COM'} at 127.19.236.65:46891
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.236.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.66.keytab.
Entry for principal kudu/127.19.236.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.66.keytab.
I20260811 15:03:20.742159 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.66:0
--local_ip_for_outbound_sockets=127.19.236.66
--webserver_interface=127.19.236.66
--webserver_port=0
--tserver_master_addrs=127.19.236.126:33579
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.66.keytab
--principal=kudu/127.19.236.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:44337
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:03:20.859145 21286 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:03:20.859414 21286 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:03:20.859462 21286 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:03:20.863437 21286 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:03:20.863493 21286 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:03:20.863554 21286 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.66
I20260811 15:03:20.868809 21286 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:44337
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.66.keytab
--principal=kudu/127.19.236.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.236.66
--webserver_port=0
--tserver_master_addrs=127.19.236.126:33579
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21286
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.66
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:03:20.869853 21286 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:03:20.870853 21286 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:03:20.880892 21293 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:20.881053 21295 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:20.880892 21292 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:20.881157 21286 server_base.cc:1034] running on GCE node
I20260811 15:03:20.881628 21286 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:03:20.882308 21286 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:03:20.883509 21286 hybrid_clock.cc:648] HybridClock initialized: now 1786460600883467 us; error 51 us; skew 500 ppm
Aug 11 15:03:20 dist-test-slave-8n49 krb5kdc[21004](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460600, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:03:20.886565 21286 init.cc:377] Logged in from keytab as kudu/127.19.236.66@KRBTEST.COM (short username kudu)
I20260811 15:03:20.887523 21286 webserver.cc:460] Webserver started at http://127.19.236.66:43115/ using document root <none> and password file <none>
I20260811 15:03:20.888126 21286 fs_manager.cc:359] Metadata directory not provided
I20260811 15:03:20.888234 21286 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:03:20.888489 21286 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:03:20.890689 21286 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/minicluster-data/ts-1/data/instance:
uuid: "78ad59b11a344dc0ab088abde640fab6"
format_stamp: "Formatted at 2026-08-11 15:03:20 on dist-test-slave-8n49"
server_key: "b168d5db14d461adf207296e87b58026"
server_key_iv: "a65abae55b04e5e7181a287c0e3c8ce4"
server_key_version: "encryptionkey@0"
I20260811 15:03:20.891276 21286 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/minicluster-data/ts-1/wal/instance:
uuid: "78ad59b11a344dc0ab088abde640fab6"
format_stamp: "Formatted at 2026-08-11 15:03:20 on dist-test-slave-8n49"
server_key: "b168d5db14d461adf207296e87b58026"
server_key_iv: "a65abae55b04e5e7181a287c0e3c8ce4"
server_key_version: "encryptionkey@0"
I20260811 15:03:20.895087 21286 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260811 15:03:20.897833 21303 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:20.899164 21286 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 15:03:20.899310 21286 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/minicluster-data/ts-1/wal
uuid: "78ad59b11a344dc0ab088abde640fab6"
format_stamp: "Formatted at 2026-08-11 15:03:20 on dist-test-slave-8n49"
server_key: "b168d5db14d461adf207296e87b58026"
server_key_iv: "a65abae55b04e5e7181a287c0e3c8ce4"
server_key_version: "encryptionkey@0"
I20260811 15:03:20.899436 21286 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:03:20.923652 21286 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:03:20.927451 21286 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:03:20.927695 21286 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:03:20.928402 21286 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:03:20.929430 21286 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:03:20.929507 21286 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:20.929584 21286 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:03:20.929643 21286 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:20.939908 21286 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.66:43655
I20260811 15:03:20.939925 21430 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.66:43655 every 8 connection(s)
I20260811 15:03:20.940968 21286 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
I20260811 15:03:20.949802 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 21286
I20260811 15:03:20.949950 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/minicluster-data/ts-1/wal/instance
I20260811 15:03:20.950235 20401 external_mini_cluster.cc:1428] Setting key 9b42fff13efe4b87d82d0344ad9faa0c
Aug 11 15:03:20 dist-test-slave-8n49 krb5kdc[21004](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460600, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.66@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
I20260811 15:03:20.955252 21104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:20.942811 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.66:33037 (local address 127.19.236.126:33579)
0811 15:03:20.942948 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:20.942952 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:20.943792 (+ 840us) server_negotiation.cc:407] Connection header received
0811 15:03:20.945168 (+ 1376us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:20.945172 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:20.945233 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:20.945346 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:20.946497 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:20.947040 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:20.948185 (+ 1145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:20.948408 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:20.948517 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:20.951234 (+ 2717us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:20.951238 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:20.951241 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:20.951275 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:20.953093 (+ 1818us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:20.953599 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:20.953606 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:20.953610 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:20.953709 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:20.954089 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:20.954092 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:20.954094 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:20.954279 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:20.954393 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:20.954936 (+ 543us) server_negotiation.cc:299] Negotiation successful
0811 15:03:20.955060 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 15:03:20.956161 21434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:20.943176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:33579 (local address 127.19.236.66:33037)
0811 15:03:20.943650 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:20.943692 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:20.944953 (+ 1261us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:20.945522 (+ 569us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:20.945528 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:20.945879 (+ 351us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:20.946353 (+ 474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:20.946366 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:20.947169 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:20.947177 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:20.948047 (+ 870us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:20.948056 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:20.948600 (+ 544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:20.948604 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:20.948766 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:20.949331 (+ 565us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:03:20.949347 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:20.950955 (+ 1608us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:20.953226 (+ 2271us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:20.953232 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:20.953245 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:20.953497 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:20.953827 (+ 330us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:20.953830 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:20.953837 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:20.953975 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:20.954393 (+ 418us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:20.954402 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:20.954661 (+ 259us) client_negotiation.cc:769] Sending connection context
0811 15:03:20.954877 (+ 216us) client_negotiation.cc:240] Negotiation successful
0811 15:03:20.955206 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":287,"thread_start_us":128,"threads_started":1}
I20260811 15:03:20.957398 21431 heartbeater.cc:347] Connected to a master server at 127.19.236.126:33579
I20260811 15:03:20.957700 21431 heartbeater.cc:464] Registering TS with master...
I20260811 15:03:20.958527 21431 heartbeater.cc:511] Master 127.19.236.126:33579 requested a full tablet report, sending...
I20260811 15:03:20.959985 21057 ts_manager.cc:194] Registered new tserver with Master: 78ad59b11a344dc0ab088abde640fab6 (127.19.236.66:43655)
I20260811 15:03:20.960983 21057 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.236.66@KRBTEST.COM'} at 127.19.236.66:33037
WARNING: no policy specified for kudu/127.19.236.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.236.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.236.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.67.keytab.
Entry for principal kudu/127.19.236.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.67.keytab.
I20260811 15:03:20.981735 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.67:0
--local_ip_for_outbound_sockets=127.19.236.67
--webserver_interface=127.19.236.67
--webserver_port=0
--tserver_master_addrs=127.19.236.126:33579
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.67.keytab
--principal=kudu/127.19.236.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:44337
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:03:21.097321 21438 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:03:21.097676 21438 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:03:21.097783 21438 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:03:21.102365 21438 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:03:21.102434 21438 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:03:21.102526 21438 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.67
I20260811 15:03:21.108088 21438 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:44337
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.67.keytab
--principal=kudu/127.19.236.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.236.67
--webserver_port=0
--tserver_master_addrs=127.19.236.126:33579
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21438
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.67
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:03:21.109191 21438 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:03:21.110239 21438 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:03:21.120217 21445 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:21.120249 21447 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:21.120280 21444 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:21.120486 21438 server_base.cc:1034] running on GCE node
I20260811 15:03:21.120939 21438 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:03:21.121637 21438 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:03:21.122839 21438 hybrid_clock.cc:648] HybridClock initialized: now 1786460601122803 us; error 46 us; skew 500 ppm
Aug 11 15:03:21 dist-test-slave-8n49 krb5kdc[21004](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460601, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:03:21.125679 21438 init.cc:377] Logged in from keytab as kudu/127.19.236.67@KRBTEST.COM (short username kudu)
I20260811 15:03:21.126602 21438 webserver.cc:460] Webserver started at http://127.19.236.67:39787/ using document root <none> and password file <none>
I20260811 15:03:21.127206 21438 fs_manager.cc:359] Metadata directory not provided
I20260811 15:03:21.127300 21438 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:03:21.127542 21438 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:03:21.129778 21438 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/minicluster-data/ts-2/data/instance:
uuid: "1b1e8731483f490b9ddc10c9fc8ff274"
format_stamp: "Formatted at 2026-08-11 15:03:21 on dist-test-slave-8n49"
server_key: "d7c6b19341364ae3850db7bea45d45f1"
server_key_iv: "f37ad202eb01c3fda1ce8535a106e8a2"
server_key_version: "encryptionkey@0"
I20260811 15:03:21.130447 21438 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/minicluster-data/ts-2/wal/instance:
uuid: "1b1e8731483f490b9ddc10c9fc8ff274"
format_stamp: "Formatted at 2026-08-11 15:03:21 on dist-test-slave-8n49"
server_key: "d7c6b19341364ae3850db7bea45d45f1"
server_key_iv: "f37ad202eb01c3fda1ce8535a106e8a2"
server_key_version: "encryptionkey@0"
I20260811 15:03:21.134398 21438 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 15:03:21.137058 21454 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:21.138440 21438 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 15:03:21.138545 21438 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/minicluster-data/ts-2/wal
uuid: "1b1e8731483f490b9ddc10c9fc8ff274"
format_stamp: "Formatted at 2026-08-11 15:03:21 on dist-test-slave-8n49"
server_key: "d7c6b19341364ae3850db7bea45d45f1"
server_key_iv: "f37ad202eb01c3fda1ce8535a106e8a2"
server_key_version: "encryptionkey@0"
I20260811 15:03:21.138635 21438 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:03:21.152026 21438 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:03:21.155879 21438 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:03:21.156116 21438 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:03:21.156895 21438 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:03:21.157788 21438 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:03:21.157835 21438 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:21.157907 21438 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:03:21.157944 21438 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:21.167563 21438 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.67:43049
I20260811 15:03:21.167583 21583 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.67:43049 every 8 connection(s)
I20260811 15:03:21.168541 21438 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
I20260811 15:03:21.169014 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 21438
I20260811 15:03:21.169166 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786460596631409-20401-0/minicluster-data/ts-2/wal/instance
I20260811 15:03:21.169497 20401 external_mini_cluster.cc:1428] Setting key fdec9bb96b1c60c9af279d948e776fdb
Aug 11 15:03:21 dist-test-slave-8n49 krb5kdc[21004](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460601, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.67@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
I20260811 15:03:21.184082 21104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:21.170629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.67:48477 (local address 127.19.236.126:33579)
0811 15:03:21.170774 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:21.170779 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:21.172001 (+ 1222us) server_negotiation.cc:407] Connection header received
0811 15:03:21.173572 (+ 1571us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:21.173575 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:21.173636 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:21.173719 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:21.174935 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:21.175484 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:21.176675 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:21.176905 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:21.177015 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:21.179739 (+ 2724us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:21.179743 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:21.179746 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:21.179773 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:21.181531 (+ 1758us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:21.182138 (+ 607us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:21.182147 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:21.182149 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:21.182233 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:21.182626 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:21.182630 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:21.182632 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:21.182886 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:21.182998 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:21.183762 (+ 764us) server_negotiation.cc:299] Negotiation successful
0811 15:03:21.183904 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 15:03:21.185072 21587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:21.171224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:33579 (local address 127.19.236.67:48477)
0811 15:03:21.171828 (+ 604us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:21.171897 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:21.173360 (+ 1463us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:21.173903 (+ 543us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:21.173910 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:21.174284 (+ 374us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:21.174773 (+ 489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:21.174786 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:21.175616 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:21.175625 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:21.176513 (+ 888us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:21.176522 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:21.177071 (+ 549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:21.177075 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:21.177246 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:21.177838 (+ 592us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:03:21.177855 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:21.179538 (+ 1683us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:21.181674 (+ 2136us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:21.181681 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:21.181700 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:21.182009 (+ 309us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:21.182339 (+ 330us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:21.182344 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:21.182346 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:21.182512 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:21.183146 (+ 634us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:21.183156 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:21.183475 (+ 319us) client_negotiation.cc:769] Sending connection context
0811 15:03:21.183714 (+ 239us) client_negotiation.cc:240] Negotiation successful
0811 15:03:21.184100 (+ 386us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":363,"thread_start_us":184,"threads_started":1}
I20260811 15:03:21.186259 21584 heartbeater.cc:347] Connected to a master server at 127.19.236.126:33579
I20260811 15:03:21.186543 21584 heartbeater.cc:464] Registering TS with master...
I20260811 15:03:21.187089 21584 heartbeater.cc:511] Master 127.19.236.126:33579 requested a full tablet report, sending...
I20260811 15:03:21.188190 21057 ts_manager.cc:194] Registered new tserver with Master: 1b1e8731483f490b9ddc10c9fc8ff274 (127.19.236.67:43049)
I20260811 15:03:21.188894 21057 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.236.67@KRBTEST.COM'} at 127.19.236.67:48477
I20260811 15:03:21.196000 20401 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 15:03:21.207301 21104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:21.199779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35454 (local address 127.19.236.126:33579)
0811 15:03:21.199960 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:21.199964 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:21.200059 (+ 95us) server_negotiation.cc:407] Connection header received
0811 15:03:21.200172 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:21.200174 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:21.200217 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:21.200285 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:21.201117 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:21.201629 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:21.202475 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:21.202687 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:21.202761 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:21.204238 (+ 1477us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:21.204241 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:21.204243 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:21.204265 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:21.205787 (+ 1522us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:21.206195 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:21.206197 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:21.206199 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:21.206268 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:21.206522 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:21.206524 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:21.206525 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:21.206731 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:21.206830 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:21.207027 (+ 197us) server_negotiation.cc:299] Negotiation successful
0811 15:03:21.207116 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 15:03:21.212105 21057 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35454:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 15:03:21.215240 21057 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 15:03:21.231033 21601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:21.224100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.65:35891 (local address 127.0.0.1:41510)
0811 15:03:21.225087 (+ 987us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:21.225144 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:21.225293 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:21.225988 (+ 695us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:21.225993 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:21.226016 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:03:21.226161 (+ 145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:21.226168 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:21.227729 (+ 1561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:21.227733 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:21.229292 (+ 1559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:21.229299 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:21.230466 (+ 1167us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:21.230470 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:21.230583 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:21.230636 (+ 53us) client_negotiation.cc:769] Sending connection context
0811 15:03:21.230721 (+ 85us) client_negotiation.cc:240] Negotiation successful
0811 15:03:21.230861 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":794,"mutex_wait_us":139,"spinlock_wait_cycles":6272,"thread_start_us":125,"threads_started":1}
I20260811 15:03:21.231182 21602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:21.224837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34534 (local address 127.19.236.67:43049)
0811 15:03:21.225252 (+ 415us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:21.225270 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:21.225694 (+ 424us) server_negotiation.cc:407] Connection header received
0811 15:03:21.225916 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:21.225921 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:21.226108 (+ 187us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:21.226206 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:03:21.226628 (+ 422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:21.227776 (+ 1148us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:21.229439 (+ 1663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:21.230297 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:21.230392 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:21.230563 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:21.230916 (+ 353us) server_negotiation.cc:299] Negotiation successful
0811 15:03:21.231018 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":316,"thread_start_us":113,"threads_started":1}
I20260811 15:03:21.231622 21598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:21.224414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.67:43049 (local address 127.0.0.1:34534)
0811 15:03:21.225599 (+ 1185us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:21.225613 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:21.225759 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:21.226383 (+ 624us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:21.226388 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:21.226406 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:03:21.226491 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:21.226497 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:21.227929 (+ 1432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:21.227932 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:21.229271 (+ 1339us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:21.229283 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:21.230660 (+ 1377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:21.230663 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:21.230757 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:21.230776 (+ 19us) client_negotiation.cc:769] Sending connection context
0811 15:03:21.231390 (+ 614us) client_negotiation.cc:240] Negotiation successful
0811 15:03:21.231474 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1117,"mutex_wait_us":117,"thread_start_us":76,"threads_started":1}
I20260811 15:03:21.232738 21603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:21.224993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41510 (local address 127.19.236.65:35891)
0811 15:03:21.225585 (+ 592us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:21.225591 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:21.225609 (+ 18us) server_negotiation.cc:407] Connection header received
0811 15:03:21.225671 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:21.225676 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:21.225818 (+ 142us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:21.226314 (+ 496us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:03:21.226466 (+ 152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:21.227598 (+ 1132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:21.229438 (+ 1840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:21.230297 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:21.231595 (+ 1298us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:21.232391 (+ 796us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:21.232446 (+ 55us) server_negotiation.cc:299] Negotiation successful
0811 15:03:21.232541 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":495,"thread_start_us":72,"threads_started":1}
I20260811 15:03:21.233871 21600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:21.224251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47230 (local address 127.19.236.66:43655)
0811 15:03:21.225480 (+ 1229us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:21.225491 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:21.225515 (+ 24us) server_negotiation.cc:407] Connection header received
0811 15:03:21.225594 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:21.225601 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:21.225805 (+ 204us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:21.225981 (+ 176us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:03:21.226415 (+ 434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:21.227257 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:21.230403 (+ 3146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:21.231321 (+ 918us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:21.231802 (+ 481us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:21.231962 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:21.232382 (+ 420us) server_negotiation.cc:299] Negotiation successful
0811 15:03:21.232490 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1125,"thread_start_us":146,"threads_started":1}
I20260811 15:03:21.234228 21597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:21.224100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.66:43655 (local address 127.0.0.1:47230)
0811 15:03:21.225094 (+ 994us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:21.225143 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:21.225292 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:21.226159 (+ 867us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:21.226161 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:21.226177 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:03:21.226284 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:21.226290 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:21.227474 (+ 1184us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:21.227480 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:21.230216 (+ 2736us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:21.230232 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:21.232031 (+ 1799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:21.232035 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:21.232141 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:21.232170 (+ 29us) client_negotiation.cc:769] Sending connection context
0811 15:03:21.234015 (+ 1845us) client_negotiation.cc:240] Negotiation successful
0811 15:03:21.234097 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":904,"mutex_wait_us":92,"spinlock_wait_cycles":6912,"thread_start_us":108,"threads_started":1}
I20260811 15:03:21.235193 21508 tablet_service.cc:1467] Processing CreateTablet for tablet b3127cad5f4e4d1eab7a237973604ac5 (DEFAULT_TABLE table=test-table [id=3aab06de584548579f15a802027f217f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:03:21.235357 21204 tablet_service.cc:1467] Processing CreateTablet for tablet b3127cad5f4e4d1eab7a237973604ac5 (DEFAULT_TABLE table=test-table [id=3aab06de584548579f15a802027f217f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:03:21.236469 21204 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b3127cad5f4e4d1eab7a237973604ac5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:03:21.237484 21508 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b3127cad5f4e4d1eab7a237973604ac5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:03:21.237310 21358 tablet_service.cc:1467] Processing CreateTablet for tablet b3127cad5f4e4d1eab7a237973604ac5 (DEFAULT_TABLE table=test-table [id=3aab06de584548579f15a802027f217f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:03:21.238338 21358 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b3127cad5f4e4d1eab7a237973604ac5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:03:21.243970 21604 tablet_bootstrap.cc:492] T b3127cad5f4e4d1eab7a237973604ac5 P 17eff7fd788b4de19cdfd3d5eb98aa20: Bootstrap starting.
I20260811 15:03:21.245306 21605 tablet_bootstrap.cc:492] T b3127cad5f4e4d1eab7a237973604ac5 P 1b1e8731483f490b9ddc10c9fc8ff274: Bootstrap starting.
I20260811 15:03:21.245958 21606 tablet_bootstrap.cc:492] T b3127cad5f4e4d1eab7a237973604ac5 P 78ad59b11a344dc0ab088abde640fab6: Bootstrap starting.
I20260811 15:03:21.246533 21604 tablet_bootstrap.cc:654] T b3127cad5f4e4d1eab7a237973604ac5 P 17eff7fd788b4de19cdfd3d5eb98aa20: Neither blocks nor log segments found. Creating new log.
I20260811 15:03:21.247452 21604 log.cc:824] T b3127cad5f4e4d1eab7a237973604ac5 P 17eff7fd788b4de19cdfd3d5eb98aa20: Log is configured to *not* fsync() on all Append() calls
I20260811 15:03:21.247726 21606 tablet_bootstrap.cc:654] T b3127cad5f4e4d1eab7a237973604ac5 P 78ad59b11a344dc0ab088abde640fab6: Neither blocks nor log segments found. Creating new log.
I20260811 15:03:21.247745 21605 tablet_bootstrap.cc:654] T b3127cad5f4e4d1eab7a237973604ac5 P 1b1e8731483f490b9ddc10c9fc8ff274: Neither blocks nor log segments found. Creating new log.
I20260811 15:03:21.249027 21606 log.cc:824] T b3127cad5f4e4d1eab7a237973604ac5 P 78ad59b11a344dc0ab088abde640fab6: Log is configured to *not* fsync() on all Append() calls
I20260811 15:03:21.249034 21605 log.cc:824] T b3127cad5f4e4d1eab7a237973604ac5 P 1b1e8731483f490b9ddc10c9fc8ff274: Log is configured to *not* fsync() on all Append() calls
I20260811 15:03:21.250233 21604 tablet_bootstrap.cc:492] T b3127cad5f4e4d1eab7a237973604ac5 P 17eff7fd788b4de19cdfd3d5eb98aa20: No bootstrap required, opened a new log
I20260811 15:03:21.250464 21604 ts_tablet_manager.cc:1397] T b3127cad5f4e4d1eab7a237973604ac5 P 17eff7fd788b4de19cdfd3d5eb98aa20: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260811 15:03:21.250924 21606 tablet_bootstrap.cc:492] T b3127cad5f4e4d1eab7a237973604ac5 P 78ad59b11a344dc0ab088abde640fab6: No bootstrap required, opened a new log
I20260811 15:03:21.250939 21605 tablet_bootstrap.cc:492] T b3127cad5f4e4d1eab7a237973604ac5 P 1b1e8731483f490b9ddc10c9fc8ff274: No bootstrap required, opened a new log
I20260811 15:03:21.251112 21605 ts_tablet_manager.cc:1397] T b3127cad5f4e4d1eab7a237973604ac5 P 1b1e8731483f490b9ddc10c9fc8ff274: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260811 15:03:21.251112 21606 ts_tablet_manager.cc:1397] T b3127cad5f4e4d1eab7a237973604ac5 P 78ad59b11a344dc0ab088abde640fab6: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260811 15:03:21.254417 21604 raft_consensus.cc:348] T b3127cad5f4e4d1eab7a237973604ac5 P 17eff7fd788b4de19cdfd3d5eb98aa20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78ad59b11a344dc0ab088abde640fab6" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 43655 } } peers { permanent_uuid: "17eff7fd788b4de19cdfd3d5eb98aa20" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 35891 } } peers { permanent_uuid: "1b1e8731483f490b9ddc10c9fc8ff274" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 43049 } }
I20260811 15:03:21.254705 21604 raft_consensus.cc:374] T b3127cad5f4e4d1eab7a237973604ac5 P 17eff7fd788b4de19cdfd3d5eb98aa20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:03:21.254765 21604 raft_consensus.cc:729] T b3127cad5f4e4d1eab7a237973604ac5 P 17eff7fd788b4de19cdfd3d5eb98aa20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17eff7fd788b4de19cdfd3d5eb98aa20, State: Initialized, Role: FOLLOWER
I20260811 15:03:21.255311 21605 raft_consensus.cc:348] T b3127cad5f4e4d1eab7a237973604ac5 P 1b1e8731483f490b9ddc10c9fc8ff274 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78ad59b11a344dc0ab088abde640fab6" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 43655 } } peers { permanent_uuid: "17eff7fd788b4de19cdfd3d5eb98aa20" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 35891 } } peers { permanent_uuid: "1b1e8731483f490b9ddc10c9fc8ff274" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 43049 } }
I20260811 15:03:21.255311 21606 raft_consensus.cc:348] T b3127cad5f4e4d1eab7a237973604ac5 P 78ad59b11a344dc0ab088abde640fab6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78ad59b11a344dc0ab088abde640fab6" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 43655 } } peers { permanent_uuid: "17eff7fd788b4de19cdfd3d5eb98aa20" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 35891 } } peers { permanent_uuid: "1b1e8731483f490b9ddc10c9fc8ff274" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 43049 } }
I20260811 15:03:21.255604 21605 raft_consensus.cc:374] T b3127cad5f4e4d1eab7a237973604ac5 P 1b1e8731483f490b9ddc10c9fc8ff274 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:03:21.255604 21606 raft_consensus.cc:374] T b3127cad5f4e4d1eab7a237973604ac5 P 78ad59b11a344dc0ab088abde640fab6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:03:21.255513 21604 consensus_queue.cc:260] T b3127cad5f4e4d1eab7a237973604ac5 P 17eff7fd788b4de19cdfd3d5eb98aa20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78ad59b11a344dc0ab088abde640fab6" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 43655 } } peers { permanent_uuid: "17eff7fd788b4de19cdfd3d5eb98aa20" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 35891 } } peers { permanent_uuid: "1b1e8731483f490b9ddc10c9fc8ff274" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 43049 } }
I20260811 15:03:21.255661 21606 raft_consensus.cc:729] T b3127cad5f4e4d1eab7a237973604ac5 P 78ad59b11a344dc0ab088abde640fab6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78ad59b11a344dc0ab088abde640fab6, State: Initialized, Role: FOLLOWER
I20260811 15:03:21.255669 21605 raft_consensus.cc:729] T b3127cad5f4e4d1eab7a237973604ac5 P 1b1e8731483f490b9ddc10c9fc8ff274 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b1e8731483f490b9ddc10c9fc8ff274, State: Initialized, Role: FOLLOWER
I20260811 15:03:21.256109 21606 consensus_queue.cc:260] T b3127cad5f4e4d1eab7a237973604ac5 P 78ad59b11a344dc0ab088abde640fab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78ad59b11a344dc0ab088abde640fab6" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 43655 } } peers { permanent_uuid: "17eff7fd788b4de19cdfd3d5eb98aa20" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 35891 } } peers { permanent_uuid: "1b1e8731483f490b9ddc10c9fc8ff274" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 43049 } }
I20260811 15:03:21.256109 21605 consensus_queue.cc:260] T b3127cad5f4e4d1eab7a237973604ac5 P 1b1e8731483f490b9ddc10c9fc8ff274 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78ad59b11a344dc0ab088abde640fab6" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 43655 } } peers { permanent_uuid: "17eff7fd788b4de19cdfd3d5eb98aa20" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 35891 } } peers { permanent_uuid: "1b1e8731483f490b9ddc10c9fc8ff274" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 43049 } }
I20260811 15:03:21.256824 21280 heartbeater.cc:503] Master 127.19.236.126:33579 was elected leader, sending a full tablet report...
I20260811 15:03:21.257107 21605 ts_tablet_manager.cc:1428] T b3127cad5f4e4d1eab7a237973604ac5 P 1b1e8731483f490b9ddc10c9fc8ff274: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260811 15:03:21.257261 21584 heartbeater.cc:503] Master 127.19.236.126:33579 was elected leader, sending a full tablet report...
I20260811 15:03:21.257387 21431 heartbeater.cc:503] Master 127.19.236.126:33579 was elected leader, sending a full tablet report...
I20260811 15:03:21.257541 21604 ts_tablet_manager.cc:1428] T b3127cad5f4e4d1eab7a237973604ac5 P 17eff7fd788b4de19cdfd3d5eb98aa20: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260811 15:03:21.257107 21606 ts_tablet_manager.cc:1428] T b3127cad5f4e4d1eab7a237973604ac5 P 78ad59b11a344dc0ab088abde640fab6: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260811 15:03:21.387713 21613 raft_consensus.cc:482] T b3127cad5f4e4d1eab7a237973604ac5 P 78ad59b11a344dc0ab088abde640fab6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 15:03:21.387972 21613 raft_consensus.cc:504] T b3127cad5f4e4d1eab7a237973604ac5 P 78ad59b11a344dc0ab088abde640fab6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78ad59b11a344dc0ab088abde640fab6" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 43655 } } peers { permanent_uuid: "17eff7fd788b4de19cdfd3d5eb98aa20" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 35891 } } peers { permanent_uuid: "1b1e8731483f490b9ddc10c9fc8ff274" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 43049 } }
I20260811 15:03:21.389479 21613 leader_election.cc:288] T b3127cad5f4e4d1eab7a237973604ac5 P 78ad59b11a344dc0ab088abde640fab6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17eff7fd788b4de19cdfd3d5eb98aa20 (127.19.236.65:35891), 1b1e8731483f490b9ddc10c9fc8ff274 (127.19.236.67:43049)
I20260811 15:03:21.393365 21603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:21.389992 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.66:46089 (local address 127.19.236.65:35891)
0811 15:03:21.390143 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:21.390148 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:21.390165 (+ 17us) server_negotiation.cc:407] Connection header received
0811 15:03:21.390227 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:21.390232 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:21.390290 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:21.390371 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:03:21.390736 (+ 365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:21.391245 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:21.392290 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:21.392791 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:21.392929 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:21.392985 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:21.393171 (+ 186us) server_negotiation.cc:299] Negotiation successful
0811 15:03:21.393240 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 15:03:21.393365 21434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:21.389739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.65:35891 (local address 127.19.236.66:46089)
0811 15:03:21.389864 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:21.389881 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:21.389982 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:21.390493 (+ 511us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:21.390497 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:21.390523 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:03:21.390622 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:21.390627 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:21.391360 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:21.391365 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:21.392161 (+ 796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:21.392170 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:21.392922 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:21.392925 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:21.393045 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:21.393064 (+ 19us) client_negotiation.cc:769] Sending connection context
0811 15:03:21.393154 (+ 90us) client_negotiation.cc:240] Negotiation successful
0811 15:03:21.393230 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37,"mutex_wait_us":1}
I20260811 15:03:21.394255 21229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3127cad5f4e4d1eab7a237973604ac5" candidate_uuid: "78ad59b11a344dc0ab088abde640fab6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17eff7fd788b4de19cdfd3d5eb98aa20" is_pre_election: true
I20260811 15:03:21.394354 21614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:21.389760 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.67:43049 (local address 127.19.236.66:33627)
0811 15:03:21.390537 (+ 777us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:21.390550 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:21.390696 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:21.390993 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:21.390996 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:21.391014 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:03:21.391144 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:21.391150 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:21.391934 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:21.391940 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:21.392929 (+ 989us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:21.392938 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:21.393819 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:21.393825 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:21.393946 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:21.393978 (+ 32us) client_negotiation.cc:769] Sending connection context
0811 15:03:21.394068 (+ 90us) client_negotiation.cc:240] Negotiation successful
0811 15:03:21.394153 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":714,"mutex_wait_us":348,"thread_start_us":194,"threads_started":1}
I20260811 15:03:21.394445 21602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:21.389924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.66:33627 (local address 127.19.236.67:43049)
0811 15:03:21.390098 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:21.390103 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:21.390659 (+ 556us) server_negotiation.cc:407] Connection header received
0811 15:03:21.390828 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:21.390832 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:21.390880 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:21.390979 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:03:21.391268 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:21.391810 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:21.393062 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:21.393633 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:21.393763 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:21.393824 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:21.394119 (+ 295us) server_negotiation.cc:299] Negotiation successful
0811 15:03:21.394226 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 15:03:21.394629 21229 raft_consensus.cc:2454] T b3127cad5f4e4d1eab7a237973604ac5 P 17eff7fd788b4de19cdfd3d5eb98aa20 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 78ad59b11a344dc0ab088abde640fab6 in term 0.
I20260811 15:03:21.395143 21308 leader_election.cc:302] T b3127cad5f4e4d1eab7a237973604ac5 P 78ad59b11a344dc0ab088abde640fab6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17eff7fd788b4de19cdfd3d5eb98aa20, 78ad59b11a344dc0ab088abde640fab6; no voters:
I20260811 15:03:21.395258 21529 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3127cad5f4e4d1eab7a237973604ac5" candidate_uuid: "78ad59b11a344dc0ab088abde640fab6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b1e8731483f490b9ddc10c9fc8ff274" is_pre_election: true
I20260811 15:03:21.395444 21613 raft_consensus.cc:2781] T b3127cad5f4e4d1eab7a237973604ac5 P 78ad59b11a344dc0ab088abde640fab6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 15:03:21.395526 21613 raft_consensus.cc:482] T b3127cad5f4e4d1eab7a237973604ac5 P 78ad59b11a344dc0ab088abde640fab6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 15:03:21.395594 21613 raft_consensus.cc:3037] T b3127cad5f4e4d1eab7a237973604ac5 P 78ad59b11a344dc0ab088abde640fab6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:03:21.395615 21529 raft_consensus.cc:2454] T b3127cad5f4e4d1eab7a237973604ac5 P 1b1e8731483f490b9ddc10c9fc8ff274 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 78ad59b11a344dc0ab088abde640fab6 in term 0.
I20260811 15:03:21.396984 21613 raft_consensus.cc:504] T b3127cad5f4e4d1eab7a237973604ac5 P 78ad59b11a344dc0ab088abde640fab6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78ad59b11a344dc0ab088abde640fab6" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 43655 } } peers { permanent_uuid: "17eff7fd788b4de19cdfd3d5eb98aa20" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 35891 } } peers { permanent_uuid: "1b1e8731483f490b9ddc10c9fc8ff274" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 43049 } }
I20260811 15:03:21.397408 21613 leader_election.cc:288] T b3127cad5f4e4d1eab7a237973604ac5 P 78ad59b11a344dc0ab088abde640fab6 [CANDIDATE]: Term 1 election: Requested vote from peers 17eff7fd788b4de19cdfd3d5eb98aa20 (127.19.236.65:35891), 1b1e8731483f490b9ddc10c9fc8ff274 (127.19.236.67:43049)
I20260811 15:03:21.397799 21229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3127cad5f4e4d1eab7a237973604ac5" candidate_uuid: "78ad59b11a344dc0ab088abde640fab6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17eff7fd788b4de19cdfd3d5eb98aa20"
I20260811 15:03:21.397840 21529 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3127cad5f4e4d1eab7a237973604ac5" candidate_uuid: "78ad59b11a344dc0ab088abde640fab6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b1e8731483f490b9ddc10c9fc8ff274"
I20260811 15:03:21.397967 21229 raft_consensus.cc:3037] T b3127cad5f4e4d1eab7a237973604ac5 P 17eff7fd788b4de19cdfd3d5eb98aa20 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:03:21.397974 21529 raft_consensus.cc:3037] T b3127cad5f4e4d1eab7a237973604ac5 P 1b1e8731483f490b9ddc10c9fc8ff274 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:03:21.399034 21529 raft_consensus.cc:2454] T b3127cad5f4e4d1eab7a237973604ac5 P 1b1e8731483f490b9ddc10c9fc8ff274 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78ad59b11a344dc0ab088abde640fab6 in term 1.
I20260811 15:03:21.399042 21229 raft_consensus.cc:2454] T b3127cad5f4e4d1eab7a237973604ac5 P 17eff7fd788b4de19cdfd3d5eb98aa20 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 78ad59b11a344dc0ab088abde640fab6 in term 1.
I20260811 15:03:21.399369 21305 leader_election.cc:302] T b3127cad5f4e4d1eab7a237973604ac5 P 78ad59b11a344dc0ab088abde640fab6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b1e8731483f490b9ddc10c9fc8ff274, 78ad59b11a344dc0ab088abde640fab6; no voters:
I20260811 15:03:21.399626 21613 raft_consensus.cc:2781] T b3127cad5f4e4d1eab7a237973604ac5 P 78ad59b11a344dc0ab088abde640fab6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:03:21.399838 21613 raft_consensus.cc:686] T b3127cad5f4e4d1eab7a237973604ac5 P 78ad59b11a344dc0ab088abde640fab6 [term 1 LEADER]: Becoming Leader. State: Replica: 78ad59b11a344dc0ab088abde640fab6, State: Running, Role: LEADER
I20260811 15:03:21.400170 21613 consensus_queue.cc:237] T b3127cad5f4e4d1eab7a237973604ac5 P 78ad59b11a344dc0ab088abde640fab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78ad59b11a344dc0ab088abde640fab6" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 43655 } } peers { permanent_uuid: "17eff7fd788b4de19cdfd3d5eb98aa20" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 35891 } } peers { permanent_uuid: "1b1e8731483f490b9ddc10c9fc8ff274" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 43049 } }
I20260811 15:03:21.403743 21056 catalog_manager.cc:5495] T b3127cad5f4e4d1eab7a237973604ac5 P 78ad59b11a344dc0ab088abde640fab6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 78ad59b11a344dc0ab088abde640fab6 (127.19.236.66). New cstate: current_term: 1 leader_uuid: "78ad59b11a344dc0ab088abde640fab6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78ad59b11a344dc0ab088abde640fab6" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 43655 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17eff7fd788b4de19cdfd3d5eb98aa20" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 35891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b1e8731483f490b9ddc10c9fc8ff274" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 43049 } health_report { overall_health: UNKNOWN } } }
W20260811 15:03:21.419894 21586 tablet.cc:2369] T b3127cad5f4e4d1eab7a237973604ac5 P 1b1e8731483f490b9ddc10c9fc8ff274: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 11 15:03:21 dist-test-slave-8n49 krb5kdc[21004](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460600, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.236.65@KRBTEST.COM
I20260811 15:03:21.429320 21603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:21.415530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41526 (local address 127.19.236.65:35891)
0811 15:03:21.415683 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:21.415689 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:21.415808 (+ 119us) server_negotiation.cc:407] Connection header received
0811 15:03:21.415909 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:21.415912 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:21.415975 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:21.416071 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:21.416806 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:21.417705 (+ 899us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:21.418623 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:21.419016 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:21.419127 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:21.425183 (+ 6056us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:21.425197 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:21.425217 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:21.425257 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:21.427082 (+ 1825us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:21.427617 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:21.427624 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:21.427625 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:21.427730 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:21.428094 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:21.428098 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:21.428099 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:21.428385 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:21.428668 (+ 283us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:21.428935 (+ 267us) server_negotiation.cc:299] Negotiation successful
0811 15:03:21.429111 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
W20260811 15:03:21.442281 21433 tablet.cc:2369] T b3127cad5f4e4d1eab7a237973604ac5 P 78ad59b11a344dc0ab088abde640fab6: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 11 15:03:21 dist-test-slave-8n49 krb5kdc[21004](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460601, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 15:03:21 dist-test-slave-8n49 krb5kdc[21004](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460601, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.19.236.65@KRBTEST.COM
W20260811 15:03:21.458415 21281 tablet.cc:2369] T b3127cad5f4e4d1eab7a237973604ac5 P 17eff7fd788b4de19cdfd3d5eb98aa20: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 15:03:21.458928 21603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:21.450070 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41540 (local address 127.19.236.65:35891)
0811 15:03:21.450249 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:21.450253 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:21.450325 (+ 72us) server_negotiation.cc:407] Connection header received
0811 15:03:21.450455 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:21.450458 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:21.450504 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:21.450576 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:21.451265 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:21.451792 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:21.452665 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:21.452948 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:21.453047 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:21.455586 (+ 2539us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:21.455590 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:21.455593 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:21.455620 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:21.456995 (+ 1375us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:21.457459 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:21.457464 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:21.457466 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:21.457554 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:21.457854 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:21.457859 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:21.457861 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:21.458103 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:21.458257 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:21.458614 (+ 357us) server_negotiation.cc:299] Negotiation successful
0811 15:03:21.458759 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
Aug 11 15:03:21 dist-test-slave-8n49 krb5kdc[21004](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460601, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 15:03:21 dist-test-slave-8n49 krb5kdc[21004](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460601, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.236.65@KRBTEST.COM
I20260811 15:03:21.488147 21603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:21.478472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41546 (local address 127.19.236.65:35891)
0811 15:03:21.478648 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:21.478655 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:21.478852 (+ 197us) server_negotiation.cc:407] Connection header received
0811 15:03:21.479048 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:21.479056 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:21.479103 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:21.479204 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:21.480088 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:21.480673 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:21.481669 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:21.481914 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:21.482003 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:21.484647 (+ 2644us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:21.484653 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:21.484658 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:21.484696 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:21.486427 (+ 1731us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:21.486895 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:21.486898 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:21.486900 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:21.486994 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:21.487272 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:21.487275 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:21.487276 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:21.487463 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:21.487579 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:21.487794 (+ 215us) server_negotiation.cc:299] Negotiation successful
0811 15:03:21.487907 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
W20260811 15:03:21.489800 21177 tablet_service.cc:2908] Rejecting scan request for tablet b3127cad5f4e4d1eab7a237973604ac5: Uninitialized: clean time has not yet been initialized
I20260811 15:03:21.492022 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 21128
I20260811 15:03:21.501343 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 21286
I20260811 15:03:21.511015 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 21438
I20260811 15:03:21.519675 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 21018
2026-08-11T15:03:21Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2555 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 15:03:21 dist-test-slave-8n49 krb5kdc[21631](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 15:03:21 dist-test-slave-8n49 krb5kdc[21631](info): set up 2 sockets
Aug 11 15:03:21 dist-test-slave-8n49 krb5kdc[21631](info): commencing operation
krb5kdc: starting...
W20260811 15:03:22.656324 20401 mini_kdc.cc:121] Time spent starting KDC: real 1.110s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/krb5kdc/test-user.keytab.
Aug 11 15:03:22 dist-test-slave-8n49 krb5kdc[21631](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460602, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T15:03:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T15:03:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.236.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.236.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.236.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab.
Entry for principal kudu/127.19.236.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab.
I20260811 15:03:22.792413 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:34293
--webserver_interface=127.19.236.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab
--principal=kudu/127.19.236.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:34489
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.236.126:34293
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:03:22.910818 21647 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:03:22.911114 21647 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:03:22.911158 21647 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:03:22.915418 21647 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:03:22.915493 21647 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 15:03:22.915510 21647 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:03:22.915536 21647 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:03:22.915553 21647 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:03:22.915623 21647 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:03:22.921177 21647 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:34489
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.236.126:34293
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab
--principal=kudu/127.19.236.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:34293
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.236.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21647
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:03:22.922353 21647 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:03:22.923456 21647 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:03:22.932685 21655 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:22.932729 21657 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:22.932729 21653 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:22.932973 21647 server_base.cc:1034] running on GCE node
I20260811 15:03:22.933753 21647 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:03:22.934947 21647 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:03:22.936146 21647 hybrid_clock.cc:648] HybridClock initialized: now 1786460602936133 us; error 28 us; skew 500 ppm
Aug 11 15:03:22 dist-test-slave-8n49 krb5kdc[21631](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460602, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:03:22.939038 21647 init.cc:377] Logged in from keytab as kudu/127.19.236.126@KRBTEST.COM (short username kudu)
I20260811 15:03:22.940001 21647 webserver.cc:460] Webserver started at http://127.19.236.126:37213/ using document root <none> and password file <none>
I20260811 15:03:22.940663 21647 fs_manager.cc:359] Metadata directory not provided
I20260811 15:03:22.940758 21647 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:03:22.941032 21647 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:03:22.943217 21647 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/minicluster-data/master-0/data/instance:
uuid: "d3c02e55ad0540199c98fc723c309e8f"
format_stamp: "Formatted at 2026-08-11 15:03:22 on dist-test-slave-8n49"
server_key: "b61fd00f077fc82759d3930142ae9c4b"
server_key_iv: "57bc7869b8abe8b8563e536fd7434c5d"
server_key_version: "encryptionkey@0"
I20260811 15:03:22.943822 21647 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/minicluster-data/master-0/wal/instance:
uuid: "d3c02e55ad0540199c98fc723c309e8f"
format_stamp: "Formatted at 2026-08-11 15:03:22 on dist-test-slave-8n49"
server_key: "b61fd00f077fc82759d3930142ae9c4b"
server_key_iv: "57bc7869b8abe8b8563e536fd7434c5d"
server_key_version: "encryptionkey@0"
I20260811 15:03:22.947952 21647 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260811 15:03:22.950649 21664 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:22.952080 21647 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 15:03:22.952263 21647 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/minicluster-data/master-0/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/minicluster-data/master-0/wal
uuid: "d3c02e55ad0540199c98fc723c309e8f"
format_stamp: "Formatted at 2026-08-11 15:03:22 on dist-test-slave-8n49"
server_key: "b61fd00f077fc82759d3930142ae9c4b"
server_key_iv: "57bc7869b8abe8b8563e536fd7434c5d"
server_key_version: "encryptionkey@0"
I20260811 15:03:22.952433 21647 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:03:22.976529 21647 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:03:22.980087 21647 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:03:22.980331 21647 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:03:22.989161 21647 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.126:34293
I20260811 15:03:22.989178 21736 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.126:34293 every 8 connection(s)
I20260811 15:03:22.990226 21647 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
I20260811 15:03:22.991889 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 21647
I20260811 15:03:22.991990 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/minicluster-data/master-0/wal/instance
I20260811 15:03:22.992286 20401 external_mini_cluster.cc:1428] Setting key 9c35fa252d55e20d73f9b92b6884b661
I20260811 15:03:22.993511 21737 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:03:23.000939 21737 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d3c02e55ad0540199c98fc723c309e8f: Bootstrap starting.
Aug 11 15:03:22 dist-test-slave-8n49 krb5kdc[21631](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460602, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
I20260811 15:03:23.003566 21737 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d3c02e55ad0540199c98fc723c309e8f: Neither blocks nor log segments found. Creating new log.
I20260811 15:03:23.005152 21737 log.cc:824] T 00000000000000000000000000000000 P d3c02e55ad0540199c98fc723c309e8f: Log is configured to *not* fsync() on all Append() calls
I20260811 15:03:23.007678 21737 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d3c02e55ad0540199c98fc723c309e8f: No bootstrap required, opened a new log
I20260811 15:03:23.008597 21740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:22.993856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56956 (local address 127.19.236.126:34293)
0811 15:03:22.994308 (+ 452us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:22.994328 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:22.994374 (+ 46us) server_negotiation.cc:407] Connection header received
0811 15:03:22.995252 (+ 878us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:22.995277 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:22.995704 (+ 427us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:22.996094 (+ 390us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:22.996869 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:22.998390 (+ 1521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:22.999416 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:23.000168 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:23.000341 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:23.003117 (+ 2776us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:23.003124 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:23.003142 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:23.003176 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:23.005477 (+ 2301us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:23.005961 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:23.005971 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:23.005981 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:23.006138 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:23.006474 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:23.006476 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:23.006478 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:23.006878 (+ 400us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:23.007029 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:23.007370 (+ 341us) server_negotiation.cc:299] Negotiation successful
0811 15:03:23.007740 (+ 370us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":297,"thread_start_us":124,"threads_started":1}
I20260811 15:03:23.011291 21737 raft_consensus.cc:348] T 00000000000000000000000000000000 P d3c02e55ad0540199c98fc723c309e8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3c02e55ad0540199c98fc723c309e8f" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 34293 } }
I20260811 15:03:23.011547 21737 raft_consensus.cc:374] T 00000000000000000000000000000000 P d3c02e55ad0540199c98fc723c309e8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:03:23.011631 21737 raft_consensus.cc:729] T 00000000000000000000000000000000 P d3c02e55ad0540199c98fc723c309e8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3c02e55ad0540199c98fc723c309e8f, State: Initialized, Role: FOLLOWER
I20260811 15:03:23.012111 21737 consensus_queue.cc:260] T 00000000000000000000000000000000 P d3c02e55ad0540199c98fc723c309e8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3c02e55ad0540199c98fc723c309e8f" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 34293 } }
I20260811 15:03:23.012279 21737 raft_consensus.cc:388] T 00000000000000000000000000000000 P d3c02e55ad0540199c98fc723c309e8f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 15:03:23.012385 21737 raft_consensus.cc:482] T 00000000000000000000000000000000 P d3c02e55ad0540199c98fc723c309e8f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 15:03:23.012496 21737 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d3c02e55ad0540199c98fc723c309e8f [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:03:23.013540 21737 raft_consensus.cc:504] T 00000000000000000000000000000000 P d3c02e55ad0540199c98fc723c309e8f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3c02e55ad0540199c98fc723c309e8f" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 34293 } }
I20260811 15:03:23.013901 21737 leader_election.cc:302] T 00000000000000000000000000000000 P d3c02e55ad0540199c98fc723c309e8f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d3c02e55ad0540199c98fc723c309e8f; no voters:
I20260811 15:03:23.014261 21737 leader_election.cc:288] T 00000000000000000000000000000000 P d3c02e55ad0540199c98fc723c309e8f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 15:03:23.014403 21742 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d3c02e55ad0540199c98fc723c309e8f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:03:23.014657 21742 raft_consensus.cc:686] T 00000000000000000000000000000000 P d3c02e55ad0540199c98fc723c309e8f [term 1 LEADER]: Becoming Leader. State: Replica: d3c02e55ad0540199c98fc723c309e8f, State: Running, Role: LEADER
I20260811 15:03:23.014967 21742 consensus_queue.cc:237] T 00000000000000000000000000000000 P d3c02e55ad0540199c98fc723c309e8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3c02e55ad0540199c98fc723c309e8f" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 34293 } }
I20260811 15:03:23.015641 21737 sys_catalog.cc:564] T 00000000000000000000000000000000 P d3c02e55ad0540199c98fc723c309e8f [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:03:23.016773 21743 sys_catalog.cc:455] T 00000000000000000000000000000000 P d3c02e55ad0540199c98fc723c309e8f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d3c02e55ad0540199c98fc723c309e8f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3c02e55ad0540199c98fc723c309e8f" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 34293 } } }
I20260811 15:03:23.016918 21743 sys_catalog.cc:458] T 00000000000000000000000000000000 P d3c02e55ad0540199c98fc723c309e8f [sys.catalog]: This master's current role is: LEADER
I20260811 15:03:23.017195 21744 sys_catalog.cc:455] T 00000000000000000000000000000000 P d3c02e55ad0540199c98fc723c309e8f [sys.catalog]: SysCatalogTable state changed. Reason: New leader d3c02e55ad0540199c98fc723c309e8f. Latest consensus state: current_term: 1 leader_uuid: "d3c02e55ad0540199c98fc723c309e8f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3c02e55ad0540199c98fc723c309e8f" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 34293 } } }
I20260811 15:03:23.017279 21744 sys_catalog.cc:458] T 00000000000000000000000000000000 P d3c02e55ad0540199c98fc723c309e8f [sys.catalog]: This master's current role is: LEADER
I20260811 15:03:23.017307 21751 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:03:23.020565 21751 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:03:23.026309 21751 catalog_manager.cc:1347] Generated new cluster ID: 9f027d081fbf46d3b48450474f262b8c
I20260811 15:03:23.026388 21751 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:03:23.042004 21751 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 15:03:23.043349 21751 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:03:23.056810 21751 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d3c02e55ad0540199c98fc723c309e8f: Generated new TSK 0
I20260811 15:03:23.057739 21751 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.236.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.236.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.236.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.65.keytab.
Entry for principal kudu/127.19.236.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.65.keytab.
I20260811 15:03:23.090042 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.65:0
--local_ip_for_outbound_sockets=127.19.236.65
--webserver_interface=127.19.236.65
--webserver_port=0
--tserver_master_addrs=127.19.236.126:34293
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.65.keytab
--principal=kudu/127.19.236.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:34489
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:03:23.231549 21764 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:03:23.231858 21764 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:03:23.231904 21764 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:03:23.236188 21764 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:03:23.236256 21764 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:03:23.236295 21764 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 15:03:23.236384 21764 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.65
I20260811 15:03:23.241772 21764 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:34489
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.65.keytab
--principal=kudu/127.19.236.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.236.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.19.236.126:34293
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21764
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.65
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:03:23.242969 21764 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:03:23.244104 21764 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:03:23.254504 21769 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:23.254495 21771 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:23.254516 21774 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:23.254789 21764 server_base.cc:1034] running on GCE node
I20260811 15:03:23.255242 21764 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:03:23.256057 21764 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:03:23.257246 21764 hybrid_clock.cc:648] HybridClock initialized: now 1786460603257230 us; error 30 us; skew 500 ppm
Aug 11 15:03:23 dist-test-slave-8n49 krb5kdc[21631](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460603, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:03:23.260286 21764 init.cc:377] Logged in from keytab as kudu/127.19.236.65@KRBTEST.COM (short username kudu)
I20260811 15:03:23.261737 21764 webserver.cc:460] Webserver started at http://127.19.236.65:44151/ using document root <none> and password file <none>
I20260811 15:03:23.262547 21764 fs_manager.cc:359] Metadata directory not provided
I20260811 15:03:23.262655 21764 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:03:23.262915 21764 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:03:23.265249 21764 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/minicluster-data/ts-0/data/instance:
uuid: "ef0267fd8fff48649a724c47544874d7"
format_stamp: "Formatted at 2026-08-11 15:03:23 on dist-test-slave-8n49"
server_key: "4d5040e35cdf1498223dc3fa1f116e60"
server_key_iv: "e75b53d5a4dadb7505d1105ed875721b"
server_key_version: "encryptionkey@0"
I20260811 15:03:23.265866 21764 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/minicluster-data/ts-0/wal/instance:
uuid: "ef0267fd8fff48649a724c47544874d7"
format_stamp: "Formatted at 2026-08-11 15:03:23 on dist-test-slave-8n49"
server_key: "4d5040e35cdf1498223dc3fa1f116e60"
server_key_iv: "e75b53d5a4dadb7505d1105ed875721b"
server_key_version: "encryptionkey@0"
I20260811 15:03:23.269932 21764 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 15:03:23.272795 21782 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:23.274168 21764 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 15:03:23.274333 21764 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/minicluster-data/ts-0/wal
uuid: "ef0267fd8fff48649a724c47544874d7"
format_stamp: "Formatted at 2026-08-11 15:03:23 on dist-test-slave-8n49"
server_key: "4d5040e35cdf1498223dc3fa1f116e60"
server_key_iv: "e75b53d5a4dadb7505d1105ed875721b"
server_key_version: "encryptionkey@0"
I20260811 15:03:23.274473 21764 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:03:23.295682 21764 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:03:23.300318 21764 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:03:23.300640 21764 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:03:23.302520 21764 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:03:23.302601 21764 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:23.302702 21764 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:03:23.302757 21764 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 15:03:23 dist-test-slave-8n49 krb5kdc[21631](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460603, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.65@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
I20260811 15:03:23.314402 21764 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.65:38531
I20260811 15:03:23.314447 21906 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.65:38531 every 8 connection(s)
I20260811 15:03:23.315629 21764 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
I20260811 15:03:23.318262 21740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:23.303422 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.65:43249 (local address 127.19.236.126:34293)
0811 15:03:23.303567 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:23.303571 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:23.304784 (+ 1213us) server_negotiation.cc:407] Connection header received
0811 15:03:23.305947 (+ 1163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:23.305951 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:23.306016 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:23.306144 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:23.307929 (+ 1785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:23.308851 (+ 922us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:23.310908 (+ 2057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:23.311175 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:23.311267 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:23.314283 (+ 3016us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:23.314290 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:23.314293 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:23.314326 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:23.315924 (+ 1598us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:23.316529 (+ 605us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:23.316532 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:23.316536 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:23.316650 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:23.317061 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:23.317064 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:23.317065 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:23.317258 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:23.317357 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:23.318006 (+ 649us) server_negotiation.cc:299] Negotiation successful
0811 15:03:23.318135 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 15:03:23.318975 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 21764
I20260811 15:03:23.319073 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/minicluster-data/ts-0/wal/instance
I20260811 15:03:23.319211 21792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:23.304028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:34293 (local address 127.19.236.65:43249)
0811 15:03:23.304620 (+ 592us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:23.304673 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:23.305672 (+ 999us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:23.306395 (+ 723us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:23.306409 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:23.306938 (+ 529us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:23.307715 (+ 777us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:23.307742 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:23.309019 (+ 1277us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:23.309025 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:23.310751 (+ 1726us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:23.310767 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:23.311370 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:23.311375 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:23.311625 (+ 250us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:23.312394 (+ 769us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:03:23.312421 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:23.314073 (+ 1652us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:23.316049 (+ 1976us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:23.316056 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:23.316071 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:23.316432 (+ 361us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:23.316759 (+ 327us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:23.316763 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:23.316765 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:23.316942 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:23.317469 (+ 527us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:23.317475 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:23.317744 (+ 269us) client_negotiation.cc:769] Sending connection context
0811 15:03:23.317932 (+ 188us) client_negotiation.cc:240] Negotiation successful
0811 15:03:23.318199 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":318,"thread_start_us":147,"threads_started":1}
I20260811 15:03:23.319427 20401 external_mini_cluster.cc:1428] Setting key 677a6ac976f53eb20817e9d0353b444a
I20260811 15:03:23.320871 21907 heartbeater.cc:347] Connected to a master server at 127.19.236.126:34293
I20260811 15:03:23.321038 21907 heartbeater.cc:464] Registering TS with master...
I20260811 15:03:23.323683 21907 heartbeater.cc:511] Master 127.19.236.126:34293 requested a full tablet report, sending...
I20260811 15:03:23.325490 21681 ts_manager.cc:194] Registered new tserver with Master: ef0267fd8fff48649a724c47544874d7 (127.19.236.65:38531)
I20260811 15:03:23.326617 21681 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.236.65@KRBTEST.COM'} at 127.19.236.65:43249
WARNING: no policy specified for kudu/127.19.236.66@KRBTEST.COM; defaulting to no policy
I20260811 15:03:23.334928 21914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:23.323521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:34293 (local address 127.19.236.65:39335)
0811 15:03:23.324461 (+ 940us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:23.324480 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:23.324622 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:23.327518 (+ 2896us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:23.327521 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:23.327754 (+ 233us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:23.327877 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:23.327885 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:23.329105 (+ 1220us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:23.329109 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:23.329816 (+ 707us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:23.329829 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:23.330320 (+ 491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:23.330328 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:23.330456 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:23.331039 (+ 583us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:03:23.331061 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:23.331544 (+ 483us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:23.333405 (+ 1861us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:23.333410 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:23.333414 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:23.333683 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:23.333983 (+ 300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:23.333986 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:23.333996 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:23.334097 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:23.334475 (+ 378us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:23.334477 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:23.334560 (+ 83us) client_negotiation.cc:769] Sending connection context
0811 15:03:23.334649 (+ 89us) client_negotiation.cc:240] Negotiation successful
0811 15:03:23.334767 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":836,"thread_start_us":139,"threads_started":1}
I20260811 15:03:23.334933 21740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:23.323592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.65:39335 (local address 127.19.236.126:34293)
0811 15:03:23.323739 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:23.323744 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:23.324579 (+ 835us) server_negotiation.cc:407] Connection header received
0811 15:03:23.324736 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:23.324740 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:23.324789 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:23.324857 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:23.328031 (+ 3174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:23.328961 (+ 930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:23.329956 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:23.330187 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:23.330275 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:23.331726 (+ 1451us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:23.331730 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:23.331732 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:23.331754 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:23.333284 (+ 1530us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:23.333789 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:23.333792 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:23.333794 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:23.333870 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:23.334192 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:23.334194 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:23.334195 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:23.334358 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:23.334478 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:23.334716 (+ 238us) server_negotiation.cc:299] Negotiation successful
0811 15:03:23.334820 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.236.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.236.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.66.keytab.
Entry for principal kudu/127.19.236.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.66.keytab.
I20260811 15:03:23.353099 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.66:0
--local_ip_for_outbound_sockets=127.19.236.66
--webserver_interface=127.19.236.66
--webserver_port=0
--tserver_master_addrs=127.19.236.126:34293
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.66.keytab
--principal=kudu/127.19.236.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:34489
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:03:23.476243 21919 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:03:23.476581 21919 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:03:23.476630 21919 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:03:23.481016 21919 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:03:23.481104 21919 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:03:23.481145 21919 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 15:03:23.481180 21919 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.66
I20260811 15:03:23.487030 21919 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:34489
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.66.keytab
--principal=kudu/127.19.236.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.236.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.19.236.126:34293
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21919
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.66
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:03:23.488276 21919 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:03:23.489390 21919 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:03:23.499513 21928 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:23.499517 21930 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:23.499630 21927 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:23.499783 21919 server_base.cc:1034] running on GCE node
I20260811 15:03:23.500294 21919 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:03:23.501041 21919 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:03:23.502220 21919 hybrid_clock.cc:648] HybridClock initialized: now 1786460603502204 us; error 29 us; skew 500 ppm
Aug 11 15:03:23 dist-test-slave-8n49 krb5kdc[21631](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460603, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:03:23.505267 21919 init.cc:377] Logged in from keytab as kudu/127.19.236.66@KRBTEST.COM (short username kudu)
I20260811 15:03:23.506263 21919 webserver.cc:460] Webserver started at http://127.19.236.66:39553/ using document root <none> and password file <none>
I20260811 15:03:23.506860 21919 fs_manager.cc:359] Metadata directory not provided
I20260811 15:03:23.506924 21919 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:03:23.507153 21919 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:03:23.509528 21919 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/minicluster-data/ts-1/data/instance:
uuid: "b13d92bfdbc04b29a08b01fd3e776f53"
format_stamp: "Formatted at 2026-08-11 15:03:23 on dist-test-slave-8n49"
server_key: "83850e49951d6ee1968843b8f41a1fb1"
server_key_iv: "8b5af1b08396246cf2ec16a8ea2b55af"
server_key_version: "encryptionkey@0"
I20260811 15:03:23.510150 21919 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/minicluster-data/ts-1/wal/instance:
uuid: "b13d92bfdbc04b29a08b01fd3e776f53"
format_stamp: "Formatted at 2026-08-11 15:03:23 on dist-test-slave-8n49"
server_key: "83850e49951d6ee1968843b8f41a1fb1"
server_key_iv: "8b5af1b08396246cf2ec16a8ea2b55af"
server_key_version: "encryptionkey@0"
I20260811 15:03:23.514276 21919 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 15:03:23.517330 21938 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:23.518877 21919 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 15:03:23.519035 21919 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/minicluster-data/ts-1/wal
uuid: "b13d92bfdbc04b29a08b01fd3e776f53"
format_stamp: "Formatted at 2026-08-11 15:03:23 on dist-test-slave-8n49"
server_key: "83850e49951d6ee1968843b8f41a1fb1"
server_key_iv: "8b5af1b08396246cf2ec16a8ea2b55af"
server_key_version: "encryptionkey@0"
I20260811 15:03:23.519172 21919 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:03:23.533298 21919 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:03:23.536885 21919 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:03:23.537101 21919 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:03:23.538646 21919 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:03:23.538722 21919 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:23.538796 21919 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:03:23.538847 21919 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 15:03:23 dist-test-slave-8n49 krb5kdc[21631](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460603, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.66@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
I20260811 15:03:23.550367 21919 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.66:44459
I20260811 15:03:23.550482 22066 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.66:44459 every 8 connection(s)
I20260811 15:03:23.551580 21919 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
I20260811 15:03:23.553807 21740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:23.539474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.66:41635 (local address 127.19.236.126:34293)
0811 15:03:23.539607 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:23.539611 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:23.540716 (+ 1105us) server_negotiation.cc:407] Connection header received
0811 15:03:23.541783 (+ 1067us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:23.541787 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:23.541849 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:23.541937 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:23.543266 (+ 1329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:23.543901 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:23.545390 (+ 1489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:23.545631 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:23.545750 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:23.549498 (+ 3748us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:23.549503 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:23.549506 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:23.549538 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:23.551351 (+ 1813us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:23.552017 (+ 666us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:23.552021 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:23.552026 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:23.552143 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:23.552625 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:23.552629 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:23.552631 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:23.552842 (+ 211us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:23.552969 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:23.553492 (+ 523us) server_negotiation.cc:299] Negotiation successful
0811 15:03:23.553631 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 15:03:23.554597 21949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:23.540032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:34293 (local address 127.19.236.66:41635)
0811 15:03:23.540515 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:23.540614 (+ 99us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:23.541569 (+ 955us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:23.542266 (+ 697us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:23.542279 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:23.542633 (+ 354us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:23.543111 (+ 478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:23.543124 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:23.544037 (+ 913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:23.544045 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:23.545242 (+ 1197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:23.545266 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:23.545808 (+ 542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:23.545813 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:23.546023 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:23.546783 (+ 760us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:03:23.546809 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:23.549295 (+ 2486us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:23.551509 (+ 2214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:23.551515 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:23.551527 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:23.551881 (+ 354us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:23.552264 (+ 383us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:23.552267 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:23.552269 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:23.552480 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:23.552968 (+ 488us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:23.552976 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:23.553228 (+ 252us) client_negotiation.cc:769] Sending connection context
0811 15:03:23.553431 (+ 203us) client_negotiation.cc:240] Negotiation successful
0811 15:03:23.553761 (+ 330us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":293,"thread_start_us":135,"threads_started":1}
I20260811 15:03:23.556049 22067 heartbeater.cc:347] Connected to a master server at 127.19.236.126:34293
I20260811 15:03:23.556237 22067 heartbeater.cc:464] Registering TS with master...
I20260811 15:03:23.556883 22067 heartbeater.cc:511] Master 127.19.236.126:34293 requested a full tablet report, sending...
I20260811 15:03:23.558037 21683 ts_manager.cc:194] Registered new tserver with Master: b13d92bfdbc04b29a08b01fd3e776f53 (127.19.236.66:44459)
I20260811 15:03:23.558739 21683 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.236.66@KRBTEST.COM'} at 127.19.236.66:41635
I20260811 15:03:23.561556 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 21919
I20260811 15:03:23.561666 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/minicluster-data/ts-1/wal/instance
I20260811 15:03:23.561980 20401 external_mini_cluster.cc:1428] Setting key a9af2463bf3744cbbca26992de30359b
I20260811 15:03:23.566450 21740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:23.558718 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.66:38157 (local address 127.19.236.126:34293)
0811 15:03:23.558855 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:23.558859 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:23.559032 (+ 173us) server_negotiation.cc:407] Connection header received
0811 15:03:23.559236 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:23.559238 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:23.559279 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:23.559341 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:23.559907 (+ 566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:23.560461 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:23.561427 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:23.561775 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:23.561890 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:23.563085 (+ 1195us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:23.563089 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:23.563092 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:23.563114 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:23.564655 (+ 1541us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:23.565169 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:23.565171 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:23.565173 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:23.565247 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:23.565566 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:23.565568 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:23.565570 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:23.565778 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:23.565910 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:23.566177 (+ 267us) server_negotiation.cc:299] Negotiation successful
0811 15:03:23.566289 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 15:03:23.566484 22074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:23.558654 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:34293 (local address 127.19.236.66:38157)
0811 15:03:23.558944 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:23.558960 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:23.559136 (+ 176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:23.559384 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:23.559388 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:23.559625 (+ 237us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:23.559765 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:23.559772 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:23.560623 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:23.560627 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:23.561294 (+ 667us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:23.561305 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:23.561904 (+ 599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:23.561907 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:23.561987 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:23.562583 (+ 596us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:03:23.562603 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:23.562953 (+ 350us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:23.564761 (+ 1808us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:23.564768 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:23.564772 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:23.565063 (+ 291us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:23.565339 (+ 276us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:23.565345 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:23.565350 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:23.565467 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:23.565889 (+ 422us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:23.565892 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:23.566000 (+ 108us) client_negotiation.cc:769] Sending connection context
0811 15:03:23.566116 (+ 116us) client_negotiation.cc:240] Negotiation successful
0811 15:03:23.566282 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":201,"mutex_wait_us":5,"thread_start_us":111,"threads_started":1}
WARNING: no policy specified for kudu/127.19.236.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.236.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.236.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.67.keytab.
Entry for principal kudu/127.19.236.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.67.keytab.
I20260811 15:03:23.593015 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.67:0
--local_ip_for_outbound_sockets=127.19.236.67
--webserver_interface=127.19.236.67
--webserver_port=0
--tserver_master_addrs=127.19.236.126:34293
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.67.keytab
--principal=kudu/127.19.236.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:34489
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:03:23.710040 22077 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:03:23.710314 22077 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:03:23.710359 22077 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:03:23.714423 22077 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:03:23.714498 22077 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:03:23.714540 22077 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 15:03:23.714573 22077 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.67
I20260811 15:03:23.720301 22077 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:34489
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.67.keytab
--principal=kudu/127.19.236.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.236.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.19.236.126:34293
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22077
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.67
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:03:23.721561 22077 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:03:23.722744 22077 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:03:23.732818 22083 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:23.732847 22086 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:23.732954 22077 server_base.cc:1034] running on GCE node
W20260811 15:03:23.733104 22084 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:23.733635 22077 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:03:23.734298 22077 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:03:23.735508 22077 hybrid_clock.cc:648] HybridClock initialized: now 1786460603735496 us; error 35 us; skew 500 ppm
Aug 11 15:03:23 dist-test-slave-8n49 krb5kdc[21631](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460603, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:03:23.738287 22077 init.cc:377] Logged in from keytab as kudu/127.19.236.67@KRBTEST.COM (short username kudu)
I20260811 15:03:23.739188 22077 webserver.cc:460] Webserver started at http://127.19.236.67:37415/ using document root <none> and password file <none>
I20260811 15:03:23.739785 22077 fs_manager.cc:359] Metadata directory not provided
I20260811 15:03:23.739880 22077 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:03:23.740113 22077 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:03:23.742204 22077 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/minicluster-data/ts-2/data/instance:
uuid: "89ec29f0eea649adb90e6b8d112d68de"
format_stamp: "Formatted at 2026-08-11 15:03:23 on dist-test-slave-8n49"
server_key: "bfe5883e3832820f16384ace698759c1"
server_key_iv: "d5a53f145509e4dcd5665a5bff939a62"
server_key_version: "encryptionkey@0"
I20260811 15:03:23.742755 22077 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/minicluster-data/ts-2/wal/instance:
uuid: "89ec29f0eea649adb90e6b8d112d68de"
format_stamp: "Formatted at 2026-08-11 15:03:23 on dist-test-slave-8n49"
server_key: "bfe5883e3832820f16384ace698759c1"
server_key_iv: "d5a53f145509e4dcd5665a5bff939a62"
server_key_version: "encryptionkey@0"
I20260811 15:03:23.746712 22077 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 15:03:23.749366 22093 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:23.750901 22077 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 15:03:23.751027 22077 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/minicluster-data/ts-2/wal
uuid: "89ec29f0eea649adb90e6b8d112d68de"
format_stamp: "Formatted at 2026-08-11 15:03:23 on dist-test-slave-8n49"
server_key: "bfe5883e3832820f16384ace698759c1"
server_key_iv: "d5a53f145509e4dcd5665a5bff939a62"
server_key_version: "encryptionkey@0"
I20260811 15:03:23.751125 22077 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:03:23.766721 22077 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:03:23.769979 22077 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:03:23.770146 22077 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:03:23.771732 22077 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:03:23.771812 22077 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:23.771891 22077 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:03:23.771939 22077 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 15:03:23 dist-test-slave-8n49 krb5kdc[21631](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460603, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.67@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
I20260811 15:03:23.784036 22077 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.67:41275
I20260811 15:03:23.784140 22224 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.67:41275 every 8 connection(s)
I20260811 15:03:23.785356 22077 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
I20260811 15:03:23.787138 21740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:23.772514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.67:36875 (local address 127.19.236.126:34293)
0811 15:03:23.772680 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:23.772684 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:23.774444 (+ 1760us) server_negotiation.cc:407] Connection header received
0811 15:03:23.775802 (+ 1358us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:23.775807 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:23.775867 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:23.775969 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:23.777363 (+ 1394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:23.778269 (+ 906us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:23.779707 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:23.779998 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:23.780133 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:23.782839 (+ 2706us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:23.782843 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:23.782848 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:23.782884 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:23.784705 (+ 1821us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:23.785423 (+ 718us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:23.785426 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:23.785428 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:23.785583 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:23.785971 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:23.785975 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:23.785977 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:23.786226 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:23.786327 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:23.786897 (+ 570us) server_negotiation.cc:299] Negotiation successful
0811 15:03:23.787014 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260811 15:03:23.787956 22103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:23.773686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:34293 (local address 127.19.236.67:36875)
0811 15:03:23.774260 (+ 574us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:23.774304 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:23.775537 (+ 1233us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:23.776158 (+ 621us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:23.776168 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:23.776705 (+ 537us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:23.777199 (+ 494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:23.777212 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:23.778416 (+ 1204us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:23.778420 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:23.779561 (+ 1141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:23.779571 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:23.780181 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:23.780186 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:23.780373 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:23.781084 (+ 711us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:03:23.781103 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:23.782648 (+ 1545us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:23.784873 (+ 2225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:23.784881 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:23.784897 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:23.785278 (+ 381us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:23.785671 (+ 393us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:23.785674 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:23.785676 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:23.785827 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:23.786329 (+ 502us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:23.786335 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:23.786628 (+ 293us) client_negotiation.cc:769] Sending connection context
0811 15:03:23.786800 (+ 172us) client_negotiation.cc:240] Negotiation successful
0811 15:03:23.787069 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":330,"thread_start_us":141,"threads_started":1}
I20260811 15:03:23.789471 22225 heartbeater.cc:347] Connected to a master server at 127.19.236.126:34293
I20260811 15:03:23.789633 22225 heartbeater.cc:464] Registering TS with master...
I20260811 15:03:23.790158 22225 heartbeater.cc:511] Master 127.19.236.126:34293 requested a full tablet report, sending...
I20260811 15:03:23.790988 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 22077
I20260811 15:03:23.791116 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/minicluster-data/ts-2/wal/instance
I20260811 15:03:23.791358 21681 ts_manager.cc:194] Registered new tserver with Master: 89ec29f0eea649adb90e6b8d112d68de (127.19.236.67:41275)
I20260811 15:03:23.791394 20401 external_mini_cluster.cc:1428] Setting key 95cfa2141218a8253c1260e443ad73eb
I20260811 15:03:23.792133 21681 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.236.67@KRBTEST.COM'} at 127.19.236.67:36875
I20260811 15:03:23.793524 20401 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 15:03:23.800225 22231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:23.791788 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:34293 (local address 127.19.236.67:37563)
0811 15:03:23.792295 (+ 507us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:23.792310 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:23.792464 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:23.792768 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:23.792772 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:23.792963 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:23.793072 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:23.793077 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:23.794094 (+ 1017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:23.794098 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:23.795043 (+ 945us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:23.795059 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:23.795526 (+ 467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:23.795532 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:23.795666 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:23.796279 (+ 613us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:03:23.796291 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:23.796727 (+ 436us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:23.798637 (+ 1910us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:23.798640 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:23.798643 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:23.798851 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:23.799145 (+ 294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:23.799149 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:23.799151 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:23.799248 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:23.799646 (+ 398us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:23.799649 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:23.799752 (+ 103us) client_negotiation.cc:769] Sending connection context
0811 15:03:23.799862 (+ 110us) client_negotiation.cc:240] Negotiation successful
0811 15:03:23.800035 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":404,"thread_start_us":116,"threads_started":1}
I20260811 15:03:23.800215 21740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:23.791871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.67:37563 (local address 127.19.236.126:34293)
0811 15:03:23.791981 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:23.791985 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:23.792534 (+ 549us) server_negotiation.cc:407] Connection header received
0811 15:03:23.792597 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:23.792600 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:23.792649 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:23.792730 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:23.793186 (+ 456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:23.793942 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:23.795181 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:23.795397 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:23.795492 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:23.796872 (+ 1380us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:23.796876 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:23.796878 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:23.796909 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:23.798506 (+ 1597us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:23.798955 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:23.798959 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:23.798961 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:23.799046 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:23.799345 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:23.799349 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:23.799351 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:23.799544 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:23.799656 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:23.799918 (+ 262us) server_negotiation.cc:299] Negotiation successful
0811 15:03:23.800035 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
Aug 11 15:03:23 dist-test-slave-8n49 krb5kdc[21631](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460603, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 15:03:23 dist-test-slave-8n49 krb5kdc[21631](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460603, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
I20260811 15:03:23.823887 21740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:23.814141 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56968 (local address 127.19.236.126:34293)
0811 15:03:23.814294 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:23.814299 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:23.814312 (+ 13us) server_negotiation.cc:407] Connection header received
0811 15:03:23.814355 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:23.814358 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:23.814414 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:23.814493 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:23.815241 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:23.815883 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:23.816885 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:23.817124 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:23.817213 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:23.820046 (+ 2833us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:23.820049 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:23.820051 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:23.820081 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:23.821676 (+ 1595us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:23.822175 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:23.822178 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:23.822179 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:23.822269 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:23.822891 (+ 622us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:23.822895 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:23.822896 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:23.823145 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:23.823256 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:23.823561 (+ 305us) server_negotiation.cc:299] Negotiation successful
0811 15:03:23.823742 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260811 15:03:23.827237 21681 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56968:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 15:03:23.830407 21681 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 15:03:23.845793 22245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:23.839651 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.67:41275 (local address 127.0.0.1:38012)
0811 15:03:23.840483 (+ 832us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:23.840496 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:23.840677 (+ 181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:23.841344 (+ 667us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:23.841347 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:23.841368 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:03:23.841599 (+ 231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:23.841605 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:23.842886 (+ 1281us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:23.842890 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:23.844224 (+ 1334us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:23.844236 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:23.845406 (+ 1170us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:23.845410 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:23.845505 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:23.845524 (+ 19us) client_negotiation.cc:769] Sending connection context
0811 15:03:23.845595 (+ 71us) client_negotiation.cc:240] Negotiation successful
0811 15:03:23.845652 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":774,"mutex_wait_us":172,"thread_start_us":84,"threads_started":1}
I20260811 15:03:23.845793 22243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:23.839263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.65:38531 (local address 127.0.0.1:56898)
0811 15:03:23.839864 (+ 601us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:23.839918 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:23.840049 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:23.840964 (+ 915us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:23.840970 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:23.840992 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:03:23.841141 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:23.841149 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:23.842618 (+ 1469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:23.842621 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:23.844224 (+ 1603us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:23.844236 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:23.845163 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:23.845167 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:23.845278 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:23.845316 (+ 38us) client_negotiation.cc:769] Sending connection context
0811 15:03:23.845429 (+ 113us) client_negotiation.cc:240] Negotiation successful
0811 15:03:23.845579 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":426,"mutex_wait_us":90,"thread_start_us":86,"threads_started":1}
I20260811 15:03:23.845896 22249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:23.840073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38012 (local address 127.19.236.67:41275)
0811 15:03:23.840399 (+ 326us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:23.840411 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:23.840608 (+ 197us) server_negotiation.cc:407] Connection header received
0811 15:03:23.840831 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:23.840838 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:23.841020 (+ 182us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:23.841197 (+ 177us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:03:23.841732 (+ 535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:23.842775 (+ 1043us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:23.844361 (+ 1586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:23.845183 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:23.845284 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:23.845442 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:23.845644 (+ 202us) server_negotiation.cc:299] Negotiation successful
0811 15:03:23.845745 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":234,"thread_start_us":141,"threads_started":1}
I20260811 15:03:23.846401 22247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:23.839367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56898 (local address 127.19.236.65:38531)
0811 15:03:23.840365 (+ 998us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:23.840374 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:23.840401 (+ 27us) server_negotiation.cc:407] Connection header received
0811 15:03:23.840481 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:23.840489 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:23.840760 (+ 271us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:23.840909 (+ 149us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:03:23.841293 (+ 384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:23.842492 (+ 1199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:23.844395 (+ 1903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:23.845035 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:23.845162 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:23.845324 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:23.846168 (+ 844us) server_negotiation.cc:299] Negotiation successful
0811 15:03:23.846276 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":895,"thread_start_us":99,"threads_started":1}
I20260811 15:03:23.847236 22248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:23.839309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.66:44459 (local address 127.0.0.1:55370)
0811 15:03:23.839963 (+ 654us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:23.839978 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:23.840075 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:23.841404 (+ 1329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:23.841407 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:23.841419 (+ 12us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:03:23.841598 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:23.841605 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:23.843866 (+ 2261us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:23.843869 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:23.845114 (+ 1245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:23.845126 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:23.846806 (+ 1680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:23.846810 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:23.846912 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:23.846945 (+ 33us) client_negotiation.cc:769] Sending connection context
0811 15:03:23.847028 (+ 83us) client_negotiation.cc:240] Negotiation successful
0811 15:03:23.847101 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":586,"mutex_wait_us":60,"thread_start_us":121,"threads_started":1}
I20260811 15:03:23.847659 22250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:23.840091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55370 (local address 127.19.236.66:44459)
0811 15:03:23.840622 (+ 531us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:23.840635 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:23.840660 (+ 25us) server_negotiation.cc:407] Connection header received
0811 15:03:23.840735 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:23.840740 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:23.841285 (+ 545us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:23.841442 (+ 157us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:03:23.842891 (+ 1449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:23.843740 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:23.845271 (+ 1531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:23.846444 (+ 1173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:23.846584 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:23.846738 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:23.847403 (+ 665us) server_negotiation.cc:299] Negotiation successful
0811 15:03:23.847516 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":409,"thread_start_us":123,"threads_started":1}
I20260811 15:03:23.849171 22153 tablet_service.cc:1467] Processing CreateTablet for tablet 732ed79baa8a49bf916d606a63a96982 (DEFAULT_TABLE table=test-table [id=c388f842d8fd41ea9d6b9666dae415c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:03:23.849167 21836 tablet_service.cc:1467] Processing CreateTablet for tablet 732ed79baa8a49bf916d606a63a96982 (DEFAULT_TABLE table=test-table [id=c388f842d8fd41ea9d6b9666dae415c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:03:23.849895 21994 tablet_service.cc:1467] Processing CreateTablet for tablet 732ed79baa8a49bf916d606a63a96982 (DEFAULT_TABLE table=test-table [id=c388f842d8fd41ea9d6b9666dae415c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:03:23.850358 22153 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 732ed79baa8a49bf916d606a63a96982. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:03:23.850354 21836 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 732ed79baa8a49bf916d606a63a96982. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:03:23.850786 21994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 732ed79baa8a49bf916d606a63a96982. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:03:23.858171 22251 tablet_bootstrap.cc:492] T 732ed79baa8a49bf916d606a63a96982 P b13d92bfdbc04b29a08b01fd3e776f53: Bootstrap starting.
I20260811 15:03:23.859493 22253 tablet_bootstrap.cc:492] T 732ed79baa8a49bf916d606a63a96982 P 89ec29f0eea649adb90e6b8d112d68de: Bootstrap starting.
I20260811 15:03:23.859493 22252 tablet_bootstrap.cc:492] T 732ed79baa8a49bf916d606a63a96982 P ef0267fd8fff48649a724c47544874d7: Bootstrap starting.
I20260811 15:03:23.861215 22251 tablet_bootstrap.cc:654] T 732ed79baa8a49bf916d606a63a96982 P b13d92bfdbc04b29a08b01fd3e776f53: Neither blocks nor log segments found. Creating new log.
I20260811 15:03:23.861819 22253 tablet_bootstrap.cc:654] T 732ed79baa8a49bf916d606a63a96982 P 89ec29f0eea649adb90e6b8d112d68de: Neither blocks nor log segments found. Creating new log.
I20260811 15:03:23.861819 22252 tablet_bootstrap.cc:654] T 732ed79baa8a49bf916d606a63a96982 P ef0267fd8fff48649a724c47544874d7: Neither blocks nor log segments found. Creating new log.
I20260811 15:03:23.862051 22251 log.cc:824] T 732ed79baa8a49bf916d606a63a96982 P b13d92bfdbc04b29a08b01fd3e776f53: Log is configured to *not* fsync() on all Append() calls
I20260811 15:03:23.862723 22253 log.cc:824] T 732ed79baa8a49bf916d606a63a96982 P 89ec29f0eea649adb90e6b8d112d68de: Log is configured to *not* fsync() on all Append() calls
I20260811 15:03:23.862723 22252 log.cc:824] T 732ed79baa8a49bf916d606a63a96982 P ef0267fd8fff48649a724c47544874d7: Log is configured to *not* fsync() on all Append() calls
I20260811 15:03:23.864070 22251 tablet_bootstrap.cc:492] T 732ed79baa8a49bf916d606a63a96982 P b13d92bfdbc04b29a08b01fd3e776f53: No bootstrap required, opened a new log
I20260811 15:03:23.864279 22251 ts_tablet_manager.cc:1397] T 732ed79baa8a49bf916d606a63a96982 P b13d92bfdbc04b29a08b01fd3e776f53: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260811 15:03:23.864660 22253 tablet_bootstrap.cc:492] T 732ed79baa8a49bf916d606a63a96982 P 89ec29f0eea649adb90e6b8d112d68de: No bootstrap required, opened a new log
I20260811 15:03:23.864851 22253 ts_tablet_manager.cc:1397] T 732ed79baa8a49bf916d606a63a96982 P 89ec29f0eea649adb90e6b8d112d68de: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.001s
I20260811 15:03:23.865548 22252 tablet_bootstrap.cc:492] T 732ed79baa8a49bf916d606a63a96982 P ef0267fd8fff48649a724c47544874d7: No bootstrap required, opened a new log
I20260811 15:03:23.865741 22252 ts_tablet_manager.cc:1397] T 732ed79baa8a49bf916d606a63a96982 P ef0267fd8fff48649a724c47544874d7: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260811 15:03:23.867640 22251 raft_consensus.cc:348] T 732ed79baa8a49bf916d606a63a96982 P b13d92bfdbc04b29a08b01fd3e776f53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0267fd8fff48649a724c47544874d7" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 38531 } } peers { permanent_uuid: "b13d92bfdbc04b29a08b01fd3e776f53" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 44459 } } peers { permanent_uuid: "89ec29f0eea649adb90e6b8d112d68de" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 41275 } }
I20260811 15:03:23.867887 22251 raft_consensus.cc:374] T 732ed79baa8a49bf916d606a63a96982 P b13d92bfdbc04b29a08b01fd3e776f53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:03:23.867950 22251 raft_consensus.cc:729] T 732ed79baa8a49bf916d606a63a96982 P b13d92bfdbc04b29a08b01fd3e776f53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b13d92bfdbc04b29a08b01fd3e776f53, State: Initialized, Role: FOLLOWER
I20260811 15:03:23.868403 22251 consensus_queue.cc:260] T 732ed79baa8a49bf916d606a63a96982 P b13d92bfdbc04b29a08b01fd3e776f53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0267fd8fff48649a724c47544874d7" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 38531 } } peers { permanent_uuid: "b13d92bfdbc04b29a08b01fd3e776f53" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 44459 } } peers { permanent_uuid: "89ec29f0eea649adb90e6b8d112d68de" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 41275 } }
I20260811 15:03:23.869138 22067 heartbeater.cc:503] Master 127.19.236.126:34293 was elected leader, sending a full tablet report...
I20260811 15:03:23.869236 22253 raft_consensus.cc:348] T 732ed79baa8a49bf916d606a63a96982 P 89ec29f0eea649adb90e6b8d112d68de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0267fd8fff48649a724c47544874d7" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 38531 } } peers { permanent_uuid: "b13d92bfdbc04b29a08b01fd3e776f53" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 44459 } } peers { permanent_uuid: "89ec29f0eea649adb90e6b8d112d68de" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 41275 } }
I20260811 15:03:23.869457 22251 ts_tablet_manager.cc:1428] T 732ed79baa8a49bf916d606a63a96982 P b13d92bfdbc04b29a08b01fd3e776f53: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260811 15:03:23.869518 22253 raft_consensus.cc:374] T 732ed79baa8a49bf916d606a63a96982 P 89ec29f0eea649adb90e6b8d112d68de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:03:23.869590 22253 raft_consensus.cc:729] T 732ed79baa8a49bf916d606a63a96982 P 89ec29f0eea649adb90e6b8d112d68de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89ec29f0eea649adb90e6b8d112d68de, State: Initialized, Role: FOLLOWER
I20260811 15:03:23.870052 22253 consensus_queue.cc:260] T 732ed79baa8a49bf916d606a63a96982 P 89ec29f0eea649adb90e6b8d112d68de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0267fd8fff48649a724c47544874d7" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 38531 } } peers { permanent_uuid: "b13d92bfdbc04b29a08b01fd3e776f53" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 44459 } } peers { permanent_uuid: "89ec29f0eea649adb90e6b8d112d68de" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 41275 } }
I20260811 15:03:23.871102 22253 ts_tablet_manager.cc:1428] T 732ed79baa8a49bf916d606a63a96982 P 89ec29f0eea649adb90e6b8d112d68de: Time spent starting tablet: real 0.006s user 0.003s sys 0.002s
I20260811 15:03:23.871476 22225 heartbeater.cc:503] Master 127.19.236.126:34293 was elected leader, sending a full tablet report...
I20260811 15:03:23.871485 22252 raft_consensus.cc:348] T 732ed79baa8a49bf916d606a63a96982 P ef0267fd8fff48649a724c47544874d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0267fd8fff48649a724c47544874d7" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 38531 } } peers { permanent_uuid: "b13d92bfdbc04b29a08b01fd3e776f53" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 44459 } } peers { permanent_uuid: "89ec29f0eea649adb90e6b8d112d68de" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 41275 } }
I20260811 15:03:23.871759 22252 raft_consensus.cc:374] T 732ed79baa8a49bf916d606a63a96982 P ef0267fd8fff48649a724c47544874d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:03:23.871835 22252 raft_consensus.cc:729] T 732ed79baa8a49bf916d606a63a96982 P ef0267fd8fff48649a724c47544874d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0267fd8fff48649a724c47544874d7, State: Initialized, Role: FOLLOWER
I20260811 15:03:23.872318 22252 consensus_queue.cc:260] T 732ed79baa8a49bf916d606a63a96982 P ef0267fd8fff48649a724c47544874d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0267fd8fff48649a724c47544874d7" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 38531 } } peers { permanent_uuid: "b13d92bfdbc04b29a08b01fd3e776f53" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 44459 } } peers { permanent_uuid: "89ec29f0eea649adb90e6b8d112d68de" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 41275 } }
I20260811 15:03:23.873239 21907 heartbeater.cc:503] Master 127.19.236.126:34293 was elected leader, sending a full tablet report...
I20260811 15:03:23.873833 22252 ts_tablet_manager.cc:1428] T 732ed79baa8a49bf916d606a63a96982 P ef0267fd8fff48649a724c47544874d7: Time spent starting tablet: real 0.008s user 0.008s sys 0.000s
I20260811 15:03:23.893397 22259 raft_consensus.cc:482] T 732ed79baa8a49bf916d606a63a96982 P 89ec29f0eea649adb90e6b8d112d68de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 15:03:23.893610 22259 raft_consensus.cc:504] T 732ed79baa8a49bf916d606a63a96982 P 89ec29f0eea649adb90e6b8d112d68de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0267fd8fff48649a724c47544874d7" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 38531 } } peers { permanent_uuid: "b13d92bfdbc04b29a08b01fd3e776f53" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 44459 } } peers { permanent_uuid: "89ec29f0eea649adb90e6b8d112d68de" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 41275 } }
I20260811 15:03:23.894726 22259 leader_election.cc:288] T 732ed79baa8a49bf916d606a63a96982 P 89ec29f0eea649adb90e6b8d112d68de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef0267fd8fff48649a724c47544874d7 (127.19.236.65:38531), b13d92bfdbc04b29a08b01fd3e776f53 (127.19.236.66:44459)
I20260811 15:03:23.899082 22103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:23.895014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.65:38531 (local address 127.19.236.67:33215)
0811 15:03:23.895189 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:23.895207 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:23.895312 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:23.895683 (+ 371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:23.895704 (+ 21us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:23.895731 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:03:23.895908 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:23.895916 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:23.896790 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:23.896794 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:23.897695 (+ 901us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:23.897706 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:23.898592 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:23.898594 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:23.898753 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:23.898780 (+ 27us) client_negotiation.cc:769] Sending connection context
0811 15:03:23.898867 (+ 87us) client_negotiation.cc:240] Negotiation successful
0811 15:03:23.898936 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":69,"spinlock_wait_cycles":33664}
I20260811 15:03:23.899093 22247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:23.895271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.67:33215 (local address 127.19.236.65:38531)
0811 15:03:23.895433 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:23.895437 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:23.895453 (+ 16us) server_negotiation.cc:407] Connection header received
0811 15:03:23.895513 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:23.895517 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:23.895566 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:23.895658 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:03:23.896062 (+ 404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:23.896687 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:23.897829 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:23.898461 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:23.898592 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:23.898665 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:23.898919 (+ 254us) server_negotiation.cc:299] Negotiation successful
0811 15:03:23.898995 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 15:03:23.899747 21858 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "732ed79baa8a49bf916d606a63a96982" candidate_uuid: "89ec29f0eea649adb90e6b8d112d68de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0267fd8fff48649a724c47544874d7" is_pre_election: true
I20260811 15:03:23.899899 22250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:23.895152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.67:46763 (local address 127.19.236.66:44459)
0811 15:03:23.895316 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:23.895323 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:23.895730 (+ 407us) server_negotiation.cc:407] Connection header received
0811 15:03:23.895926 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:23.895930 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:23.895991 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:23.896073 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:03:23.896344 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:23.896997 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:23.898725 (+ 1728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:23.899355 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:23.899488 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:23.899535 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:23.899713 (+ 178us) server_negotiation.cc:299] Negotiation successful
0811 15:03:23.899780 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 15:03:23.899910 22261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:23.895014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.66:44459 (local address 127.19.236.67:46763)
0811 15:03:23.895622 (+ 608us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:23.895639 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:23.895797 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:23.896088 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:23.896091 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:23.896107 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:03:23.896229 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:23.896234 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:23.897112 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:23.897115 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:23.898593 (+ 1478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:23.898604 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:23.899476 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:23.899480 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:23.899578 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:23.899598 (+ 20us) client_negotiation.cc:769] Sending connection context
0811 15:03:23.899694 (+ 96us) client_negotiation.cc:240] Negotiation successful
0811 15:03:23.899760 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":525,"mutex_wait_us":209,"spinlock_wait_cycles":16768,"thread_start_us":137,"threads_started":1}
I20260811 15:03:23.900138 21858 raft_consensus.cc:2454] T 732ed79baa8a49bf916d606a63a96982 P ef0267fd8fff48649a724c47544874d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ec29f0eea649adb90e6b8d112d68de in term 0.
I20260811 15:03:23.900630 22016 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "732ed79baa8a49bf916d606a63a96982" candidate_uuid: "89ec29f0eea649adb90e6b8d112d68de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b13d92bfdbc04b29a08b01fd3e776f53" is_pre_election: true
I20260811 15:03:23.900717 22098 leader_election.cc:302] T 732ed79baa8a49bf916d606a63a96982 P 89ec29f0eea649adb90e6b8d112d68de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89ec29f0eea649adb90e6b8d112d68de, ef0267fd8fff48649a724c47544874d7; no voters:
I20260811 15:03:23.900924 22016 raft_consensus.cc:2454] T 732ed79baa8a49bf916d606a63a96982 P b13d92bfdbc04b29a08b01fd3e776f53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ec29f0eea649adb90e6b8d112d68de in term 0.
I20260811 15:03:23.901039 22259 raft_consensus.cc:2781] T 732ed79baa8a49bf916d606a63a96982 P 89ec29f0eea649adb90e6b8d112d68de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 15:03:23.901135 22259 raft_consensus.cc:482] T 732ed79baa8a49bf916d606a63a96982 P 89ec29f0eea649adb90e6b8d112d68de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 15:03:23.901192 22259 raft_consensus.cc:3037] T 732ed79baa8a49bf916d606a63a96982 P 89ec29f0eea649adb90e6b8d112d68de [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:03:23.902343 22259 raft_consensus.cc:504] T 732ed79baa8a49bf916d606a63a96982 P 89ec29f0eea649adb90e6b8d112d68de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0267fd8fff48649a724c47544874d7" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 38531 } } peers { permanent_uuid: "b13d92bfdbc04b29a08b01fd3e776f53" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 44459 } } peers { permanent_uuid: "89ec29f0eea649adb90e6b8d112d68de" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 41275 } }
I20260811 15:03:23.902738 22259 leader_election.cc:288] T 732ed79baa8a49bf916d606a63a96982 P 89ec29f0eea649adb90e6b8d112d68de [CANDIDATE]: Term 1 election: Requested vote from peers ef0267fd8fff48649a724c47544874d7 (127.19.236.65:38531), b13d92bfdbc04b29a08b01fd3e776f53 (127.19.236.66:44459)
I20260811 15:03:23.903096 22016 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "732ed79baa8a49bf916d606a63a96982" candidate_uuid: "89ec29f0eea649adb90e6b8d112d68de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b13d92bfdbc04b29a08b01fd3e776f53"
I20260811 15:03:23.903138 21858 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "732ed79baa8a49bf916d606a63a96982" candidate_uuid: "89ec29f0eea649adb90e6b8d112d68de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0267fd8fff48649a724c47544874d7"
I20260811 15:03:23.903257 21858 raft_consensus.cc:3037] T 732ed79baa8a49bf916d606a63a96982 P ef0267fd8fff48649a724c47544874d7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:03:23.903257 22016 raft_consensus.cc:3037] T 732ed79baa8a49bf916d606a63a96982 P b13d92bfdbc04b29a08b01fd3e776f53 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:03:23.904713 21858 raft_consensus.cc:2454] T 732ed79baa8a49bf916d606a63a96982 P ef0267fd8fff48649a724c47544874d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ec29f0eea649adb90e6b8d112d68de in term 1.
I20260811 15:03:23.905164 22098 leader_election.cc:302] T 732ed79baa8a49bf916d606a63a96982 P 89ec29f0eea649adb90e6b8d112d68de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89ec29f0eea649adb90e6b8d112d68de, ef0267fd8fff48649a724c47544874d7; no voters:
I20260811 15:03:23.905179 22016 raft_consensus.cc:2454] T 732ed79baa8a49bf916d606a63a96982 P b13d92bfdbc04b29a08b01fd3e776f53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ec29f0eea649adb90e6b8d112d68de in term 1.
I20260811 15:03:23.905364 22259 raft_consensus.cc:2781] T 732ed79baa8a49bf916d606a63a96982 P 89ec29f0eea649adb90e6b8d112d68de [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:03:23.905757 22259 raft_consensus.cc:686] T 732ed79baa8a49bf916d606a63a96982 P 89ec29f0eea649adb90e6b8d112d68de [term 1 LEADER]: Becoming Leader. State: Replica: 89ec29f0eea649adb90e6b8d112d68de, State: Running, Role: LEADER
I20260811 15:03:23.906177 22259 consensus_queue.cc:237] T 732ed79baa8a49bf916d606a63a96982 P 89ec29f0eea649adb90e6b8d112d68de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0267fd8fff48649a724c47544874d7" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 38531 } } peers { permanent_uuid: "b13d92bfdbc04b29a08b01fd3e776f53" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 44459 } } peers { permanent_uuid: "89ec29f0eea649adb90e6b8d112d68de" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 41275 } }
I20260811 15:03:23.909340 21683 catalog_manager.cc:5495] T 732ed79baa8a49bf916d606a63a96982 P 89ec29f0eea649adb90e6b8d112d68de reported cstate change: term changed from 0 to 1, leader changed from <none> to 89ec29f0eea649adb90e6b8d112d68de (127.19.236.67). New cstate: current_term: 1 leader_uuid: "89ec29f0eea649adb90e6b8d112d68de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0267fd8fff48649a724c47544874d7" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 38531 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b13d92bfdbc04b29a08b01fd3e776f53" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 44459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89ec29f0eea649adb90e6b8d112d68de" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 41275 } health_report { overall_health: HEALTHY } } }
I20260811 15:03:23.936357 22249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:23.932253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38020 (local address 127.19.236.67:41275)
0811 15:03:23.932422 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:23.932427 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:23.932444 (+ 17us) server_negotiation.cc:407] Connection header received
0811 15:03:23.932754 (+ 310us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:23.932756 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:23.932812 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:23.932919 (+ 107us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 15:03:23.933209 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:23.933735 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:23.934667 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:23.934911 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:23.935029 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:23.935390 (+ 361us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 15:03:23.935829 (+ 439us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 15:03:23.935960 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:23.936049 (+ 89us) server_negotiation.cc:299] Negotiation successful
0811 15:03:23.936111 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 15:03:23.943308 21858 raft_consensus.cc:1261] T 732ed79baa8a49bf916d606a63a96982 P ef0267fd8fff48649a724c47544874d7 [term 1 FOLLOWER]: Refusing update from remote peer 89ec29f0eea649adb90e6b8d112d68de: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:03:23.943703 22016 raft_consensus.cc:1261] T 732ed79baa8a49bf916d606a63a96982 P b13d92bfdbc04b29a08b01fd3e776f53 [term 1 FOLLOWER]: Refusing update from remote peer 89ec29f0eea649adb90e6b8d112d68de: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:03:23.944092 22263 consensus_queue.cc:1035] T 732ed79baa8a49bf916d606a63a96982 P 89ec29f0eea649adb90e6b8d112d68de [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0267fd8fff48649a724c47544874d7" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 38531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:03:23.944345 22259 consensus_queue.cc:1035] T 732ed79baa8a49bf916d606a63a96982 P 89ec29f0eea649adb90e6b8d112d68de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b13d92bfdbc04b29a08b01fd3e776f53" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 44459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:03:23.964805 21681 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56968:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 15:03:23.965094 21681 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56968:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 15:03:23.967922 21681 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d3c02e55ad0540199c98fc723c309e8f: Sending DeleteTablet for 3 replicas of tablet 732ed79baa8a49bf916d606a63a96982
I20260811 15:03:23.968925 21994 tablet_service.cc:1514] Processing DeleteTablet for tablet 732ed79baa8a49bf916d606a63a96982 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:03:23 UTC) from {username='kudu', principal='kudu/127.19.236.126@KRBTEST.COM'} at 127.0.0.1:55370
I20260811 15:03:23.968920 22153 tablet_service.cc:1514] Processing DeleteTablet for tablet 732ed79baa8a49bf916d606a63a96982 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:03:23 UTC) from {username='kudu', principal='kudu/127.19.236.126@KRBTEST.COM'} at 127.0.0.1:38012
I20260811 15:03:23.968925 21836 tablet_service.cc:1514] Processing DeleteTablet for tablet 732ed79baa8a49bf916d606a63a96982 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:03:23 UTC) from {username='kudu', principal='kudu/127.19.236.126@KRBTEST.COM'} at 127.0.0.1:56898
I20260811 15:03:23.969527 22276 tablet_replica.cc:330] T 732ed79baa8a49bf916d606a63a96982 P b13d92bfdbc04b29a08b01fd3e776f53: stopping tablet replica
I20260811 15:03:23.969709 22277 tablet_replica.cc:330] T 732ed79baa8a49bf916d606a63a96982 P ef0267fd8fff48649a724c47544874d7: stopping tablet replica
I20260811 15:03:23.969909 22276 raft_consensus.cc:2229] T 732ed79baa8a49bf916d606a63a96982 P b13d92bfdbc04b29a08b01fd3e776f53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 15:03:23.970129 22277 raft_consensus.cc:2229] T 732ed79baa8a49bf916d606a63a96982 P ef0267fd8fff48649a724c47544874d7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 15:03:23.970281 22276 raft_consensus.cc:2258] T 732ed79baa8a49bf916d606a63a96982 P b13d92bfdbc04b29a08b01fd3e776f53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:03:23.970526 22277 raft_consensus.cc:2258] T 732ed79baa8a49bf916d606a63a96982 P ef0267fd8fff48649a724c47544874d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:03:23.970716 22275 tablet_replica.cc:330] T 732ed79baa8a49bf916d606a63a96982 P 89ec29f0eea649adb90e6b8d112d68de: stopping tablet replica
I20260811 15:03:23.970834 21683 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56968:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 15:03:23.971019 22275 raft_consensus.cc:2229] T 732ed79baa8a49bf916d606a63a96982 P 89ec29f0eea649adb90e6b8d112d68de [term 1 LEADER]: Raft consensus shutting down.
W20260811 15:03:23.971284 21683 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 15:03:23.971377 22275 raft_consensus.cc:2258] T 732ed79baa8a49bf916d606a63a96982 P 89ec29f0eea649adb90e6b8d112d68de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:03:23.973292 22276 ts_tablet_manager.cc:1905] T 732ed79baa8a49bf916d606a63a96982 P b13d92bfdbc04b29a08b01fd3e776f53: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 15:03:23.973292 22277 ts_tablet_manager.cc:1905] T 732ed79baa8a49bf916d606a63a96982 P ef0267fd8fff48649a724c47544874d7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 15:03:23.977061 22277 ts_tablet_manager.cc:1918] T 732ed79baa8a49bf916d606a63a96982 P ef0267fd8fff48649a724c47544874d7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 15:03:23.977061 22276 ts_tablet_manager.cc:1918] T 732ed79baa8a49bf916d606a63a96982 P b13d92bfdbc04b29a08b01fd3e776f53: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 15:03:23.977185 22276 log.cc:1196] T 732ed79baa8a49bf916d606a63a96982 P b13d92bfdbc04b29a08b01fd3e776f53: Deleting WAL directory at /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/minicluster-data/ts-1/wal/wals/732ed79baa8a49bf916d606a63a96982
I20260811 15:03:23.977185 22277 log.cc:1196] T 732ed79baa8a49bf916d606a63a96982 P ef0267fd8fff48649a724c47544874d7: Deleting WAL directory at /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/minicluster-data/ts-0/wal/wals/732ed79baa8a49bf916d606a63a96982
I20260811 15:03:23.977527 22277 ts_tablet_manager.cc:1939] T 732ed79baa8a49bf916d606a63a96982 P ef0267fd8fff48649a724c47544874d7: Deleting consensus metadata
I20260811 15:03:23.977527 22276 ts_tablet_manager.cc:1939] T 732ed79baa8a49bf916d606a63a96982 P b13d92bfdbc04b29a08b01fd3e776f53: Deleting consensus metadata
I20260811 15:03:23.977727 21836 tablet_service.cc:1467] Processing CreateTablet for tablet 934b8219cb6f4bdab2aa6512e4d3bbad (DEFAULT_TABLE table=test-table [id=787454b40f8e43f99fc65654de3e658f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:03:23.978015 21836 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 934b8219cb6f4bdab2aa6512e4d3bbad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:03:23.980005 21665 catalog_manager.cc:4841] TS b13d92bfdbc04b29a08b01fd3e776f53 (127.19.236.66:44459): tablet 732ed79baa8a49bf916d606a63a96982 (table test-table [id=c388f842d8fd41ea9d6b9666dae415c0]) successfully deleted
I20260811 15:03:23.980533 22252 tablet_bootstrap.cc:492] T 934b8219cb6f4bdab2aa6512e4d3bbad P ef0267fd8fff48649a724c47544874d7: Bootstrap starting.
I20260811 15:03:23.980964 22275 ts_tablet_manager.cc:1905] T 732ed79baa8a49bf916d606a63a96982 P 89ec29f0eea649adb90e6b8d112d68de: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 15:03:23.980922 21994 tablet_service.cc:1467] Processing CreateTablet for tablet 934b8219cb6f4bdab2aa6512e4d3bbad (DEFAULT_TABLE table=test-table [id=787454b40f8e43f99fc65654de3e658f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:03:23.981240 21994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 934b8219cb6f4bdab2aa6512e4d3bbad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:03:23.982000 22252 tablet_bootstrap.cc:654] T 934b8219cb6f4bdab2aa6512e4d3bbad P ef0267fd8fff48649a724c47544874d7: Neither blocks nor log segments found. Creating new log.
I20260811 15:03:23.983165 21668 catalog_manager.cc:4841] TS ef0267fd8fff48649a724c47544874d7 (127.19.236.65:38531): tablet 732ed79baa8a49bf916d606a63a96982 (table test-table [id=c388f842d8fd41ea9d6b9666dae415c0]) successfully deleted
I20260811 15:03:23.983938 22275 ts_tablet_manager.cc:1918] T 732ed79baa8a49bf916d606a63a96982 P 89ec29f0eea649adb90e6b8d112d68de: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 15:03:23.984057 22275 log.cc:1196] T 732ed79baa8a49bf916d606a63a96982 P 89ec29f0eea649adb90e6b8d112d68de: Deleting WAL directory at /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/minicluster-data/ts-2/wal/wals/732ed79baa8a49bf916d606a63a96982
I20260811 15:03:23.984237 22153 tablet_service.cc:1467] Processing CreateTablet for tablet 934b8219cb6f4bdab2aa6512e4d3bbad (DEFAULT_TABLE table=test-table [id=787454b40f8e43f99fc65654de3e658f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:03:23.984413 22275 ts_tablet_manager.cc:1939] T 732ed79baa8a49bf916d606a63a96982 P 89ec29f0eea649adb90e6b8d112d68de: Deleting consensus metadata
I20260811 15:03:23.984508 22153 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 934b8219cb6f4bdab2aa6512e4d3bbad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:03:23.985520 22252 tablet_bootstrap.cc:492] T 934b8219cb6f4bdab2aa6512e4d3bbad P ef0267fd8fff48649a724c47544874d7: No bootstrap required, opened a new log
I20260811 15:03:23.985657 22252 ts_tablet_manager.cc:1397] T 934b8219cb6f4bdab2aa6512e4d3bbad P ef0267fd8fff48649a724c47544874d7: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.002s
I20260811 15:03:23.985916 21667 catalog_manager.cc:4841] TS 89ec29f0eea649adb90e6b8d112d68de (127.19.236.67:41275): tablet 732ed79baa8a49bf916d606a63a96982 (table test-table [id=c388f842d8fd41ea9d6b9666dae415c0]) successfully deleted
I20260811 15:03:23.986608 22252 raft_consensus.cc:348] T 934b8219cb6f4bdab2aa6512e4d3bbad P ef0267fd8fff48649a724c47544874d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0267fd8fff48649a724c47544874d7" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 38531 } } peers { permanent_uuid: "b13d92bfdbc04b29a08b01fd3e776f53" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 44459 } } peers { permanent_uuid: "89ec29f0eea649adb90e6b8d112d68de" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 41275 } }
I20260811 15:03:23.986744 22252 raft_consensus.cc:374] T 934b8219cb6f4bdab2aa6512e4d3bbad P ef0267fd8fff48649a724c47544874d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:03:23.986781 22252 raft_consensus.cc:729] T 934b8219cb6f4bdab2aa6512e4d3bbad P ef0267fd8fff48649a724c47544874d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0267fd8fff48649a724c47544874d7, State: Initialized, Role: FOLLOWER
I20260811 15:03:23.986814 22253 tablet_bootstrap.cc:492] T 934b8219cb6f4bdab2aa6512e4d3bbad P 89ec29f0eea649adb90e6b8d112d68de: Bootstrap starting.
I20260811 15:03:23.986915 22252 consensus_queue.cc:260] T 934b8219cb6f4bdab2aa6512e4d3bbad P ef0267fd8fff48649a724c47544874d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0267fd8fff48649a724c47544874d7" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 38531 } } peers { permanent_uuid: "b13d92bfdbc04b29a08b01fd3e776f53" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 44459 } } peers { permanent_uuid: "89ec29f0eea649adb90e6b8d112d68de" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 41275 } }
I20260811 15:03:23.987193 22252 ts_tablet_manager.cc:1428] T 934b8219cb6f4bdab2aa6512e4d3bbad P ef0267fd8fff48649a724c47544874d7: Time spent starting tablet: real 0.001s user 0.000s sys 0.002s
I20260811 15:03:23.987430 22251 tablet_bootstrap.cc:492] T 934b8219cb6f4bdab2aa6512e4d3bbad P b13d92bfdbc04b29a08b01fd3e776f53: Bootstrap starting.
I20260811 15:03:23.987893 22253 tablet_bootstrap.cc:654] T 934b8219cb6f4bdab2aa6512e4d3bbad P 89ec29f0eea649adb90e6b8d112d68de: Neither blocks nor log segments found. Creating new log.
I20260811 15:03:23.988499 22251 tablet_bootstrap.cc:654] T 934b8219cb6f4bdab2aa6512e4d3bbad P b13d92bfdbc04b29a08b01fd3e776f53: Neither blocks nor log segments found. Creating new log.
I20260811 15:03:23.989570 22253 tablet_bootstrap.cc:492] T 934b8219cb6f4bdab2aa6512e4d3bbad P 89ec29f0eea649adb90e6b8d112d68de: No bootstrap required, opened a new log
I20260811 15:03:23.989671 22253 ts_tablet_manager.cc:1397] T 934b8219cb6f4bdab2aa6512e4d3bbad P 89ec29f0eea649adb90e6b8d112d68de: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20260811 15:03:23.990118 22251 tablet_bootstrap.cc:492] T 934b8219cb6f4bdab2aa6512e4d3bbad P b13d92bfdbc04b29a08b01fd3e776f53: No bootstrap required, opened a new log
I20260811 15:03:23.990206 22251 ts_tablet_manager.cc:1397] T 934b8219cb6f4bdab2aa6512e4d3bbad P b13d92bfdbc04b29a08b01fd3e776f53: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 15:03:23.990204 22253 raft_consensus.cc:348] T 934b8219cb6f4bdab2aa6512e4d3bbad P 89ec29f0eea649adb90e6b8d112d68de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0267fd8fff48649a724c47544874d7" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 38531 } } peers { permanent_uuid: "b13d92bfdbc04b29a08b01fd3e776f53" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 44459 } } peers { permanent_uuid: "89ec29f0eea649adb90e6b8d112d68de" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 41275 } }
I20260811 15:03:23.990324 22253 raft_consensus.cc:374] T 934b8219cb6f4bdab2aa6512e4d3bbad P 89ec29f0eea649adb90e6b8d112d68de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:03:23.990362 22253 raft_consensus.cc:729] T 934b8219cb6f4bdab2aa6512e4d3bbad P 89ec29f0eea649adb90e6b8d112d68de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89ec29f0eea649adb90e6b8d112d68de, State: Initialized, Role: FOLLOWER
I20260811 15:03:23.990489 22253 consensus_queue.cc:260] T 934b8219cb6f4bdab2aa6512e4d3bbad P 89ec29f0eea649adb90e6b8d112d68de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0267fd8fff48649a724c47544874d7" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 38531 } } peers { permanent_uuid: "b13d92bfdbc04b29a08b01fd3e776f53" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 44459 } } peers { permanent_uuid: "89ec29f0eea649adb90e6b8d112d68de" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 41275 } }
I20260811 15:03:23.990692 22251 raft_consensus.cc:348] T 934b8219cb6f4bdab2aa6512e4d3bbad P b13d92bfdbc04b29a08b01fd3e776f53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0267fd8fff48649a724c47544874d7" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 38531 } } peers { permanent_uuid: "b13d92bfdbc04b29a08b01fd3e776f53" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 44459 } } peers { permanent_uuid: "89ec29f0eea649adb90e6b8d112d68de" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 41275 } }
I20260811 15:03:23.990774 22253 ts_tablet_manager.cc:1428] T 934b8219cb6f4bdab2aa6512e4d3bbad P 89ec29f0eea649adb90e6b8d112d68de: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 15:03:23.990798 22251 raft_consensus.cc:374] T 934b8219cb6f4bdab2aa6512e4d3bbad P b13d92bfdbc04b29a08b01fd3e776f53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:03:23.990830 22251 raft_consensus.cc:729] T 934b8219cb6f4bdab2aa6512e4d3bbad P b13d92bfdbc04b29a08b01fd3e776f53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b13d92bfdbc04b29a08b01fd3e776f53, State: Initialized, Role: FOLLOWER
I20260811 15:03:23.991012 22251 consensus_queue.cc:260] T 934b8219cb6f4bdab2aa6512e4d3bbad P b13d92bfdbc04b29a08b01fd3e776f53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0267fd8fff48649a724c47544874d7" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 38531 } } peers { permanent_uuid: "b13d92bfdbc04b29a08b01fd3e776f53" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 44459 } } peers { permanent_uuid: "89ec29f0eea649adb90e6b8d112d68de" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 41275 } }
I20260811 15:03:23.992158 22251 ts_tablet_manager.cc:1428] T 934b8219cb6f4bdab2aa6512e4d3bbad P b13d92bfdbc04b29a08b01fd3e776f53: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
W20260811 15:03:24.036485 22226 tablet.cc:2369] T 934b8219cb6f4bdab2aa6512e4d3bbad P 89ec29f0eea649adb90e6b8d112d68de: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 15:03:24.052903 22068 tablet.cc:2369] T 934b8219cb6f4bdab2aa6512e4d3bbad P b13d92bfdbc04b29a08b01fd3e776f53: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 15:03:24.067910 21908 tablet.cc:2369] T 934b8219cb6f4bdab2aa6512e4d3bbad P ef0267fd8fff48649a724c47544874d7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 15:03:24.344108 22263 raft_consensus.cc:482] T 934b8219cb6f4bdab2aa6512e4d3bbad P 89ec29f0eea649adb90e6b8d112d68de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 15:03:24.344270 22263 raft_consensus.cc:504] T 934b8219cb6f4bdab2aa6512e4d3bbad P 89ec29f0eea649adb90e6b8d112d68de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0267fd8fff48649a724c47544874d7" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 38531 } } peers { permanent_uuid: "b13d92bfdbc04b29a08b01fd3e776f53" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 44459 } } peers { permanent_uuid: "89ec29f0eea649adb90e6b8d112d68de" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 41275 } }
I20260811 15:03:24.344760 22263 leader_election.cc:288] T 934b8219cb6f4bdab2aa6512e4d3bbad P 89ec29f0eea649adb90e6b8d112d68de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef0267fd8fff48649a724c47544874d7 (127.19.236.65:38531), b13d92bfdbc04b29a08b01fd3e776f53 (127.19.236.66:44459)
I20260811 15:03:24.345257 22016 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "934b8219cb6f4bdab2aa6512e4d3bbad" candidate_uuid: "89ec29f0eea649adb90e6b8d112d68de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b13d92bfdbc04b29a08b01fd3e776f53" is_pre_election: true
I20260811 15:03:24.345268 21858 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "934b8219cb6f4bdab2aa6512e4d3bbad" candidate_uuid: "89ec29f0eea649adb90e6b8d112d68de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0267fd8fff48649a724c47544874d7" is_pre_election: true
I20260811 15:03:24.345465 22016 raft_consensus.cc:2454] T 934b8219cb6f4bdab2aa6512e4d3bbad P b13d92bfdbc04b29a08b01fd3e776f53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ec29f0eea649adb90e6b8d112d68de in term 0.
I20260811 15:03:24.345463 21858 raft_consensus.cc:2454] T 934b8219cb6f4bdab2aa6512e4d3bbad P ef0267fd8fff48649a724c47544874d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ec29f0eea649adb90e6b8d112d68de in term 0.
I20260811 15:03:24.345809 22098 leader_election.cc:302] T 934b8219cb6f4bdab2aa6512e4d3bbad P 89ec29f0eea649adb90e6b8d112d68de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89ec29f0eea649adb90e6b8d112d68de, ef0267fd8fff48649a724c47544874d7; no voters:
I20260811 15:03:24.346031 22263 raft_consensus.cc:2781] T 934b8219cb6f4bdab2aa6512e4d3bbad P 89ec29f0eea649adb90e6b8d112d68de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 15:03:24.346099 22263 raft_consensus.cc:482] T 934b8219cb6f4bdab2aa6512e4d3bbad P 89ec29f0eea649adb90e6b8d112d68de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 15:03:24.346163 22263 raft_consensus.cc:3037] T 934b8219cb6f4bdab2aa6512e4d3bbad P 89ec29f0eea649adb90e6b8d112d68de [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:03:24.347232 22263 raft_consensus.cc:504] T 934b8219cb6f4bdab2aa6512e4d3bbad P 89ec29f0eea649adb90e6b8d112d68de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0267fd8fff48649a724c47544874d7" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 38531 } } peers { permanent_uuid: "b13d92bfdbc04b29a08b01fd3e776f53" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 44459 } } peers { permanent_uuid: "89ec29f0eea649adb90e6b8d112d68de" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 41275 } }
I20260811 15:03:24.347602 22263 leader_election.cc:288] T 934b8219cb6f4bdab2aa6512e4d3bbad P 89ec29f0eea649adb90e6b8d112d68de [CANDIDATE]: Term 1 election: Requested vote from peers ef0267fd8fff48649a724c47544874d7 (127.19.236.65:38531), b13d92bfdbc04b29a08b01fd3e776f53 (127.19.236.66:44459)
I20260811 15:03:24.347939 21858 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "934b8219cb6f4bdab2aa6512e4d3bbad" candidate_uuid: "89ec29f0eea649adb90e6b8d112d68de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0267fd8fff48649a724c47544874d7"
I20260811 15:03:24.348021 22016 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "934b8219cb6f4bdab2aa6512e4d3bbad" candidate_uuid: "89ec29f0eea649adb90e6b8d112d68de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b13d92bfdbc04b29a08b01fd3e776f53"
I20260811 15:03:24.348106 21858 raft_consensus.cc:3037] T 934b8219cb6f4bdab2aa6512e4d3bbad P ef0267fd8fff48649a724c47544874d7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:03:24.348145 22016 raft_consensus.cc:3037] T 934b8219cb6f4bdab2aa6512e4d3bbad P b13d92bfdbc04b29a08b01fd3e776f53 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:03:24.349085 21858 raft_consensus.cc:2454] T 934b8219cb6f4bdab2aa6512e4d3bbad P ef0267fd8fff48649a724c47544874d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ec29f0eea649adb90e6b8d112d68de in term 1.
I20260811 15:03:24.349371 22016 raft_consensus.cc:2454] T 934b8219cb6f4bdab2aa6512e4d3bbad P b13d92bfdbc04b29a08b01fd3e776f53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ec29f0eea649adb90e6b8d112d68de in term 1.
I20260811 15:03:24.349404 22098 leader_election.cc:302] T 934b8219cb6f4bdab2aa6512e4d3bbad P 89ec29f0eea649adb90e6b8d112d68de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89ec29f0eea649adb90e6b8d112d68de, ef0267fd8fff48649a724c47544874d7; no voters:
I20260811 15:03:24.349571 22263 raft_consensus.cc:2781] T 934b8219cb6f4bdab2aa6512e4d3bbad P 89ec29f0eea649adb90e6b8d112d68de [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:03:24.349660 22263 raft_consensus.cc:686] T 934b8219cb6f4bdab2aa6512e4d3bbad P 89ec29f0eea649adb90e6b8d112d68de [term 1 LEADER]: Becoming Leader. State: Replica: 89ec29f0eea649adb90e6b8d112d68de, State: Running, Role: LEADER
I20260811 15:03:24.349798 22263 consensus_queue.cc:237] T 934b8219cb6f4bdab2aa6512e4d3bbad P 89ec29f0eea649adb90e6b8d112d68de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0267fd8fff48649a724c47544874d7" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 38531 } } peers { permanent_uuid: "b13d92bfdbc04b29a08b01fd3e776f53" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 44459 } } peers { permanent_uuid: "89ec29f0eea649adb90e6b8d112d68de" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 41275 } }
I20260811 15:03:24.351471 21681 catalog_manager.cc:5495] T 934b8219cb6f4bdab2aa6512e4d3bbad P 89ec29f0eea649adb90e6b8d112d68de reported cstate change: term changed from 0 to 1, leader changed from <none> to 89ec29f0eea649adb90e6b8d112d68de (127.19.236.67). New cstate: current_term: 1 leader_uuid: "89ec29f0eea649adb90e6b8d112d68de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0267fd8fff48649a724c47544874d7" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 38531 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b13d92bfdbc04b29a08b01fd3e776f53" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 44459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89ec29f0eea649adb90e6b8d112d68de" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 41275 } health_report { overall_health: HEALTHY } } }
Aug 11 15:03:24 dist-test-slave-8n49 krb5kdc[21631](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460602, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.126@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
I20260811 15:03:24.395133 22289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:24.386475 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:34293 (local address 127.0.0.1:56984)
0811 15:03:24.386866 (+ 391us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:24.386886 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:24.387044 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:24.387289 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:24.387291 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:24.387766 (+ 475us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:24.387861 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:24.387867 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:24.388639 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:24.388641 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:24.389257 (+ 616us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:24.389266 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:24.389735 (+ 469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:24.389737 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:24.389799 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:24.390443 (+ 644us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:03:24.390467 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:24.391933 (+ 1466us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:24.393612 (+ 1679us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:24.393621 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:24.393627 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:24.393855 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:24.394108 (+ 253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:24.394110 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:24.394112 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:24.394189 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:24.394585 (+ 396us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:24.394591 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:24.394702 (+ 111us) client_negotiation.cc:769] Sending connection context
0811 15:03:24.394803 (+ 101us) client_negotiation.cc:240] Negotiation successful
0811 15:03:24.394931 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":267,"thread_start_us":131,"threads_started":1}
I20260811 15:03:24.395138 22290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:24.386522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56984 (local address 127.19.236.126:34293)
0811 15:03:24.386885 (+ 363us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:24.386898 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:24.386998 (+ 100us) server_negotiation.cc:407] Connection header received
0811 15:03:24.387128 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:24.387131 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:24.387173 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:24.387254 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:24.387969 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:24.388515 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:24.389390 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:24.389632 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:24.389711 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:24.392067 (+ 2356us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:24.392071 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:24.392073 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:24.392096 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:24.393508 (+ 1412us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:24.393943 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:24.393945 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:24.393946 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:24.394027 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:24.394268 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:24.394270 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:24.394271 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:24.394444 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:24.394544 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:24.394858 (+ 314us) server_negotiation.cc:299] Negotiation successful
0811 15:03:24.394994 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":21,"server-negotiator.queue_time_us":278,"thread_start_us":104,"threads_started":1}
I20260811 15:03:24.399830 21681 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.19.236.126@KRBTEST.COM'} at 127.0.0.1:56984:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 15:03:24.400786 21681 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 15:03:24.406111 21994 tablet_service.cc:1467] Processing CreateTablet for tablet 6e2300fc8894499bbd06304a3bdead3d (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=ac87bec38a4e45e1bca170b3ef1e2992]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 15:03:24.406088 21836 tablet_service.cc:1467] Processing CreateTablet for tablet 6e2300fc8894499bbd06304a3bdead3d (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=ac87bec38a4e45e1bca170b3ef1e2992]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 15:03:24.406095 22153 tablet_service.cc:1467] Processing CreateTablet for tablet 6e2300fc8894499bbd06304a3bdead3d (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=ac87bec38a4e45e1bca170b3ef1e2992]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 15:03:24.406519 21836 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e2300fc8894499bbd06304a3bdead3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:03:24.406519 21994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e2300fc8894499bbd06304a3bdead3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:03:24.406534 22153 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e2300fc8894499bbd06304a3bdead3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:03:24.409087 22253 tablet_bootstrap.cc:492] T 6e2300fc8894499bbd06304a3bdead3d P 89ec29f0eea649adb90e6b8d112d68de: Bootstrap starting.
I20260811 15:03:24.409494 22251 tablet_bootstrap.cc:492] T 6e2300fc8894499bbd06304a3bdead3d P b13d92bfdbc04b29a08b01fd3e776f53: Bootstrap starting.
I20260811 15:03:24.409490 22252 tablet_bootstrap.cc:492] T 6e2300fc8894499bbd06304a3bdead3d P ef0267fd8fff48649a724c47544874d7: Bootstrap starting.
I20260811 15:03:24.410066 22253 tablet_bootstrap.cc:654] T 6e2300fc8894499bbd06304a3bdead3d P 89ec29f0eea649adb90e6b8d112d68de: Neither blocks nor log segments found. Creating new log.
I20260811 15:03:24.410288 22251 tablet_bootstrap.cc:654] T 6e2300fc8894499bbd06304a3bdead3d P b13d92bfdbc04b29a08b01fd3e776f53: Neither blocks nor log segments found. Creating new log.
I20260811 15:03:24.410450 22252 tablet_bootstrap.cc:654] T 6e2300fc8894499bbd06304a3bdead3d P ef0267fd8fff48649a724c47544874d7: Neither blocks nor log segments found. Creating new log.
I20260811 15:03:24.411305 22253 tablet_bootstrap.cc:492] T 6e2300fc8894499bbd06304a3bdead3d P 89ec29f0eea649adb90e6b8d112d68de: No bootstrap required, opened a new log
I20260811 15:03:24.411396 22253 ts_tablet_manager.cc:1397] T 6e2300fc8894499bbd06304a3bdead3d P 89ec29f0eea649adb90e6b8d112d68de: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20260811 15:03:24.411844 22252 tablet_bootstrap.cc:492] T 6e2300fc8894499bbd06304a3bdead3d P ef0267fd8fff48649a724c47544874d7: No bootstrap required, opened a new log
I20260811 15:03:24.411943 22252 ts_tablet_manager.cc:1397] T 6e2300fc8894499bbd06304a3bdead3d P ef0267fd8fff48649a724c47544874d7: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 15:03:24.411891 22253 raft_consensus.cc:348] T 6e2300fc8894499bbd06304a3bdead3d P 89ec29f0eea649adb90e6b8d112d68de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0267fd8fff48649a724c47544874d7" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 38531 } } peers { permanent_uuid: "b13d92bfdbc04b29a08b01fd3e776f53" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 44459 } } peers { permanent_uuid: "89ec29f0eea649adb90e6b8d112d68de" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 41275 } }
I20260811 15:03:24.412009 22253 raft_consensus.cc:374] T 6e2300fc8894499bbd06304a3bdead3d P 89ec29f0eea649adb90e6b8d112d68de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:03:24.412057 22253 raft_consensus.cc:729] T 6e2300fc8894499bbd06304a3bdead3d P 89ec29f0eea649adb90e6b8d112d68de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89ec29f0eea649adb90e6b8d112d68de, State: Initialized, Role: FOLLOWER
I20260811 15:03:24.412199 22253 consensus_queue.cc:260] T 6e2300fc8894499bbd06304a3bdead3d P 89ec29f0eea649adb90e6b8d112d68de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0267fd8fff48649a724c47544874d7" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 38531 } } peers { permanent_uuid: "b13d92bfdbc04b29a08b01fd3e776f53" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 44459 } } peers { permanent_uuid: "89ec29f0eea649adb90e6b8d112d68de" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 41275 } }
I20260811 15:03:24.412453 22252 raft_consensus.cc:348] T 6e2300fc8894499bbd06304a3bdead3d P ef0267fd8fff48649a724c47544874d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0267fd8fff48649a724c47544874d7" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 38531 } } peers { permanent_uuid: "b13d92bfdbc04b29a08b01fd3e776f53" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 44459 } } peers { permanent_uuid: "89ec29f0eea649adb90e6b8d112d68de" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 41275 } }
I20260811 15:03:24.412544 22253 ts_tablet_manager.cc:1428] T 6e2300fc8894499bbd06304a3bdead3d P 89ec29f0eea649adb90e6b8d112d68de: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 15:03:24.412611 22252 raft_consensus.cc:374] T 6e2300fc8894499bbd06304a3bdead3d P ef0267fd8fff48649a724c47544874d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:03:24.412648 22252 raft_consensus.cc:729] T 6e2300fc8894499bbd06304a3bdead3d P ef0267fd8fff48649a724c47544874d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0267fd8fff48649a724c47544874d7, State: Initialized, Role: FOLLOWER
I20260811 15:03:24.412616 22263 tablet_replica.cc:439] T 6e2300fc8894499bbd06304a3bdead3d P 89ec29f0eea649adb90e6b8d112d68de: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0267fd8fff48649a724c47544874d7" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 38531 } } peers { permanent_uuid: "b13d92bfdbc04b29a08b01fd3e776f53" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 44459 } } peers { permanent_uuid: "89ec29f0eea649adb90e6b8d112d68de" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 41275 } } }
I20260811 15:03:24.412758 22263 tablet_replica.cc:442] T 6e2300fc8894499bbd06304a3bdead3d P 89ec29f0eea649adb90e6b8d112d68de: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 15:03:24.412770 22252 consensus_queue.cc:260] T 6e2300fc8894499bbd06304a3bdead3d P ef0267fd8fff48649a724c47544874d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0267fd8fff48649a724c47544874d7" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 38531 } } peers { permanent_uuid: "b13d92bfdbc04b29a08b01fd3e776f53" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 44459 } } peers { permanent_uuid: "89ec29f0eea649adb90e6b8d112d68de" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 41275 } }
I20260811 15:03:24.413100 22252 ts_tablet_manager.cc:1428] T 6e2300fc8894499bbd06304a3bdead3d P ef0267fd8fff48649a724c47544874d7: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 15:03:24.413022 22260 tablet_replica.cc:439] T 6e2300fc8894499bbd06304a3bdead3d P ef0267fd8fff48649a724c47544874d7: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0267fd8fff48649a724c47544874d7" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 38531 } } peers { permanent_uuid: "b13d92bfdbc04b29a08b01fd3e776f53" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 44459 } } peers { permanent_uuid: "89ec29f0eea649adb90e6b8d112d68de" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 41275 } } }
I20260811 15:03:24.413173 22260 tablet_replica.cc:442] T 6e2300fc8894499bbd06304a3bdead3d P ef0267fd8fff48649a724c47544874d7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 15:03:24.413431 22251 tablet_bootstrap.cc:492] T 6e2300fc8894499bbd06304a3bdead3d P b13d92bfdbc04b29a08b01fd3e776f53: No bootstrap required, opened a new log
I20260811 15:03:24.413538 22251 ts_tablet_manager.cc:1397] T 6e2300fc8894499bbd06304a3bdead3d P b13d92bfdbc04b29a08b01fd3e776f53: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260811 15:03:24.414014 22251 raft_consensus.cc:348] T 6e2300fc8894499bbd06304a3bdead3d P b13d92bfdbc04b29a08b01fd3e776f53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0267fd8fff48649a724c47544874d7" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 38531 } } peers { permanent_uuid: "b13d92bfdbc04b29a08b01fd3e776f53" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 44459 } } peers { permanent_uuid: "89ec29f0eea649adb90e6b8d112d68de" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 41275 } }
I20260811 15:03:24.414137 22251 raft_consensus.cc:374] T 6e2300fc8894499bbd06304a3bdead3d P b13d92bfdbc04b29a08b01fd3e776f53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:03:24.414171 22251 raft_consensus.cc:729] T 6e2300fc8894499bbd06304a3bdead3d P b13d92bfdbc04b29a08b01fd3e776f53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b13d92bfdbc04b29a08b01fd3e776f53, State: Initialized, Role: FOLLOWER
I20260811 15:03:24.414314 22251 consensus_queue.cc:260] T 6e2300fc8894499bbd06304a3bdead3d P b13d92bfdbc04b29a08b01fd3e776f53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0267fd8fff48649a724c47544874d7" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 38531 } } peers { permanent_uuid: "b13d92bfdbc04b29a08b01fd3e776f53" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 44459 } } peers { permanent_uuid: "89ec29f0eea649adb90e6b8d112d68de" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 41275 } }
I20260811 15:03:24.414604 22251 ts_tablet_manager.cc:1428] T 6e2300fc8894499bbd06304a3bdead3d P b13d92bfdbc04b29a08b01fd3e776f53: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260811 15:03:24.414569 22257 tablet_replica.cc:439] T 6e2300fc8894499bbd06304a3bdead3d P b13d92bfdbc04b29a08b01fd3e776f53: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0267fd8fff48649a724c47544874d7" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 38531 } } peers { permanent_uuid: "b13d92bfdbc04b29a08b01fd3e776f53" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 44459 } } peers { permanent_uuid: "89ec29f0eea649adb90e6b8d112d68de" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 41275 } } }
I20260811 15:03:24.414710 22257 tablet_replica.cc:442] T 6e2300fc8894499bbd06304a3bdead3d P b13d92bfdbc04b29a08b01fd3e776f53: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 15:03:24.475554 22260 raft_consensus.cc:482] T 6e2300fc8894499bbd06304a3bdead3d P ef0267fd8fff48649a724c47544874d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 15:03:24.475714 22260 raft_consensus.cc:504] T 6e2300fc8894499bbd06304a3bdead3d P ef0267fd8fff48649a724c47544874d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0267fd8fff48649a724c47544874d7" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 38531 } } peers { permanent_uuid: "b13d92bfdbc04b29a08b01fd3e776f53" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 44459 } } peers { permanent_uuid: "89ec29f0eea649adb90e6b8d112d68de" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 41275 } }
I20260811 15:03:24.477023 22260 leader_election.cc:288] T 6e2300fc8894499bbd06304a3bdead3d P ef0267fd8fff48649a724c47544874d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b13d92bfdbc04b29a08b01fd3e776f53 (127.19.236.66:44459), 89ec29f0eea649adb90e6b8d112d68de (127.19.236.67:41275)
I20260811 15:03:24.482908 22300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:24.477598 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.65:34287 (local address 127.19.236.67:41275)
0811 15:03:24.477856 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:24.477861 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:24.477906 (+ 45us) server_negotiation.cc:407] Connection header received
0811 15:03:24.478001 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:24.478005 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:24.478062 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:24.478172 (+ 110us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:03:24.478694 (+ 522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:24.479585 (+ 891us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:24.481449 (+ 1864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:24.482108 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:24.482252 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:24.482314 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:24.482655 (+ 341us) server_negotiation.cc:299] Negotiation successful
0811 15:03:24.482746 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":185,"thread_start_us":91,"threads_started":1}
I20260811 15:03:24.482914 22298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:24.477562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.65:34861 (local address 127.19.236.66:44459)
0811 15:03:24.477824 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:24.477829 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:24.477921 (+ 92us) server_negotiation.cc:407] Connection header received
0811 15:03:24.478013 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:24.478016 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:24.478062 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:24.478172 (+ 110us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:03:24.478694 (+ 522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:24.479567 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:24.481449 (+ 1882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:24.482108 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:24.482259 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:24.482314 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:24.482655 (+ 341us) server_negotiation.cc:299] Negotiation successful
0811 15:03:24.482746 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":188,"thread_start_us":77,"threads_started":1}
I20260811 15:03:24.482932 22296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:24.477347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.66:44459 (local address 127.19.236.65:34861)
0811 15:03:24.477833 (+ 486us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:24.477846 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:24.477926 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:24.478201 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:24.478204 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:24.478249 (+ 45us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:03:24.478526 (+ 277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:24.478535 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:24.479717 (+ 1182us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:24.479719 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:24.481297 (+ 1578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:24.481311 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:24.482273 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:24.482277 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:24.482500 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:24.482516 (+ 16us) client_negotiation.cc:769] Sending connection context
0811 15:03:24.482608 (+ 92us) client_negotiation.cc:240] Negotiation successful
0811 15:03:24.482730 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":418,"mutex_wait_us":427,"spinlock_wait_cycles":8192,"thread_start_us":69,"threads_started":1}
I20260811 15:03:24.482945 22295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:24.477347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.67:41275 (local address 127.19.236.65:34287)
0811 15:03:24.477747 (+ 400us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:24.477764 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:24.477884 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:24.478201 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:24.478204 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:24.478247 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:03:24.478535 (+ 288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:24.478541 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:24.479706 (+ 1165us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:24.479712 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:24.481297 (+ 1585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:24.481311 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:24.482273 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:24.482277 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:24.482437 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:24.482517 (+ 80us) client_negotiation.cc:769] Sending connection context
0811 15:03:24.482608 (+ 91us) client_negotiation.cc:240] Negotiation successful
0811 15:03:24.482728 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":317,"mutex_wait_us":284,"spinlock_wait_cycles":32128,"thread_start_us":78,"threads_started":1}
I20260811 15:03:24.483590 22016 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e2300fc8894499bbd06304a3bdead3d" candidate_uuid: "ef0267fd8fff48649a724c47544874d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b13d92bfdbc04b29a08b01fd3e776f53" is_pre_election: true
I20260811 15:03:24.483783 22016 raft_consensus.cc:2454] T 6e2300fc8894499bbd06304a3bdead3d P b13d92bfdbc04b29a08b01fd3e776f53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0267fd8fff48649a724c47544874d7 in term 0.
I20260811 15:03:24.484042 22174 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e2300fc8894499bbd06304a3bdead3d" candidate_uuid: "ef0267fd8fff48649a724c47544874d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ec29f0eea649adb90e6b8d112d68de" is_pre_election: true
I20260811 15:03:24.484300 22174 raft_consensus.cc:2454] T 6e2300fc8894499bbd06304a3bdead3d P 89ec29f0eea649adb90e6b8d112d68de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0267fd8fff48649a724c47544874d7 in term 0.
I20260811 15:03:24.484241 21783 leader_election.cc:302] T 6e2300fc8894499bbd06304a3bdead3d P ef0267fd8fff48649a724c47544874d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b13d92bfdbc04b29a08b01fd3e776f53, ef0267fd8fff48649a724c47544874d7; no voters:
I20260811 15:03:24.484576 22260 raft_consensus.cc:2781] T 6e2300fc8894499bbd06304a3bdead3d P ef0267fd8fff48649a724c47544874d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 15:03:24.484655 22260 raft_consensus.cc:482] T 6e2300fc8894499bbd06304a3bdead3d P ef0267fd8fff48649a724c47544874d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 15:03:24.484699 22260 raft_consensus.cc:3037] T 6e2300fc8894499bbd06304a3bdead3d P ef0267fd8fff48649a724c47544874d7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:03:24.485803 22260 raft_consensus.cc:504] T 6e2300fc8894499bbd06304a3bdead3d P ef0267fd8fff48649a724c47544874d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0267fd8fff48649a724c47544874d7" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 38531 } } peers { permanent_uuid: "b13d92bfdbc04b29a08b01fd3e776f53" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 44459 } } peers { permanent_uuid: "89ec29f0eea649adb90e6b8d112d68de" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 41275 } }
I20260811 15:03:24.486229 22260 leader_election.cc:288] T 6e2300fc8894499bbd06304a3bdead3d P ef0267fd8fff48649a724c47544874d7 [CANDIDATE]: Term 1 election: Requested vote from peers b13d92bfdbc04b29a08b01fd3e776f53 (127.19.236.66:44459), 89ec29f0eea649adb90e6b8d112d68de (127.19.236.67:41275)
I20260811 15:03:24.486737 22174 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e2300fc8894499bbd06304a3bdead3d" candidate_uuid: "ef0267fd8fff48649a724c47544874d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ec29f0eea649adb90e6b8d112d68de"
I20260811 15:03:24.486883 22016 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e2300fc8894499bbd06304a3bdead3d" candidate_uuid: "ef0267fd8fff48649a724c47544874d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b13d92bfdbc04b29a08b01fd3e776f53"
I20260811 15:03:24.487031 22016 raft_consensus.cc:3037] T 6e2300fc8894499bbd06304a3bdead3d P b13d92bfdbc04b29a08b01fd3e776f53 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:03:24.487030 22174 raft_consensus.cc:3037] T 6e2300fc8894499bbd06304a3bdead3d P 89ec29f0eea649adb90e6b8d112d68de [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:03:24.488133 22016 raft_consensus.cc:2454] T 6e2300fc8894499bbd06304a3bdead3d P b13d92bfdbc04b29a08b01fd3e776f53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0267fd8fff48649a724c47544874d7 in term 1.
I20260811 15:03:24.488139 22174 raft_consensus.cc:2454] T 6e2300fc8894499bbd06304a3bdead3d P 89ec29f0eea649adb90e6b8d112d68de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0267fd8fff48649a724c47544874d7 in term 1.
I20260811 15:03:24.488510 21783 leader_election.cc:302] T 6e2300fc8894499bbd06304a3bdead3d P ef0267fd8fff48649a724c47544874d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b13d92bfdbc04b29a08b01fd3e776f53, ef0267fd8fff48649a724c47544874d7; no voters:
I20260811 15:03:24.488765 22260 raft_consensus.cc:2781] T 6e2300fc8894499bbd06304a3bdead3d P ef0267fd8fff48649a724c47544874d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:03:24.488955 22260 raft_consensus.cc:686] T 6e2300fc8894499bbd06304a3bdead3d P ef0267fd8fff48649a724c47544874d7 [term 1 LEADER]: Becoming Leader. State: Replica: ef0267fd8fff48649a724c47544874d7, State: Running, Role: LEADER
I20260811 15:03:24.489251 22260 consensus_queue.cc:237] T 6e2300fc8894499bbd06304a3bdead3d P ef0267fd8fff48649a724c47544874d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0267fd8fff48649a724c47544874d7" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 38531 } } peers { permanent_uuid: "b13d92bfdbc04b29a08b01fd3e776f53" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 44459 } } peers { permanent_uuid: "89ec29f0eea649adb90e6b8d112d68de" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 41275 } }
I20260811 15:03:24.490825 22301 tablet_replica.cc:439] T 6e2300fc8894499bbd06304a3bdead3d P ef0267fd8fff48649a724c47544874d7: TxnStatusTablet state changed. Reason: New leader ef0267fd8fff48649a724c47544874d7. Latest consensus state: current_term: 1 leader_uuid: "ef0267fd8fff48649a724c47544874d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0267fd8fff48649a724c47544874d7" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 38531 } } peers { permanent_uuid: "b13d92bfdbc04b29a08b01fd3e776f53" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 44459 } } peers { permanent_uuid: "89ec29f0eea649adb90e6b8d112d68de" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 41275 } } }
I20260811 15:03:24.490963 22301 tablet_replica.cc:442] T 6e2300fc8894499bbd06304a3bdead3d P ef0267fd8fff48649a724c47544874d7: This TxnStatusTablet replica's current role is: LEADER
I20260811 15:03:24.491276 22303 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 15:03:24.491442 22303 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 15:03:24.492411 21683 catalog_manager.cc:5495] T 6e2300fc8894499bbd06304a3bdead3d P ef0267fd8fff48649a724c47544874d7 reported cstate change: term changed from 0 to 1, leader changed from <none> to ef0267fd8fff48649a724c47544874d7 (127.19.236.65). New cstate: current_term: 1 leader_uuid: "ef0267fd8fff48649a724c47544874d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0267fd8fff48649a724c47544874d7" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 38531 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b13d92bfdbc04b29a08b01fd3e776f53" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 44459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89ec29f0eea649adb90e6b8d112d68de" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 41275 } health_report { overall_health: UNKNOWN } } }
I20260811 15:03:24.518543 22307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:24.513651 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56904 (local address 127.19.236.65:38531)
0811 15:03:24.513957 (+ 306us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:24.513966 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:24.513983 (+ 17us) server_negotiation.cc:407] Connection header received
0811 15:03:24.514079 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:24.514083 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:24.514156 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:24.514282 (+ 126us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 15:03:24.514570 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:24.515154 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:24.516632 (+ 1478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:24.516983 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:24.517090 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:24.517576 (+ 486us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 15:03:24.518085 (+ 509us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 15:03:24.518188 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:24.518325 (+ 137us) server_negotiation.cc:299] Negotiation successful
0811 15:03:24.518386 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":236,"thread_start_us":120,"threads_started":1}
I20260811 15:03:24.518563 22289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:24.513537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.65:38531 (local address 127.0.0.1:56904)
0811 15:03:24.513774 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:24.513794 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:24.513925 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:24.514320 (+ 395us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:24.514323 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:24.514331 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 15:03:24.514451 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:24.514456 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:24.515326 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:24.515330 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:24.516357 (+ 1027us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:24.516369 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:24.517125 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:24.517129 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:24.517238 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:24.517305 (+ 67us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 15:03:24.518195 (+ 890us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 15:03:24.518214 (+ 19us) client_negotiation.cc:769] Sending connection context
0811 15:03:24.518294 (+ 80us) client_negotiation.cc:240] Negotiation successful
0811 15:03:24.518409 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":90}
I20260811 15:03:24.522509 22016 raft_consensus.cc:1261] T 6e2300fc8894499bbd06304a3bdead3d P b13d92bfdbc04b29a08b01fd3e776f53 [term 1 FOLLOWER]: Refusing update from remote peer ef0267fd8fff48649a724c47544874d7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:03:24.522513 22174 raft_consensus.cc:1261] T 6e2300fc8894499bbd06304a3bdead3d P 89ec29f0eea649adb90e6b8d112d68de [term 1 FOLLOWER]: Refusing update from remote peer ef0267fd8fff48649a724c47544874d7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:03:24.523090 22260 consensus_queue.cc:1035] T 6e2300fc8894499bbd06304a3bdead3d P ef0267fd8fff48649a724c47544874d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b13d92bfdbc04b29a08b01fd3e776f53" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 44459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:03:24.523278 22301 consensus_queue.cc:1035] T 6e2300fc8894499bbd06304a3bdead3d P ef0267fd8fff48649a724c47544874d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ec29f0eea649adb90e6b8d112d68de" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 41275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:03:24.525120 22263 tablet_replica.cc:439] T 6e2300fc8894499bbd06304a3bdead3d P 89ec29f0eea649adb90e6b8d112d68de: TxnStatusTablet state changed. Reason: New leader ef0267fd8fff48649a724c47544874d7. Latest consensus state: current_term: 1 leader_uuid: "ef0267fd8fff48649a724c47544874d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0267fd8fff48649a724c47544874d7" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 38531 } } peers { permanent_uuid: "b13d92bfdbc04b29a08b01fd3e776f53" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 44459 } } peers { permanent_uuid: "89ec29f0eea649adb90e6b8d112d68de" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 41275 } } }
I20260811 15:03:24.525245 22263 tablet_replica.cc:442] T 6e2300fc8894499bbd06304a3bdead3d P 89ec29f0eea649adb90e6b8d112d68de: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 15:03:24.526480 22257 tablet_replica.cc:439] T 6e2300fc8894499bbd06304a3bdead3d P b13d92bfdbc04b29a08b01fd3e776f53: TxnStatusTablet state changed. Reason: New leader ef0267fd8fff48649a724c47544874d7. Latest consensus state: current_term: 1 leader_uuid: "ef0267fd8fff48649a724c47544874d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0267fd8fff48649a724c47544874d7" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 38531 } } peers { permanent_uuid: "b13d92bfdbc04b29a08b01fd3e776f53" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 44459 } } peers { permanent_uuid: "89ec29f0eea649adb90e6b8d112d68de" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 41275 } } }
I20260811 15:03:24.526605 22257 tablet_replica.cc:442] T 6e2300fc8894499bbd06304a3bdead3d P b13d92bfdbc04b29a08b01fd3e776f53: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 15:03:24.527907 22260 tablet_replica.cc:439] T 6e2300fc8894499bbd06304a3bdead3d P ef0267fd8fff48649a724c47544874d7: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ef0267fd8fff48649a724c47544874d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0267fd8fff48649a724c47544874d7" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 38531 } } peers { permanent_uuid: "b13d92bfdbc04b29a08b01fd3e776f53" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 44459 } } peers { permanent_uuid: "89ec29f0eea649adb90e6b8d112d68de" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 41275 } } }
I20260811 15:03:24.527974 22308 mvcc.cc:205] Tried to move back new op lower bound from 7317342636116946944 to 7317342635990519808. Current Snapshot: MvccSnapshot[applied={T|T < 7317342636116946944}]
I20260811 15:03:24.528036 22260 tablet_replica.cc:442] T 6e2300fc8894499bbd06304a3bdead3d P ef0267fd8fff48649a724c47544874d7: This TxnStatusTablet replica's current role is: LEADER
I20260811 15:03:24.528700 22309 mvcc.cc:205] Tried to move back new op lower bound from 7317342636116946944 to 7317342635990519808. Current Snapshot: MvccSnapshot[applied={T|T < 7317342636116946944}]
I20260811 15:03:24.529172 22263 tablet_replica.cc:439] T 6e2300fc8894499bbd06304a3bdead3d P 89ec29f0eea649adb90e6b8d112d68de: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ef0267fd8fff48649a724c47544874d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0267fd8fff48649a724c47544874d7" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 38531 } } peers { permanent_uuid: "b13d92bfdbc04b29a08b01fd3e776f53" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 44459 } } peers { permanent_uuid: "89ec29f0eea649adb90e6b8d112d68de" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 41275 } } }
I20260811 15:03:24.529299 22263 tablet_replica.cc:442] T 6e2300fc8894499bbd06304a3bdead3d P 89ec29f0eea649adb90e6b8d112d68de: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 15:03:24.530959 22311 mvcc.cc:205] Tried to move back new op lower bound from 7317342636116946944 to 7317342635990519808. Current Snapshot: MvccSnapshot[applied={T|T < 7317342636116946944}]
I20260811 15:03:24.531352 22257 tablet_replica.cc:439] T 6e2300fc8894499bbd06304a3bdead3d P b13d92bfdbc04b29a08b01fd3e776f53: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ef0267fd8fff48649a724c47544874d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0267fd8fff48649a724c47544874d7" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 38531 } } peers { permanent_uuid: "b13d92bfdbc04b29a08b01fd3e776f53" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 44459 } } peers { permanent_uuid: "89ec29f0eea649adb90e6b8d112d68de" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 41275 } } }
I20260811 15:03:24.531486 22257 tablet_replica.cc:442] T 6e2300fc8894499bbd06304a3bdead3d P b13d92bfdbc04b29a08b01fd3e776f53: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 15:03:24.527930 22301 tablet_replica.cc:439] T 6e2300fc8894499bbd06304a3bdead3d P ef0267fd8fff48649a724c47544874d7: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ef0267fd8fff48649a724c47544874d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0267fd8fff48649a724c47544874d7" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 38531 } } peers { permanent_uuid: "b13d92bfdbc04b29a08b01fd3e776f53" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 44459 } } peers { permanent_uuid: "89ec29f0eea649adb90e6b8d112d68de" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 41275 } } }
I20260811 15:03:24.532284 22301 tablet_replica.cc:442] T 6e2300fc8894499bbd06304a3bdead3d P ef0267fd8fff48649a724c47544874d7: This TxnStatusTablet replica's current role is: LEADER
I20260811 15:03:24.545683 22307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:24.541932 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.67:38449 (local address 127.19.236.65:38531)
0811 15:03:24.542086 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:24.542092 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:24.542223 (+ 131us) server_negotiation.cc:407] Connection header received
0811 15:03:24.542358 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:24.542360 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:24.542405 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:24.542468 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 15:03:24.542723 (+ 255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:24.543219 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:24.544482 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:24.544807 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:24.544892 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:24.545219 (+ 327us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 15:03:24.545291 (+ 72us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 15:03:24.545340 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:24.545470 (+ 130us) server_negotiation.cc:299] Negotiation successful
0811 15:03:24.545529 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 15:03:24.545696 22319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:24.541837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.65:38531 (local address 127.19.236.67:38449)
0811 15:03:24.542150 (+ 313us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:24.542166 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:24.542275 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:24.542501 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:24.542505 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:24.542513 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 15:03:24.542621 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:24.542627 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:24.543324 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:24.543328 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:24.544350 (+ 1022us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:24.544362 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:24.544919 (+ 557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:24.544923 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:24.545014 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:24.545076 (+ 62us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 15:03:24.545367 (+ 291us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 15:03:24.545373 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 15:03:24.545450 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 15:03:24.545538 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":123,"threads_started":1}
I20260811 15:03:24.553665 21858 raft_consensus.cc:1261] T 934b8219cb6f4bdab2aa6512e4d3bbad P ef0267fd8fff48649a724c47544874d7 [term 1 FOLLOWER]: Refusing update from remote peer 89ec29f0eea649adb90e6b8d112d68de: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:03:24.553665 22016 raft_consensus.cc:1261] T 934b8219cb6f4bdab2aa6512e4d3bbad P b13d92bfdbc04b29a08b01fd3e776f53 [term 1 FOLLOWER]: Refusing update from remote peer 89ec29f0eea649adb90e6b8d112d68de: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:03:24.554116 22259 consensus_queue.cc:1035] T 934b8219cb6f4bdab2aa6512e4d3bbad P 89ec29f0eea649adb90e6b8d112d68de [LEADER]: Connected to new peer: Peer: permanent_uuid: "b13d92bfdbc04b29a08b01fd3e776f53" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 44459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:03:24.554684 22259 consensus_queue.cc:1035] T 934b8219cb6f4bdab2aa6512e4d3bbad P 89ec29f0eea649adb90e6b8d112d68de [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0267fd8fff48649a724c47544874d7" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 38531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:03:24.582813 22300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:24.578095 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.65:49713 (local address 127.19.236.67:41275)
0811 15:03:24.578224 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:24.578228 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:24.578636 (+ 408us) server_negotiation.cc:407] Connection header received
0811 15:03:24.578830 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:24.578834 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:24.578893 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:24.578994 (+ 101us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 15:03:24.579357 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:24.579926 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:24.581293 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:24.581582 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:24.581708 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:24.582080 (+ 372us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 15:03:24.582172 (+ 92us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 15:03:24.582404 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:24.582521 (+ 117us) server_negotiation.cc:299] Negotiation successful
0811 15:03:24.582613 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 15:03:24.583220 22324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:24.578005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.67:41275 (local address 127.19.236.65:49713)
0811 15:03:24.578550 (+ 545us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:24.578566 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:24.578718 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:24.579004 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:24.579008 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:24.579017 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 15:03:24.579197 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:24.579204 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:24.580069 (+ 865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:24.580074 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:24.581159 (+ 1085us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:24.581171 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:24.581730 (+ 559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:24.581734 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:24.581846 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:24.581921 (+ 75us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 15:03:24.582404 (+ 483us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 15:03:24.582416 (+ 12us) client_negotiation.cc:769] Sending connection context
0811 15:03:24.582502 (+ 86us) client_negotiation.cc:240] Negotiation successful
0811 15:03:24.583010 (+ 508us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":411,"thread_start_us":295,"threads_started":1}
I20260811 15:03:24.608690 21683 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56968:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 15:03:24.608855 21683 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56968:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 15:03:24.611097 21683 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d3c02e55ad0540199c98fc723c309e8f: Sending DeleteTablet for 3 replicas of tablet 934b8219cb6f4bdab2aa6512e4d3bbad
I20260811 15:03:24.611969 21836 tablet_service.cc:1514] Processing DeleteTablet for tablet 934b8219cb6f4bdab2aa6512e4d3bbad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:03:24 UTC) from {username='kudu', principal='kudu/127.19.236.126@KRBTEST.COM'} at 127.0.0.1:56898
I20260811 15:03:24.612020 22153 tablet_service.cc:1514] Processing DeleteTablet for tablet 934b8219cb6f4bdab2aa6512e4d3bbad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:03:24 UTC) from {username='kudu', principal='kudu/127.19.236.126@KRBTEST.COM'} at 127.0.0.1:38012
I20260811 15:03:24.612382 21994 tablet_service.cc:1514] Processing DeleteTablet for tablet 934b8219cb6f4bdab2aa6512e4d3bbad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:03:24 UTC) from {username='kudu', principal='kudu/127.19.236.126@KRBTEST.COM'} at 127.0.0.1:55370
I20260811 15:03:24.612787 22327 tablet_replica.cc:330] T 934b8219cb6f4bdab2aa6512e4d3bbad P 89ec29f0eea649adb90e6b8d112d68de: stopping tablet replica
I20260811 15:03:24.612926 22327 raft_consensus.cc:2229] T 934b8219cb6f4bdab2aa6512e4d3bbad P 89ec29f0eea649adb90e6b8d112d68de [term 1 LEADER]: Raft consensus shutting down.
I20260811 15:03:24.613163 22327 raft_consensus.cc:2258] T 934b8219cb6f4bdab2aa6512e4d3bbad P 89ec29f0eea649adb90e6b8d112d68de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:03:24.613413 22330 tablet_replica.cc:330] T 934b8219cb6f4bdab2aa6512e4d3bbad P b13d92bfdbc04b29a08b01fd3e776f53: stopping tablet replica
I20260811 15:03:24.613549 22330 raft_consensus.cc:2229] T 934b8219cb6f4bdab2aa6512e4d3bbad P b13d92bfdbc04b29a08b01fd3e776f53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 15:03:24.613708 22330 raft_consensus.cc:2258] T 934b8219cb6f4bdab2aa6512e4d3bbad P b13d92bfdbc04b29a08b01fd3e776f53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:03:24.614477 22330 ts_tablet_manager.cc:1905] T 934b8219cb6f4bdab2aa6512e4d3bbad P b13d92bfdbc04b29a08b01fd3e776f53: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 15:03:24.614468 22327 ts_tablet_manager.cc:1905] T 934b8219cb6f4bdab2aa6512e4d3bbad P 89ec29f0eea649adb90e6b8d112d68de: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 15:03:24.617787 22327 ts_tablet_manager.cc:1918] T 934b8219cb6f4bdab2aa6512e4d3bbad P 89ec29f0eea649adb90e6b8d112d68de: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 15:03:24.617889 22327 log.cc:1196] T 934b8219cb6f4bdab2aa6512e4d3bbad P 89ec29f0eea649adb90e6b8d112d68de: Deleting WAL directory at /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/minicluster-data/ts-2/wal/wals/934b8219cb6f4bdab2aa6512e4d3bbad
I20260811 15:03:24.617828 22330 ts_tablet_manager.cc:1918] T 934b8219cb6f4bdab2aa6512e4d3bbad P b13d92bfdbc04b29a08b01fd3e776f53: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 15:03:24.618124 22330 log.cc:1196] T 934b8219cb6f4bdab2aa6512e4d3bbad P b13d92bfdbc04b29a08b01fd3e776f53: Deleting WAL directory at /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/minicluster-data/ts-1/wal/wals/934b8219cb6f4bdab2aa6512e4d3bbad
I20260811 15:03:24.618220 22327 ts_tablet_manager.cc:1939] T 934b8219cb6f4bdab2aa6512e4d3bbad P 89ec29f0eea649adb90e6b8d112d68de: Deleting consensus metadata
I20260811 15:03:24.618477 22330 ts_tablet_manager.cc:1939] T 934b8219cb6f4bdab2aa6512e4d3bbad P b13d92bfdbc04b29a08b01fd3e776f53: Deleting consensus metadata
I20260811 15:03:24.618551 22326 tablet_replica.cc:330] T 934b8219cb6f4bdab2aa6512e4d3bbad P ef0267fd8fff48649a724c47544874d7: stopping tablet replica
I20260811 15:03:24.618695 22326 raft_consensus.cc:2229] T 934b8219cb6f4bdab2aa6512e4d3bbad P ef0267fd8fff48649a724c47544874d7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 15:03:24.618827 22326 raft_consensus.cc:2258] T 934b8219cb6f4bdab2aa6512e4d3bbad P ef0267fd8fff48649a724c47544874d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:03:24.619290 21665 catalog_manager.cc:4841] TS b13d92bfdbc04b29a08b01fd3e776f53 (127.19.236.66:44459): tablet 934b8219cb6f4bdab2aa6512e4d3bbad (table test-table [id=787454b40f8e43f99fc65654de3e658f]) successfully deleted
I20260811 15:03:24.619891 22326 ts_tablet_manager.cc:1905] T 934b8219cb6f4bdab2aa6512e4d3bbad P ef0267fd8fff48649a724c47544874d7: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 11 15:03:24 dist-test-slave-8n49 krb5kdc[21631](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460603, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.19.236.65@KRBTEST.COM
I20260811 15:03:24.620675 21667 catalog_manager.cc:4841] TS 89ec29f0eea649adb90e6b8d112d68de (127.19.236.67:41275): tablet 934b8219cb6f4bdab2aa6512e4d3bbad (table test-table [id=787454b40f8e43f99fc65654de3e658f]) successfully deleted
I20260811 15:03:24.623412 22326 ts_tablet_manager.cc:1918] T 934b8219cb6f4bdab2aa6512e4d3bbad P ef0267fd8fff48649a724c47544874d7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 15:03:24.623520 22326 log.cc:1196] T 934b8219cb6f4bdab2aa6512e4d3bbad P ef0267fd8fff48649a724c47544874d7: Deleting WAL directory at /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786460596631409-20401-0/minicluster-data/ts-0/wal/wals/934b8219cb6f4bdab2aa6512e4d3bbad
I20260811 15:03:24.623816 22326 ts_tablet_manager.cc:1939] T 934b8219cb6f4bdab2aa6512e4d3bbad P ef0267fd8fff48649a724c47544874d7: Deleting consensus metadata
I20260811 15:03:24.624650 21668 catalog_manager.cc:4841] TS ef0267fd8fff48649a724c47544874d7 (127.19.236.65:38531): tablet 934b8219cb6f4bdab2aa6512e4d3bbad (table test-table [id=787454b40f8e43f99fc65654de3e658f]) successfully deleted
I20260811 15:03:24.625922 22307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:24.613284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56912 (local address 127.19.236.65:38531)
0811 15:03:24.613412 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:24.613416 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:24.613712 (+ 296us) server_negotiation.cc:407] Connection header received
0811 15:03:24.613885 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:24.613889 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:24.613954 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:24.614007 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:24.615025 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:24.615834 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:24.617235 (+ 1401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:24.617574 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:24.617669 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:24.621420 (+ 3751us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:24.621432 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:24.621448 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:24.621491 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:24.623789 (+ 2298us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:24.624381 (+ 592us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:24.624388 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:24.624389 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:24.624522 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:24.624887 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:24.624892 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:24.624894 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:24.625162 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:24.625395 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:24.625599 (+ 204us) server_negotiation.cc:299] Negotiation successful
0811 15:03:24.625733 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
W20260811 15:03:24.626410 21901 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56912
I20260811 15:03:24.637365 22290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:24.628695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56996 (local address 127.19.236.126:34293)
0811 15:03:24.628837 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:24.628841 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:24.628913 (+ 72us) server_negotiation.cc:407] Connection header received
0811 15:03:24.629070 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:24.629072 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:24.629112 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:24.629180 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:24.630046 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:24.630634 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:24.631786 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:24.632055 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:24.632139 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:24.633871 (+ 1732us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:24.633874 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:24.633876 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:24.633901 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:24.635456 (+ 1555us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:24.635943 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:24.635945 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:24.635947 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:24.636031 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:24.636322 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:24.636325 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:24.636326 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:24.636508 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:24.636739 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:24.637021 (+ 282us) server_negotiation.cc:299] Negotiation successful
0811 15:03:24.637153 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
W20260811 15:03:24.637846 21683 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56996
I20260811 15:03:24.639150 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 21764
I20260811 15:03:24.656931 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 21919
I20260811 15:03:24.665853 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 22077
I20260811 15:03:24.675745 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 21647
2026-08-11T15:03:24Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (3155 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 15:03:24 dist-test-slave-8n49 krb5kdc[22337](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 15:03:24 dist-test-slave-8n49 krb5kdc[22337](info): set up 2 sockets
Aug 11 15:03:24 dist-test-slave-8n49 krb5kdc[22337](info): commencing operation
krb5kdc: starting...
W20260811 15:03:25.794123 20401 mini_kdc.cc:121] Time spent starting KDC: real 1.093s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/krb5kdc/test-user.keytab.
Aug 11 15:03:25 dist-test-slave-8n49 krb5kdc[22337](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460605, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T15:03:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T15:03:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.236.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.236.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.236.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab.
Entry for principal kudu/127.19.236.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab.
I20260811 15:03:25.927299 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:41441
--webserver_interface=127.19.236.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab
--principal=kudu/127.19.236.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:45023
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.236.126:41441
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:03:26.043920 22352 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:03:26.044265 22352 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:03:26.044342 22352 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:03:26.048424 22352 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:03:26.048568 22352 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 15:03:26.048602 22352 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:03:26.048647 22352 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:03:26.048709 22352 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:03:26.048750 22352 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:03:26.054268 22352 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:45023
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.236.126:41441
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab
--principal=kudu/127.19.236.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:41441
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.236.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22352
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:03:26.055483 22352 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:03:26.056638 22352 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:03:26.065402 22359 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:26.065408 22362 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:26.065621 22352 server_base.cc:1034] running on GCE node
W20260811 15:03:26.065754 22358 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:26.066335 22352 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:03:26.067528 22352 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:03:26.068683 22352 hybrid_clock.cc:648] HybridClock initialized: now 1786460606068663 us; error 32 us; skew 500 ppm
Aug 11 15:03:26 dist-test-slave-8n49 krb5kdc[22337](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460606, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:03:26.071666 22352 init.cc:377] Logged in from keytab as kudu/127.19.236.126@KRBTEST.COM (short username kudu)
I20260811 15:03:26.072711 22352 webserver.cc:460] Webserver started at http://127.19.236.126:34887/ using document root <none> and password file <none>
I20260811 15:03:26.073287 22352 fs_manager.cc:359] Metadata directory not provided
I20260811 15:03:26.073350 22352 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:03:26.073524 22352 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:03:26.075699 22352 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/minicluster-data/master-0/data/instance:
uuid: "ba30c716efa142439fa243bd54345453"
format_stamp: "Formatted at 2026-08-11 15:03:26 on dist-test-slave-8n49"
server_key: "1074870a7eb833bdaf86b73e952e2a5b"
server_key_iv: "083c2333719a70adb9fd16757599eea1"
server_key_version: "encryptionkey@0"
I20260811 15:03:26.076277 22352 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/minicluster-data/master-0/wal/instance:
uuid: "ba30c716efa142439fa243bd54345453"
format_stamp: "Formatted at 2026-08-11 15:03:26 on dist-test-slave-8n49"
server_key: "1074870a7eb833bdaf86b73e952e2a5b"
server_key_iv: "083c2333719a70adb9fd16757599eea1"
server_key_version: "encryptionkey@0"
I20260811 15:03:26.080472 22352 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.003s
I20260811 15:03:26.083236 22369 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:26.084816 22352 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260811 15:03:26.084988 22352 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/minicluster-data/master-0/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/minicluster-data/master-0/wal
uuid: "ba30c716efa142439fa243bd54345453"
format_stamp: "Formatted at 2026-08-11 15:03:26 on dist-test-slave-8n49"
server_key: "1074870a7eb833bdaf86b73e952e2a5b"
server_key_iv: "083c2333719a70adb9fd16757599eea1"
server_key_version: "encryptionkey@0"
I20260811 15:03:26.085131 22352 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:03:26.103168 22352 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:03:26.106570 22352 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:03:26.106807 22352 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:03:26.115940 22352 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.126:41441
I20260811 15:03:26.115970 22442 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.126:41441 every 8 connection(s)
I20260811 15:03:26.116956 22352 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
I20260811 15:03:26.119758 22444 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:03:26.125227 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 22352
I20260811 15:03:26.125351 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/minicluster-data/master-0/wal/instance
I20260811 15:03:26.125626 20401 external_mini_cluster.cc:1428] Setting key 3a5ead205492199785ac9d14bf040071
I20260811 15:03:26.125681 22444 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba30c716efa142439fa243bd54345453: Bootstrap starting.
I20260811 15:03:26.128346 22444 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ba30c716efa142439fa243bd54345453: Neither blocks nor log segments found. Creating new log.
I20260811 15:03:26.129139 22444 log.cc:824] T 00000000000000000000000000000000 P ba30c716efa142439fa243bd54345453: Log is configured to *not* fsync() on all Append() calls
I20260811 15:03:26.131160 22444 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba30c716efa142439fa243bd54345453: No bootstrap required, opened a new log
Aug 11 15:03:26 dist-test-slave-8n49 krb5kdc[22337](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460605, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
I20260811 15:03:26.134954 22444 raft_consensus.cc:348] T 00000000000000000000000000000000 P ba30c716efa142439fa243bd54345453 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba30c716efa142439fa243bd54345453" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 41441 } }
I20260811 15:03:26.135258 22444 raft_consensus.cc:374] T 00000000000000000000000000000000 P ba30c716efa142439fa243bd54345453 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:03:26.135349 22444 raft_consensus.cc:729] T 00000000000000000000000000000000 P ba30c716efa142439fa243bd54345453 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba30c716efa142439fa243bd54345453, State: Initialized, Role: FOLLOWER
I20260811 15:03:26.135905 22444 consensus_queue.cc:260] T 00000000000000000000000000000000 P ba30c716efa142439fa243bd54345453 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba30c716efa142439fa243bd54345453" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 41441 } }
I20260811 15:03:26.136085 22444 raft_consensus.cc:388] T 00000000000000000000000000000000 P ba30c716efa142439fa243bd54345453 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 15:03:26.136166 22444 raft_consensus.cc:482] T 00000000000000000000000000000000 P ba30c716efa142439fa243bd54345453 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 15:03:26.136276 22444 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ba30c716efa142439fa243bd54345453 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:03:26.137301 22444 raft_consensus.cc:504] T 00000000000000000000000000000000 P ba30c716efa142439fa243bd54345453 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba30c716efa142439fa243bd54345453" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 41441 } }
I20260811 15:03:26.137665 22444 leader_election.cc:302] T 00000000000000000000000000000000 P ba30c716efa142439fa243bd54345453 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ba30c716efa142439fa243bd54345453; no voters:
I20260811 15:03:26.138037 22444 leader_election.cc:288] T 00000000000000000000000000000000 P ba30c716efa142439fa243bd54345453 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 15:03:26.138132 22450 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ba30c716efa142439fa243bd54345453 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:03:26.138309 22450 raft_consensus.cc:686] T 00000000000000000000000000000000 P ba30c716efa142439fa243bd54345453 [term 1 LEADER]: Becoming Leader. State: Replica: ba30c716efa142439fa243bd54345453, State: Running, Role: LEADER
I20260811 15:03:26.138679 22450 consensus_queue.cc:237] T 00000000000000000000000000000000 P ba30c716efa142439fa243bd54345453 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba30c716efa142439fa243bd54345453" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 41441 } }
I20260811 15:03:26.139415 22444 sys_catalog.cc:564] T 00000000000000000000000000000000 P ba30c716efa142439fa243bd54345453 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:03:26.140426 22451 sys_catalog.cc:455] T 00000000000000000000000000000000 P ba30c716efa142439fa243bd54345453 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ba30c716efa142439fa243bd54345453" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba30c716efa142439fa243bd54345453" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 41441 } } }
I20260811 15:03:26.140609 22451 sys_catalog.cc:458] T 00000000000000000000000000000000 P ba30c716efa142439fa243bd54345453 [sys.catalog]: This master's current role is: LEADER
I20260811 15:03:26.140933 22452 sys_catalog.cc:455] T 00000000000000000000000000000000 P ba30c716efa142439fa243bd54345453 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ba30c716efa142439fa243bd54345453. Latest consensus state: current_term: 1 leader_uuid: "ba30c716efa142439fa243bd54345453" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba30c716efa142439fa243bd54345453" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 41441 } } }
I20260811 15:03:26.141117 22452 sys_catalog.cc:458] T 00000000000000000000000000000000 P ba30c716efa142439fa243bd54345453 [sys.catalog]: This master's current role is: LEADER
I20260811 15:03:26.141197 22448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:26.127171 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45200 (local address 127.19.236.126:41441)
0811 15:03:26.127663 (+ 492us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:26.127679 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:26.127715 (+ 36us) server_negotiation.cc:407] Connection header received
0811 15:03:26.128356 (+ 641us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:26.128373 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:26.128796 (+ 423us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:26.129138 (+ 342us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:26.129953 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:26.131057 (+ 1104us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:26.131949 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:26.132449 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:26.132658 (+ 209us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:26.135211 (+ 2553us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:26.135216 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:26.135231 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:26.135260 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:26.137220 (+ 1960us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:26.137762 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:26.137767 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:26.137772 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:26.137927 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:26.138279 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:26.138282 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:26.138284 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:26.138821 (+ 537us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:26.139024 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:26.139335 (+ 311us) server_negotiation.cc:299] Negotiation successful
0811 15:03:26.139849 (+ 514us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":346,"thread_start_us":156,"threads_started":1}
I20260811 15:03:26.141472 22462 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:03:26.145023 22462 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:03:26.151120 22462 catalog_manager.cc:1347] Generated new cluster ID: aa2a20f745be4a9e8568702696a87320
I20260811 15:03:26.151206 22462 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:03:26.177289 22462 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 15:03:26.178296 22462 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:03:26.182806 22462 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ba30c716efa142439fa243bd54345453: Generated new TSK 0
I20260811 15:03:26.183559 22462 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.236.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.236.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.236.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.65.keytab.
Entry for principal kudu/127.19.236.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.65.keytab.
I20260811 15:03:26.215314 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.65:0
--local_ip_for_outbound_sockets=127.19.236.65
--webserver_interface=127.19.236.65
--webserver_port=0
--tserver_master_addrs=127.19.236.126:41441
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.65.keytab
--principal=kudu/127.19.236.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:45023
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:03:26.334125 22475 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:03:26.334468 22475 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:03:26.334558 22475 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:03:26.338796 22475 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:03:26.338896 22475 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:03:26.339005 22475 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 15:03:26.339056 22475 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 15:03:26.339119 22475 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.65
I20260811 15:03:26.344947 22475 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:45023
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.65.keytab
--principal=kudu/127.19.236.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.236.65
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.19.236.126:41441
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22475
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.65
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:03:26.346154 22475 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:03:26.347936 22475 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:03:26.359431 22483 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:26.359709 22475 server_base.cc:1034] running on GCE node
W20260811 15:03:26.359483 22481 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:26.359431 22480 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:26.360728 22475 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:03:26.361408 22475 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:03:26.362614 22475 hybrid_clock.cc:648] HybridClock initialized: now 1786460606362577 us; error 45 us; skew 500 ppm
Aug 11 15:03:26 dist-test-slave-8n49 krb5kdc[22337](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460606, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:03:26.366979 22475 init.cc:377] Logged in from keytab as kudu/127.19.236.65@KRBTEST.COM (short username kudu)
I20260811 15:03:26.368381 22475 webserver.cc:460] Webserver started at http://127.19.236.65:36301/ using document root <none> and password file <none>
I20260811 15:03:26.369220 22475 fs_manager.cc:359] Metadata directory not provided
I20260811 15:03:26.369315 22475 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:03:26.369599 22475 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:03:26.373363 22475 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/minicluster-data/ts-0/data/instance:
uuid: "b67d6353df25414d9414a7f9c0283053"
format_stamp: "Formatted at 2026-08-11 15:03:26 on dist-test-slave-8n49"
server_key: "2d0c6a9629182e605e4b9ba89a8b4f33"
server_key_iv: "5a4b8e74e53fe7441c1f4e73fa067ad7"
server_key_version: "encryptionkey@0"
I20260811 15:03:26.374063 22475 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/minicluster-data/ts-0/wal/instance:
uuid: "b67d6353df25414d9414a7f9c0283053"
format_stamp: "Formatted at 2026-08-11 15:03:26 on dist-test-slave-8n49"
server_key: "2d0c6a9629182e605e4b9ba89a8b4f33"
server_key_iv: "5a4b8e74e53fe7441c1f4e73fa067ad7"
server_key_version: "encryptionkey@0"
I20260811 15:03:26.379819 22475 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 15:03:26.383533 22493 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:26.385118 22475 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 15:03:26.385258 22475 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/minicluster-data/ts-0/wal
uuid: "b67d6353df25414d9414a7f9c0283053"
format_stamp: "Formatted at 2026-08-11 15:03:26 on dist-test-slave-8n49"
server_key: "2d0c6a9629182e605e4b9ba89a8b4f33"
server_key_iv: "5a4b8e74e53fe7441c1f4e73fa067ad7"
server_key_version: "encryptionkey@0"
I20260811 15:03:26.385393 22475 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:03:26.415328 22475 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:03:26.418481 22475 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:03:26.418702 22475 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:03:26.420228 22475 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:03:26.420307 22475 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:26.420374 22475 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:03:26.420428 22475 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:26.431448 22475 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.65:45709
I20260811 15:03:26.431550 22624 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.65:45709 every 8 connection(s)
I20260811 15:03:26.432476 22475 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
I20260811 15:03:26.434108 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 22475
I20260811 15:03:26.434250 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/minicluster-data/ts-0/wal/instance
I20260811 15:03:26.434536 20401 external_mini_cluster.cc:1428] Setting key 072640bc0332044a7461b182b0a16519
Aug 11 15:03:26 dist-test-slave-8n49 krb5kdc[22337](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460606, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.65@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
I20260811 15:03:26.440253 22448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:26.421883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.65:47099 (local address 127.19.236.126:41441)
0811 15:03:26.422043 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:26.422048 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:26.422991 (+ 943us) server_negotiation.cc:407] Connection header received
0811 15:03:26.424301 (+ 1310us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:26.424304 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:26.424376 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:26.424472 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:26.426305 (+ 1833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:26.427018 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:26.428307 (+ 1289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:26.428537 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:26.428702 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:26.435842 (+ 7140us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:26.435846 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:26.435848 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:26.435895 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:26.437783 (+ 1888us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:26.438482 (+ 699us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:26.438486 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:26.438488 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:26.438588 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:26.438980 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:26.438985 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:26.438987 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:26.439200 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:26.439316 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:26.439939 (+ 623us) server_negotiation.cc:299] Negotiation successful
0811 15:03:26.440080 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260811 15:03:26.441386 22506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:26.422355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:41441 (local address 127.19.236.65:47099)
0811 15:03:26.422836 (+ 481us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:26.422889 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:26.424012 (+ 1123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:26.424728 (+ 716us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:26.424742 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:26.425301 (+ 559us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:26.426098 (+ 797us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:26.426123 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:26.427161 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:26.427165 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:26.428118 (+ 953us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:26.428129 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:26.428760 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:26.428767 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:26.429030 (+ 263us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:26.433907 (+ 4877us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:03:26.433924 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:26.435647 (+ 1723us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:26.437950 (+ 2303us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:26.437958 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:26.437974 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:26.438339 (+ 365us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:26.438696 (+ 357us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:26.438700 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:26.438702 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:26.438865 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:26.439316 (+ 451us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:26.439325 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:26.439631 (+ 306us) client_negotiation.cc:769] Sending connection context
0811 15:03:26.439895 (+ 264us) client_negotiation.cc:240] Negotiation successful
0811 15:03:26.440269 (+ 374us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":271,"thread_start_us":143,"threads_started":1}
I20260811 15:03:26.442878 22625 heartbeater.cc:347] Connected to a master server at 127.19.236.126:41441
I20260811 15:03:26.443073 22625 heartbeater.cc:464] Registering TS with master...
I20260811 15:03:26.443617 22625 heartbeater.cc:511] Master 127.19.236.126:41441 requested a full tablet report, sending...
I20260811 15:03:26.445322 22386 ts_manager.cc:194] Registered new tserver with Master: b67d6353df25414d9414a7f9c0283053 (127.19.236.65:45709)
WARNING: no policy specified for kudu/127.19.236.66@KRBTEST.COM; defaulting to no policy
I20260811 15:03:26.446852 22386 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.236.65@KRBTEST.COM'} at 127.19.236.65:47099
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.236.66@KRBTEST.COM" created.
I20260811 15:03:26.453831 22633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:26.445530 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:41441 (local address 127.19.236.65:33575)
0811 15:03:26.445891 (+ 361us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:26.445907 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:26.446078 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:26.446362 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:26.446365 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:26.446534 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:26.446642 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:26.446647 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:26.447611 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:26.447614 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:26.448286 (+ 672us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:26.448296 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:26.449079 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:26.449086 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:26.449193 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:26.449727 (+ 534us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:03:26.449739 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:26.450095 (+ 356us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:26.452091 (+ 1996us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:26.452095 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:26.452096 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:26.452324 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:26.452712 (+ 388us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:26.452715 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:26.452716 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:26.452800 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:26.453306 (+ 506us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:26.453309 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:26.453393 (+ 84us) client_negotiation.cc:769] Sending connection context
0811 15:03:26.453519 (+ 126us) client_negotiation.cc:240] Negotiation successful
0811 15:03:26.453641 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":252,"mutex_wait_us":19,"thread_start_us":145,"threads_started":1}
I20260811 15:03:26.453967 22448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:26.445931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.65:33575 (local address 127.19.236.126:41441)
0811 15:03:26.446038 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:26.446042 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:26.446059 (+ 17us) server_negotiation.cc:407] Connection header received
0811 15:03:26.446192 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:26.446195 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:26.446243 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:26.446327 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:26.446759 (+ 432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:26.447462 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:26.448416 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:26.448804 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:26.448934 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:26.450254 (+ 1320us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:26.450260 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:26.450268 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:26.450289 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:26.451950 (+ 1661us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:26.452476 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:26.452483 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:26.452488 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:26.452609 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:26.452896 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:26.452903 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:26.452907 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:26.453176 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:26.453285 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:26.453635 (+ 350us) server_negotiation.cc:299] Negotiation successful
0811 15:03:26.453777 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.236.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.66.keytab.
Entry for principal kudu/127.19.236.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.66.keytab.
I20260811 15:03:26.467904 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.66:0
--local_ip_for_outbound_sockets=127.19.236.66
--webserver_interface=127.19.236.66
--webserver_port=0
--tserver_master_addrs=127.19.236.126:41441
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.66.keytab
--principal=kudu/127.19.236.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:45023
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:03:26.585961 22636 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:03:26.586301 22636 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:03:26.586392 22636 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:03:26.590725 22636 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:03:26.590839 22636 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:03:26.590888 22636 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 15:03:26.590903 22636 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 15:03:26.590937 22636 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.66
I20260811 15:03:26.597066 22636 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:45023
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.66.keytab
--principal=kudu/127.19.236.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.236.66
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.19.236.126:41441
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22636
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.66
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:03:26.598237 22636 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:03:26.599296 22636 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:03:26.609555 22642 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:26.609728 22636 server_base.cc:1034] running on GCE node
W20260811 15:03:26.609561 22645 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:26.609935 22641 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:26.610438 22636 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:03:26.611145 22636 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:03:26.612337 22636 hybrid_clock.cc:648] HybridClock initialized: now 1786460606612308 us; error 57 us; skew 500 ppm
Aug 11 15:03:26 dist-test-slave-8n49 krb5kdc[22337](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460606, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:03:26.615262 22636 init.cc:377] Logged in from keytab as kudu/127.19.236.66@KRBTEST.COM (short username kudu)
I20260811 15:03:26.616271 22636 webserver.cc:460] Webserver started at http://127.19.236.66:39889/ using document root <none> and password file <none>
I20260811 15:03:26.616951 22636 fs_manager.cc:359] Metadata directory not provided
I20260811 15:03:26.617054 22636 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:03:26.617296 22636 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:03:26.619431 22636 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/minicluster-data/ts-1/data/instance:
uuid: "33f97806ad7344a5b90f7747093f0d39"
format_stamp: "Formatted at 2026-08-11 15:03:26 on dist-test-slave-8n49"
server_key: "60c2398862ec98fc841740b8a6ae63d2"
server_key_iv: "f702d719b05e07c91779ee02a9f834dc"
server_key_version: "encryptionkey@0"
I20260811 15:03:26.620034 22636 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/minicluster-data/ts-1/wal/instance:
uuid: "33f97806ad7344a5b90f7747093f0d39"
format_stamp: "Formatted at 2026-08-11 15:03:26 on dist-test-slave-8n49"
server_key: "60c2398862ec98fc841740b8a6ae63d2"
server_key_iv: "f702d719b05e07c91779ee02a9f834dc"
server_key_version: "encryptionkey@0"
I20260811 15:03:26.624055 22636 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.003s
I20260811 15:03:26.626835 22653 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:26.628083 22636 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 15:03:26.628228 22636 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/minicluster-data/ts-1/wal
uuid: "33f97806ad7344a5b90f7747093f0d39"
format_stamp: "Formatted at 2026-08-11 15:03:26 on dist-test-slave-8n49"
server_key: "60c2398862ec98fc841740b8a6ae63d2"
server_key_iv: "f702d719b05e07c91779ee02a9f834dc"
server_key_version: "encryptionkey@0"
I20260811 15:03:26.628356 22636 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:03:26.659653 22636 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:03:26.663893 22636 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:03:26.664136 22636 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:03:26.665899 22636 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:03:26.665982 22636 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:26.666052 22636 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:03:26.666096 22636 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 15:03:26 dist-test-slave-8n49 krb5kdc[22337](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460606, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.66@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
I20260811 15:03:26.677860 22636 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.66:35093
I20260811 15:03:26.677899 22786 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.66:35093 every 8 connection(s)
I20260811 15:03:26.678966 22636 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
I20260811 15:03:26.680804 22448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:26.666876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.66:40885 (local address 127.19.236.126:41441)
0811 15:03:26.667019 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:26.667023 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:26.668115 (+ 1092us) server_negotiation.cc:407] Connection header received
0811 15:03:26.669355 (+ 1240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:26.669362 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:26.669443 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:26.669545 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:26.670882 (+ 1337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:26.671442 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:26.672818 (+ 1376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:26.673051 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:26.673180 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:26.676498 (+ 3318us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:26.676502 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:26.676505 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:26.676542 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:26.678262 (+ 1720us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:26.678852 (+ 590us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:26.678854 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:26.678856 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:26.678933 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:26.679424 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:26.679427 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:26.679428 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:26.679727 (+ 299us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:26.679834 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:26.680454 (+ 620us) server_negotiation.cc:299] Negotiation successful
0811 15:03:26.680674 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 15:03:26.682044 22663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:26.667403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:41441 (local address 127.19.236.66:40885)
0811 15:03:26.667945 (+ 542us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:26.667992 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:26.669036 (+ 1044us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:26.669768 (+ 732us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:26.669775 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:26.670238 (+ 463us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:26.670720 (+ 482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:26.670733 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:26.671588 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:26.671592 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:26.672680 (+ 1088us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:26.672691 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:26.673249 (+ 558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:26.673253 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:26.673510 (+ 257us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:26.674244 (+ 734us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:03:26.674290 (+ 46us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:26.676260 (+ 1970us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:26.678380 (+ 2120us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:26.678386 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:26.678402 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:26.678747 (+ 345us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:26.679115 (+ 368us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:26.679120 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:26.679122 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:26.679294 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:26.679893 (+ 599us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:26.679899 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:26.680180 (+ 281us) client_negotiation.cc:769] Sending connection context
0811 15:03:26.680340 (+ 160us) client_negotiation.cc:240] Negotiation successful
0811 15:03:26.680933 (+ 593us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":341,"thread_start_us":151,"threads_started":1}
I20260811 15:03:26.683403 22787 heartbeater.cc:347] Connected to a master server at 127.19.236.126:41441
I20260811 15:03:26.683558 22787 heartbeater.cc:464] Registering TS with master...
I20260811 15:03:26.684165 22787 heartbeater.cc:511] Master 127.19.236.126:41441 requested a full tablet report, sending...
I20260811 15:03:26.685390 22386 ts_manager.cc:194] Registered new tserver with Master: 33f97806ad7344a5b90f7747093f0d39 (127.19.236.66:35093)
I20260811 15:03:26.685904 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 22636
I20260811 15:03:26.686053 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/minicluster-data/ts-1/wal/instance
I20260811 15:03:26.686254 22386 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.236.66@KRBTEST.COM'} at 127.19.236.66:40885
I20260811 15:03:26.686342 20401 external_mini_cluster.cc:1428] Setting key 4ae813a248c6b2d6ae3d6a928c8449f8
I20260811 15:03:26.695776 22794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:26.685870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:41441 (local address 127.19.236.66:49295)
0811 15:03:26.686852 (+ 982us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:26.686868 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:26.687000 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:26.687272 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:26.687275 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:26.687508 (+ 233us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:26.687613 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:26.687619 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:26.688378 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:26.688381 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:26.689511 (+ 1130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:26.689527 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:26.690232 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:26.690234 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:26.690307 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:26.690868 (+ 561us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:03:26.690880 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:26.691309 (+ 429us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:26.693638 (+ 2329us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:26.693645 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:26.693648 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:26.694035 (+ 387us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:26.694503 (+ 468us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:26.694506 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:26.694507 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:26.694632 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:26.695191 (+ 559us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:26.695194 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:26.695276 (+ 82us) client_negotiation.cc:769] Sending connection context
0811 15:03:26.695475 (+ 199us) client_negotiation.cc:240] Negotiation successful
0811 15:03:26.695627 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":896,"thread_start_us":90,"threads_started":1}
I20260811 15:03:26.695890 22448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:26.686562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.66:49295 (local address 127.19.236.126:41441)
0811 15:03:26.686689 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:26.686693 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:26.686957 (+ 264us) server_negotiation.cc:407] Connection header received
0811 15:03:26.687115 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:26.687118 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:26.687170 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:26.687252 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:26.687732 (+ 480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:26.688247 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:26.689681 (+ 1434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:26.690019 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:26.690093 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:26.691454 (+ 1361us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:26.691459 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:26.691461 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:26.691490 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:26.693398 (+ 1908us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:26.694269 (+ 871us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:26.694275 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:26.694278 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:26.694384 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:26.694736 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:26.694742 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:26.694746 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:26.695083 (+ 337us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:26.695191 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:26.695575 (+ 384us) server_negotiation.cc:299] Negotiation successful
0811 15:03:26.695708 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
WARNING: no policy specified for kudu/127.19.236.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.236.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.236.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.67.keytab.
Entry for principal kudu/127.19.236.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.67.keytab.
I20260811 15:03:26.716017 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.67:0
--local_ip_for_outbound_sockets=127.19.236.67
--webserver_interface=127.19.236.67
--webserver_port=0
--tserver_master_addrs=127.19.236.126:41441
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.67.keytab
--principal=kudu/127.19.236.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:45023
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:03:26.834180 22797 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:03:26.834461 22797 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:03:26.834514 22797 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:03:26.838498 22797 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:03:26.838560 22797 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:03:26.838600 22797 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 15:03:26.838615 22797 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 15:03:26.838649 22797 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.67
I20260811 15:03:26.844606 22797 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:45023
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.67.keytab
--principal=kudu/127.19.236.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.236.67
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.19.236.126:41441
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22797
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.67
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:03:26.845711 22797 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:03:26.846771 22797 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:03:26.857029 22802 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:26.857177 22803 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:26.857029 22805 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:26.857275 22797 server_base.cc:1034] running on GCE node
I20260811 15:03:26.857810 22797 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:03:26.858517 22797 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:03:26.859731 22797 hybrid_clock.cc:648] HybridClock initialized: now 1786460606859706 us; error 40 us; skew 500 ppm
Aug 11 15:03:26 dist-test-slave-8n49 krb5kdc[22337](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460606, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:03:26.862917 22797 init.cc:377] Logged in from keytab as kudu/127.19.236.67@KRBTEST.COM (short username kudu)
I20260811 15:03:26.863907 22797 webserver.cc:460] Webserver started at http://127.19.236.67:42251/ using document root <none> and password file <none>
I20260811 15:03:26.864451 22797 fs_manager.cc:359] Metadata directory not provided
I20260811 15:03:26.864511 22797 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:03:26.864753 22797 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:03:26.866838 22797 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/minicluster-data/ts-2/data/instance:
uuid: "bbeacbb144744a28882b0f355a510bc1"
format_stamp: "Formatted at 2026-08-11 15:03:26 on dist-test-slave-8n49"
server_key: "8f4e936d63c96a3418941d637bbd359f"
server_key_iv: "267cdded980287703ffc9b2cdbea88fe"
server_key_version: "encryptionkey@0"
I20260811 15:03:26.867358 22797 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/minicluster-data/ts-2/wal/instance:
uuid: "bbeacbb144744a28882b0f355a510bc1"
format_stamp: "Formatted at 2026-08-11 15:03:26 on dist-test-slave-8n49"
server_key: "8f4e936d63c96a3418941d637bbd359f"
server_key_iv: "267cdded980287703ffc9b2cdbea88fe"
server_key_version: "encryptionkey@0"
I20260811 15:03:26.871261 22797 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260811 15:03:26.873948 22813 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:26.875229 22797 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 15:03:26.875334 22797 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/minicluster-data/ts-2/wal
uuid: "bbeacbb144744a28882b0f355a510bc1"
format_stamp: "Formatted at 2026-08-11 15:03:26 on dist-test-slave-8n49"
server_key: "8f4e936d63c96a3418941d637bbd359f"
server_key_iv: "267cdded980287703ffc9b2cdbea88fe"
server_key_version: "encryptionkey@0"
I20260811 15:03:26.875437 22797 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:03:26.892535 22797 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:03:26.896225 22797 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:03:26.896485 22797 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:03:26.898245 22797 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:03:26.898330 22797 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:26.898413 22797 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:03:26.898475 22797 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 15:03:26 dist-test-slave-8n49 krb5kdc[22337](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460606, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.67@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
I20260811 15:03:26.910503 22797 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.67:37315
I20260811 15:03:26.911206 22947 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.67:37315 every 8 connection(s)
I20260811 15:03:26.911775 22797 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
I20260811 15:03:26.913563 22448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:26.899003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.67:39987 (local address 127.19.236.126:41441)
0811 15:03:26.899186 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:26.899192 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:26.900541 (+ 1349us) server_negotiation.cc:407] Connection header received
0811 15:03:26.901699 (+ 1158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:26.901702 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:26.901767 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:26.901853 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:26.903354 (+ 1501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:26.904050 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:26.905324 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:26.905604 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:26.905724 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:26.909156 (+ 3432us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:26.909161 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:26.909163 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:26.909190 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:26.910890 (+ 1700us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:26.911550 (+ 660us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:26.911555 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:26.911557 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:26.911660 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:26.912099 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:26.912102 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:26.912104 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:26.912385 (+ 281us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:26.912502 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:26.913324 (+ 822us) server_negotiation.cc:299] Negotiation successful
0811 15:03:26.913439 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 15:03:26.913913 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 22797
I20260811 15:03:26.914003 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/minicluster-data/ts-2/wal/instance
I20260811 15:03:26.914240 20401 external_mini_cluster.cc:1428] Setting key a564b94749e3401e32be374951971fb5
I20260811 15:03:26.914353 22823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:26.899879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:41441 (local address 127.19.236.67:39987)
0811 15:03:26.900349 (+ 470us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:26.900402 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:26.901477 (+ 1075us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:26.902050 (+ 573us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:26.902057 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:26.902546 (+ 489us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:26.903202 (+ 656us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:26.903218 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:26.904183 (+ 965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:26.904187 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:26.905186 (+ 999us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:26.905196 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:26.905783 (+ 587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:26.905786 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:26.905952 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:26.906728 (+ 776us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:03:26.906748 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:26.908953 (+ 2205us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:26.911016 (+ 2063us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:26.911022 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:26.911039 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:26.911431 (+ 392us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:26.911759 (+ 328us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:26.911763 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:26.911765 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:26.911983 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:26.912582 (+ 599us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:26.912590 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:26.913003 (+ 413us) client_negotiation.cc:769] Sending connection context
0811 15:03:26.913209 (+ 206us) client_negotiation.cc:240] Negotiation successful
0811 15:03:26.913476 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":262,"thread_start_us":131,"threads_started":1}
I20260811 15:03:26.916013 22950 heartbeater.cc:347] Connected to a master server at 127.19.236.126:41441
I20260811 15:03:26.916200 22950 heartbeater.cc:464] Registering TS with master...
I20260811 15:03:26.916816 22950 heartbeater.cc:511] Master 127.19.236.126:41441 requested a full tablet report, sending...
I20260811 15:03:26.918409 22386 ts_manager.cc:194] Registered new tserver with Master: bbeacbb144744a28882b0f355a510bc1 (127.19.236.67:37315)
I20260811 15:03:26.919000 22386 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.236.67@KRBTEST.COM'} at 127.19.236.67:39987
I20260811 15:03:26.925608 22448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:26.918434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.67:59279 (local address 127.19.236.126:41441)
0811 15:03:26.918589 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:26.918594 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:26.918734 (+ 140us) server_negotiation.cc:407] Connection header received
0811 15:03:26.918881 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:26.918885 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:26.918931 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:26.919025 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:26.919576 (+ 551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:26.920096 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:26.921026 (+ 930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:26.921254 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:26.921365 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:26.922439 (+ 1074us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:26.922443 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:26.922446 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:26.922483 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:26.923850 (+ 1367us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:26.924304 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:26.924308 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:26.924310 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:26.924392 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:26.924740 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:26.924744 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:26.924746 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:26.924926 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:26.925037 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:26.925320 (+ 283us) server_negotiation.cc:299] Negotiation successful
0811 15:03:26.925432 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260811 15:03:26.925616 22957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:26.918266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:41441 (local address 127.19.236.67:59279)
0811 15:03:26.918632 (+ 366us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:26.918650 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:26.918777 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:26.919044 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:26.919047 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:26.919314 (+ 267us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:26.919462 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:26.919469 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:26.920227 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:26.920230 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:26.920885 (+ 655us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:26.920894 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:26.921372 (+ 478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:26.921375 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:26.921469 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:26.921946 (+ 477us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:03:26.921957 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:26.922301 (+ 344us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:26.923975 (+ 1674us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:26.923980 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:26.923982 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:26.924197 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:26.924490 (+ 293us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:26.924494 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:26.924496 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:26.924636 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:26.925036 (+ 400us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:26.925039 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:26.925139 (+ 100us) client_negotiation.cc:769] Sending connection context
0811 15:03:26.925261 (+ 122us) client_negotiation.cc:240] Negotiation successful
0811 15:03:26.925414 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":276,"thread_start_us":110,"threads_started":1}
I20260811 15:03:26.928848 20401 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 15:03:26 dist-test-slave-8n49 krb5kdc[22337](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460606, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 15:03:26 dist-test-slave-8n49 krb5kdc[22337](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460606, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
I20260811 15:03:26.956818 22448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:26.948039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51106 (local address 127.19.236.126:41441)
0811 15:03:26.948209 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:26.948214 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:26.948229 (+ 15us) server_negotiation.cc:407] Connection header received
0811 15:03:26.948275 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:26.948278 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:26.948319 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:26.948407 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:26.949202 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:26.949833 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:26.950712 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:26.950943 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:26.951035 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:26.953609 (+ 2574us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:26.953613 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:26.953616 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:26.953641 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:26.955012 (+ 1371us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:26.955452 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:26.955457 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:26.955459 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:26.955543 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:26.955833 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:26.955867 (+ 34us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:26.955868 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:26.956078 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:26.956221 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:26.956490 (+ 269us) server_negotiation.cc:299] Negotiation successful
0811 15:03:26.956647 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 15:03:26.960037 22386 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51106:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 15:03:26.963425 22386 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 15:03:26.979137 22970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:26.972700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59558 (local address 127.19.236.65:45709)
0811 15:03:26.973919 (+ 1219us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:26.973925 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:26.973947 (+ 22us) server_negotiation.cc:407] Connection header received
0811 15:03:26.974016 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:26.974020 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:26.974189 (+ 169us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:26.974356 (+ 167us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:03:26.974759 (+ 403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:26.975581 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:26.977510 (+ 1929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:26.978324 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:26.978447 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:26.978614 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:26.978867 (+ 253us) server_negotiation.cc:299] Negotiation successful
0811 15:03:26.978984 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1045,"thread_start_us":89,"threads_started":1}
I20260811 15:03:26.979137 22972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:26.972439 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.65:45709 (local address 127.0.0.1:59558)
0811 15:03:26.973328 (+ 889us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:26.973344 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:26.973430 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:26.974350 (+ 920us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:26.974357 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:26.974381 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:03:26.974629 (+ 248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:26.974638 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:26.975724 (+ 1086us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:26.975728 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:26.977367 (+ 1639us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:26.977378 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:26.978483 (+ 1105us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:26.978487 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:26.978616 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:26.978664 (+ 48us) client_negotiation.cc:769] Sending connection context
0811 15:03:26.978826 (+ 162us) client_negotiation.cc:240] Negotiation successful
0811 15:03:26.978969 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":812,"mutex_wait_us":153,"thread_start_us":512,"threads_started":1}
I20260811 15:03:26.979655 22969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:26.972361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.67:37315 (local address 127.0.0.1:42474)
0811 15:03:26.972868 (+ 507us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:26.972923 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:26.973060 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:26.974386 (+ 1326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:26.974389 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:26.974433 (+ 44us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:03:26.974598 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:26.974607 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:26.976144 (+ 1537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:26.976147 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:26.977652 (+ 1505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:26.977663 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:26.978697 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:26.978702 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:26.978840 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:26.978907 (+ 67us) client_negotiation.cc:769] Sending connection context
0811 15:03:26.978972 (+ 65us) client_negotiation.cc:240] Negotiation successful
0811 15:03:26.979056 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":307,"mutex_wait_us":160,"spinlock_wait_cycles":10368,"thread_start_us":109,"threads_started":1}
I20260811 15:03:26.979868 22971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:26.972710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42474 (local address 127.19.236.67:37315)
0811 15:03:26.973983 (+ 1273us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:26.973994 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:26.974014 (+ 20us) server_negotiation.cc:407] Connection header received
0811 15:03:26.974090 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:26.974094 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:26.974236 (+ 142us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:26.974751 (+ 515us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:03:26.974890 (+ 139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:26.975997 (+ 1107us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:26.977786 (+ 1789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:26.978534 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:26.978924 (+ 390us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:26.979089 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:26.979187 (+ 98us) server_negotiation.cc:299] Negotiation successful
0811 15:03:26.979569 (+ 382us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1175,"thread_start_us":115,"threads_started":1}
I20260811 15:03:26.980736 22973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:26.973232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.66:35093 (local address 127.0.0.1:55254)
0811 15:03:26.973482 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:26.973498 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:26.973596 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:26.974527 (+ 931us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:26.974530 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:26.974554 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:03:26.974660 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:26.974669 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:26.976141 (+ 1472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:26.976144 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:26.977429 (+ 1285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:26.977467 (+ 38us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:26.978729 (+ 1262us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:26.978732 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:26.978845 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:26.979171 (+ 326us) client_negotiation.cc:769] Sending connection context
0811 15:03:26.979242 (+ 71us) client_negotiation.cc:240] Negotiation successful
0811 15:03:26.979399 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172,"mutex_wait_us":184,"thread_start_us":86,"threads_started":1}
I20260811 15:03:26.981096 22974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:26.973525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55254 (local address 127.19.236.66:35093)
0811 15:03:26.973901 (+ 376us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:26.973915 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:26.973940 (+ 25us) server_negotiation.cc:407] Connection header received
0811 15:03:26.974020 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:26.974027 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:26.974216 (+ 189us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:26.974377 (+ 161us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:03:26.974788 (+ 411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:26.975997 (+ 1209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:26.977598 (+ 1601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:26.978360 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:26.978503 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:26.978680 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:26.979475 (+ 795us) server_negotiation.cc:299] Negotiation successful
0811 15:03:26.980937 (+ 1462us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":266,"thread_start_us":122,"threads_started":1}
I20260811 15:03:26.982717 22861 tablet_service.cc:1467] Processing CreateTablet for tablet 47f1950a26534d1ca08a40dfdad7e3bb (DEFAULT_TABLE table=test-table [id=c6ce71753dcd4c0cac592599a5bba247]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:03:26.982715 22549 tablet_service.cc:1467] Processing CreateTablet for tablet 47f1950a26534d1ca08a40dfdad7e3bb (DEFAULT_TABLE table=test-table [id=c6ce71753dcd4c0cac592599a5bba247]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:03:26.983860 22549 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 47f1950a26534d1ca08a40dfdad7e3bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:03:26.983886 22861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 47f1950a26534d1ca08a40dfdad7e3bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:03:26.985972 22709 tablet_service.cc:1467] Processing CreateTablet for tablet 47f1950a26534d1ca08a40dfdad7e3bb (DEFAULT_TABLE table=test-table [id=c6ce71753dcd4c0cac592599a5bba247]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:03:26.987011 22709 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 47f1950a26534d1ca08a40dfdad7e3bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:03:26.991493 22976 tablet_bootstrap.cc:492] T 47f1950a26534d1ca08a40dfdad7e3bb P b67d6353df25414d9414a7f9c0283053: Bootstrap starting.
I20260811 15:03:26.992416 22977 tablet_bootstrap.cc:492] T 47f1950a26534d1ca08a40dfdad7e3bb P bbeacbb144744a28882b0f355a510bc1: Bootstrap starting.
I20260811 15:03:26.994233 22976 tablet_bootstrap.cc:654] T 47f1950a26534d1ca08a40dfdad7e3bb P b67d6353df25414d9414a7f9c0283053: Neither blocks nor log segments found. Creating new log.
I20260811 15:03:26.994719 22977 tablet_bootstrap.cc:654] T 47f1950a26534d1ca08a40dfdad7e3bb P bbeacbb144744a28882b0f355a510bc1: Neither blocks nor log segments found. Creating new log.
I20260811 15:03:26.995134 22976 log.cc:824] T 47f1950a26534d1ca08a40dfdad7e3bb P b67d6353df25414d9414a7f9c0283053: Log is configured to *not* fsync() on all Append() calls
I20260811 15:03:26.995553 22977 log.cc:824] T 47f1950a26534d1ca08a40dfdad7e3bb P bbeacbb144744a28882b0f355a510bc1: Log is configured to *not* fsync() on all Append() calls
I20260811 15:03:26.996326 22979 tablet_bootstrap.cc:492] T 47f1950a26534d1ca08a40dfdad7e3bb P 33f97806ad7344a5b90f7747093f0d39: Bootstrap starting.
I20260811 15:03:26.997911 22976 tablet_bootstrap.cc:492] T 47f1950a26534d1ca08a40dfdad7e3bb P b67d6353df25414d9414a7f9c0283053: No bootstrap required, opened a new log
I20260811 15:03:26.997992 22977 tablet_bootstrap.cc:492] T 47f1950a26534d1ca08a40dfdad7e3bb P bbeacbb144744a28882b0f355a510bc1: No bootstrap required, opened a new log
I20260811 15:03:26.998157 22976 ts_tablet_manager.cc:1397] T 47f1950a26534d1ca08a40dfdad7e3bb P b67d6353df25414d9414a7f9c0283053: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.004s
I20260811 15:03:26.998183 22977 ts_tablet_manager.cc:1397] T 47f1950a26534d1ca08a40dfdad7e3bb P bbeacbb144744a28882b0f355a510bc1: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260811 15:03:26.998626 22979 tablet_bootstrap.cc:654] T 47f1950a26534d1ca08a40dfdad7e3bb P 33f97806ad7344a5b90f7747093f0d39: Neither blocks nor log segments found. Creating new log.
I20260811 15:03:26.999462 22979 log.cc:824] T 47f1950a26534d1ca08a40dfdad7e3bb P 33f97806ad7344a5b90f7747093f0d39: Log is configured to *not* fsync() on all Append() calls
I20260811 15:03:27.001686 22979 tablet_bootstrap.cc:492] T 47f1950a26534d1ca08a40dfdad7e3bb P 33f97806ad7344a5b90f7747093f0d39: No bootstrap required, opened a new log
I20260811 15:03:27.001896 22979 ts_tablet_manager.cc:1397] T 47f1950a26534d1ca08a40dfdad7e3bb P 33f97806ad7344a5b90f7747093f0d39: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260811 15:03:27.002240 22977 raft_consensus.cc:348] T 47f1950a26534d1ca08a40dfdad7e3bb P bbeacbb144744a28882b0f355a510bc1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbeacbb144744a28882b0f355a510bc1" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37315 } } peers { permanent_uuid: "b67d6353df25414d9414a7f9c0283053" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 45709 } } peers { permanent_uuid: "33f97806ad7344a5b90f7747093f0d39" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35093 } }
I20260811 15:03:27.002522 22977 raft_consensus.cc:374] T 47f1950a26534d1ca08a40dfdad7e3bb P bbeacbb144744a28882b0f355a510bc1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:03:27.002588 22977 raft_consensus.cc:729] T 47f1950a26534d1ca08a40dfdad7e3bb P bbeacbb144744a28882b0f355a510bc1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbeacbb144744a28882b0f355a510bc1, State: Initialized, Role: FOLLOWER
I20260811 15:03:27.002615 22976 raft_consensus.cc:348] T 47f1950a26534d1ca08a40dfdad7e3bb P b67d6353df25414d9414a7f9c0283053 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbeacbb144744a28882b0f355a510bc1" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37315 } } peers { permanent_uuid: "b67d6353df25414d9414a7f9c0283053" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 45709 } } peers { permanent_uuid: "33f97806ad7344a5b90f7747093f0d39" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35093 } }
I20260811 15:03:27.003103 22977 consensus_queue.cc:260] T 47f1950a26534d1ca08a40dfdad7e3bb P bbeacbb144744a28882b0f355a510bc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbeacbb144744a28882b0f355a510bc1" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37315 } } peers { permanent_uuid: "b67d6353df25414d9414a7f9c0283053" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 45709 } } peers { permanent_uuid: "33f97806ad7344a5b90f7747093f0d39" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35093 } }
I20260811 15:03:27.003193 22976 raft_consensus.cc:374] T 47f1950a26534d1ca08a40dfdad7e3bb P b67d6353df25414d9414a7f9c0283053 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:03:27.003254 22976 raft_consensus.cc:729] T 47f1950a26534d1ca08a40dfdad7e3bb P b67d6353df25414d9414a7f9c0283053 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b67d6353df25414d9414a7f9c0283053, State: Initialized, Role: FOLLOWER
I20260811 15:03:27.003746 22976 consensus_queue.cc:260] T 47f1950a26534d1ca08a40dfdad7e3bb P b67d6353df25414d9414a7f9c0283053 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbeacbb144744a28882b0f355a510bc1" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37315 } } peers { permanent_uuid: "b67d6353df25414d9414a7f9c0283053" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 45709 } } peers { permanent_uuid: "33f97806ad7344a5b90f7747093f0d39" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35093 } }
I20260811 15:03:27.003871 22950 heartbeater.cc:503] Master 127.19.236.126:41441 was elected leader, sending a full tablet report...
I20260811 15:03:27.004372 22625 heartbeater.cc:503] Master 127.19.236.126:41441 was elected leader, sending a full tablet report...
I20260811 15:03:27.004810 22976 ts_tablet_manager.cc:1428] T 47f1950a26534d1ca08a40dfdad7e3bb P b67d6353df25414d9414a7f9c0283053: Time spent starting tablet: real 0.007s user 0.006s sys 0.001s
I20260811 15:03:27.005833 22977 ts_tablet_manager.cc:1428] T 47f1950a26534d1ca08a40dfdad7e3bb P bbeacbb144744a28882b0f355a510bc1: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20260811 15:03:27.005858 22979 raft_consensus.cc:348] T 47f1950a26534d1ca08a40dfdad7e3bb P 33f97806ad7344a5b90f7747093f0d39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbeacbb144744a28882b0f355a510bc1" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37315 } } peers { permanent_uuid: "b67d6353df25414d9414a7f9c0283053" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 45709 } } peers { permanent_uuid: "33f97806ad7344a5b90f7747093f0d39" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35093 } }
I20260811 15:03:27.006191 22979 raft_consensus.cc:374] T 47f1950a26534d1ca08a40dfdad7e3bb P 33f97806ad7344a5b90f7747093f0d39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:03:27.006266 22979 raft_consensus.cc:729] T 47f1950a26534d1ca08a40dfdad7e3bb P 33f97806ad7344a5b90f7747093f0d39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33f97806ad7344a5b90f7747093f0d39, State: Initialized, Role: FOLLOWER
I20260811 15:03:27.006630 22979 consensus_queue.cc:260] T 47f1950a26534d1ca08a40dfdad7e3bb P 33f97806ad7344a5b90f7747093f0d39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbeacbb144744a28882b0f355a510bc1" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37315 } } peers { permanent_uuid: "b67d6353df25414d9414a7f9c0283053" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 45709 } } peers { permanent_uuid: "33f97806ad7344a5b90f7747093f0d39" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35093 } }
I20260811 15:03:27.007268 22787 heartbeater.cc:503] Master 127.19.236.126:41441 was elected leader, sending a full tablet report...
I20260811 15:03:27.007625 22979 ts_tablet_manager.cc:1428] T 47f1950a26534d1ca08a40dfdad7e3bb P 33f97806ad7344a5b90f7747093f0d39: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260811 15:03:27.082094 22983 raft_consensus.cc:482] T 47f1950a26534d1ca08a40dfdad7e3bb P b67d6353df25414d9414a7f9c0283053 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 15:03:27.082317 22983 raft_consensus.cc:504] T 47f1950a26534d1ca08a40dfdad7e3bb P b67d6353df25414d9414a7f9c0283053 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbeacbb144744a28882b0f355a510bc1" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37315 } } peers { permanent_uuid: "b67d6353df25414d9414a7f9c0283053" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 45709 } } peers { permanent_uuid: "33f97806ad7344a5b90f7747093f0d39" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35093 } }
I20260811 15:03:27.083648 22983 leader_election.cc:288] T 47f1950a26534d1ca08a40dfdad7e3bb P b67d6353df25414d9414a7f9c0283053 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bbeacbb144744a28882b0f355a510bc1 (127.19.236.67:37315), 33f97806ad7344a5b90f7747093f0d39 (127.19.236.66:35093)
I20260811 15:03:27.087738 22971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:27.084040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.65:43001 (local address 127.19.236.67:37315)
0811 15:03:27.084302 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:27.084307 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:27.084391 (+ 84us) server_negotiation.cc:407] Connection header received
0811 15:03:27.084613 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:27.084618 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:27.084699 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:27.084793 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:03:27.085142 (+ 349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:27.085671 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:27.086753 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:27.087163 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:27.087292 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:27.087347 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:27.087530 (+ 183us) server_negotiation.cc:299] Negotiation successful
0811 15:03:27.087598 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144}
I20260811 15:03:27.087783 22987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:27.083871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.67:37315 (local address 127.19.236.65:43001)
0811 15:03:27.084254 (+ 383us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:27.084269 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:27.084444 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:27.084825 (+ 381us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:27.084828 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:27.084848 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:03:27.085022 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:27.085028 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:27.085788 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:27.085793 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:27.086621 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:27.086630 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:27.087288 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:27.087292 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:27.087391 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:27.087424 (+ 33us) client_negotiation.cc:769] Sending connection context
0811 15:03:27.087513 (+ 89us) client_negotiation.cc:240] Negotiation successful
0811 15:03:27.087586 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":303,"mutex_wait_us":25,"thread_start_us":133,"threads_started":1}
I20260811 15:03:27.087785 22974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:27.084105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.65:40691 (local address 127.19.236.66:35093)
0811 15:03:27.084258 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:27.084265 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:27.084580 (+ 315us) server_negotiation.cc:407] Connection header received
0811 15:03:27.084742 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:27.084748 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:27.084802 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:27.084869 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:03:27.085234 (+ 365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:27.085749 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:27.086783 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:27.087183 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:27.087329 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:27.087385 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:27.087583 (+ 198us) server_negotiation.cc:299] Negotiation successful
0811 15:03:27.087650 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 15:03:27.087999 22988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:27.084022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.66:35093 (local address 127.19.236.65:40691)
0811 15:03:27.084474 (+ 452us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:27.084488 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:27.084629 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:27.084944 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:27.084949 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:27.084969 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:03:27.085104 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:27.085109 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:27.085869 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:27.085874 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:27.086650 (+ 776us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:27.086659 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:27.087329 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:27.087333 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:27.087451 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:27.087469 (+ 18us) client_negotiation.cc:769] Sending connection context
0811 15:03:27.087560 (+ 91us) client_negotiation.cc:240] Negotiation successful
0811 15:03:27.087634 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":388,"mutex_wait_us":7,"thread_start_us":134,"threads_started":1}
I20260811 15:03:27.088390 22892 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47f1950a26534d1ca08a40dfdad7e3bb" candidate_uuid: "b67d6353df25414d9414a7f9c0283053" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbeacbb144744a28882b0f355a510bc1" is_pre_election: true
I20260811 15:03:27.088640 22732 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47f1950a26534d1ca08a40dfdad7e3bb" candidate_uuid: "b67d6353df25414d9414a7f9c0283053" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33f97806ad7344a5b90f7747093f0d39" is_pre_election: true
I20260811 15:03:27.088773 22892 raft_consensus.cc:2454] T 47f1950a26534d1ca08a40dfdad7e3bb P bbeacbb144744a28882b0f355a510bc1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b67d6353df25414d9414a7f9c0283053 in term 0.
I20260811 15:03:27.088954 22732 raft_consensus.cc:2454] T 47f1950a26534d1ca08a40dfdad7e3bb P 33f97806ad7344a5b90f7747093f0d39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b67d6353df25414d9414a7f9c0283053 in term 0.
I20260811 15:03:27.089358 22497 leader_election.cc:302] T 47f1950a26534d1ca08a40dfdad7e3bb P b67d6353df25414d9414a7f9c0283053 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b67d6353df25414d9414a7f9c0283053, bbeacbb144744a28882b0f355a510bc1; no voters:
I20260811 15:03:27.089663 22983 raft_consensus.cc:2781] T 47f1950a26534d1ca08a40dfdad7e3bb P b67d6353df25414d9414a7f9c0283053 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 15:03:27.089749 22983 raft_consensus.cc:482] T 47f1950a26534d1ca08a40dfdad7e3bb P b67d6353df25414d9414a7f9c0283053 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 15:03:27.089800 22983 raft_consensus.cc:3037] T 47f1950a26534d1ca08a40dfdad7e3bb P b67d6353df25414d9414a7f9c0283053 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:03:27.090932 22983 raft_consensus.cc:504] T 47f1950a26534d1ca08a40dfdad7e3bb P b67d6353df25414d9414a7f9c0283053 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbeacbb144744a28882b0f355a510bc1" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37315 } } peers { permanent_uuid: "b67d6353df25414d9414a7f9c0283053" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 45709 } } peers { permanent_uuid: "33f97806ad7344a5b90f7747093f0d39" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35093 } }
I20260811 15:03:27.091341 22983 leader_election.cc:288] T 47f1950a26534d1ca08a40dfdad7e3bb P b67d6353df25414d9414a7f9c0283053 [CANDIDATE]: Term 1 election: Requested vote from peers bbeacbb144744a28882b0f355a510bc1 (127.19.236.67:37315), 33f97806ad7344a5b90f7747093f0d39 (127.19.236.66:35093)
I20260811 15:03:27.091691 22892 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47f1950a26534d1ca08a40dfdad7e3bb" candidate_uuid: "b67d6353df25414d9414a7f9c0283053" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbeacbb144744a28882b0f355a510bc1"
I20260811 15:03:27.091795 22732 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47f1950a26534d1ca08a40dfdad7e3bb" candidate_uuid: "b67d6353df25414d9414a7f9c0283053" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33f97806ad7344a5b90f7747093f0d39"
I20260811 15:03:27.091813 22892 raft_consensus.cc:3037] T 47f1950a26534d1ca08a40dfdad7e3bb P bbeacbb144744a28882b0f355a510bc1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:03:27.091951 22732 raft_consensus.cc:3037] T 47f1950a26534d1ca08a40dfdad7e3bb P 33f97806ad7344a5b90f7747093f0d39 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:03:27.093087 22892 raft_consensus.cc:2454] T 47f1950a26534d1ca08a40dfdad7e3bb P bbeacbb144744a28882b0f355a510bc1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b67d6353df25414d9414a7f9c0283053 in term 1.
I20260811 15:03:27.093283 22732 raft_consensus.cc:2454] T 47f1950a26534d1ca08a40dfdad7e3bb P 33f97806ad7344a5b90f7747093f0d39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b67d6353df25414d9414a7f9c0283053 in term 1.
I20260811 15:03:27.093448 22497 leader_election.cc:302] T 47f1950a26534d1ca08a40dfdad7e3bb P b67d6353df25414d9414a7f9c0283053 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b67d6353df25414d9414a7f9c0283053, bbeacbb144744a28882b0f355a510bc1; no voters:
I20260811 15:03:27.093655 22983 raft_consensus.cc:2781] T 47f1950a26534d1ca08a40dfdad7e3bb P b67d6353df25414d9414a7f9c0283053 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:03:27.093954 22983 raft_consensus.cc:686] T 47f1950a26534d1ca08a40dfdad7e3bb P b67d6353df25414d9414a7f9c0283053 [term 1 LEADER]: Becoming Leader. State: Replica: b67d6353df25414d9414a7f9c0283053, State: Running, Role: LEADER
I20260811 15:03:27.094328 22983 consensus_queue.cc:237] T 47f1950a26534d1ca08a40dfdad7e3bb P b67d6353df25414d9414a7f9c0283053 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbeacbb144744a28882b0f355a510bc1" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37315 } } peers { permanent_uuid: "b67d6353df25414d9414a7f9c0283053" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 45709 } } peers { permanent_uuid: "33f97806ad7344a5b90f7747093f0d39" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35093 } }
I20260811 15:03:27.097748 22385 catalog_manager.cc:5495] T 47f1950a26534d1ca08a40dfdad7e3bb P b67d6353df25414d9414a7f9c0283053 reported cstate change: term changed from 0 to 1, leader changed from <none> to b67d6353df25414d9414a7f9c0283053 (127.19.236.65). New cstate: current_term: 1 leader_uuid: "b67d6353df25414d9414a7f9c0283053" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bbeacbb144744a28882b0f355a510bc1" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b67d6353df25414d9414a7f9c0283053" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 45709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33f97806ad7344a5b90f7747093f0d39" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35093 } health_report { overall_health: UNKNOWN } } }
Aug 11 15:03:27 dist-test-slave-8n49 krb5kdc[22337](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460606, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.126@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
I20260811 15:03:27.159534 22996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:27.150533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:41441 (local address 127.0.0.1:51114)
0811 15:03:27.150906 (+ 373us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:27.150920 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:27.151030 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:27.151278 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:27.151280 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:27.151681 (+ 401us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:27.151779 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:27.151785 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:27.152614 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:27.152617 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:27.153173 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:27.153181 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:27.153767 (+ 586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:27.153770 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:27.153834 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:27.154418 (+ 584us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:03:27.154432 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:27.156012 (+ 1580us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:27.157965 (+ 1953us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:27.157975 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:27.157982 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:27.158252 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:27.158511 (+ 259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:27.158514 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:27.158515 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:27.158598 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:27.159039 (+ 441us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:27.159045 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:27.159165 (+ 120us) client_negotiation.cc:769] Sending connection context
0811 15:03:27.159267 (+ 102us) client_negotiation.cc:240] Negotiation successful
0811 15:03:27.159390 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":279,"thread_start_us":163,"threads_started":1}
I20260811 15:03:27.159642 22448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:27.150641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51114 (local address 127.19.236.126:41441)
0811 15:03:27.150817 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:27.150822 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:27.151005 (+ 183us) server_negotiation.cc:407] Connection header received
0811 15:03:27.151117 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:27.151119 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:27.151163 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:27.151233 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:27.151919 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:27.152451 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:27.153317 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:27.153547 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:27.153755 (+ 208us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:27.156187 (+ 2432us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:27.156193 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:27.156198 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:27.156231 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:27.157843 (+ 1612us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:27.158344 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:27.158347 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:27.158348 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:27.158423 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:27.158711 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:27.158714 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:27.158715 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:27.158912 (+ 197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:27.159018 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:27.159376 (+ 358us) server_negotiation.cc:299] Negotiation successful
0811 15:03:27.159484 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
W20260811 15:03:27.163206 22951 tablet.cc:2369] T 47f1950a26534d1ca08a40dfdad7e3bb P bbeacbb144744a28882b0f355a510bc1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 15:03:27.163919 22385 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.19.236.126@KRBTEST.COM'} at 127.0.0.1:51114:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 15:03:27.164676 22385 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 15:03:27.170357 22709 tablet_service.cc:1467] Processing CreateTablet for tablet fa96e38eb6b949eb82f583c94e7e9c56 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=375f26b047fa452eafb439497a56efae]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 15:03:27.170320 22861 tablet_service.cc:1467] Processing CreateTablet for tablet fa96e38eb6b949eb82f583c94e7e9c56 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=375f26b047fa452eafb439497a56efae]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 15:03:27.170324 22549 tablet_service.cc:1467] Processing CreateTablet for tablet fa96e38eb6b949eb82f583c94e7e9c56 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=375f26b047fa452eafb439497a56efae]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 15:03:27.171106 22861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fa96e38eb6b949eb82f583c94e7e9c56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:03:27.171105 22549 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fa96e38eb6b949eb82f583c94e7e9c56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:03:27.171205 22709 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fa96e38eb6b949eb82f583c94e7e9c56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:03:27.174226 22977 tablet_bootstrap.cc:492] T fa96e38eb6b949eb82f583c94e7e9c56 P bbeacbb144744a28882b0f355a510bc1: Bootstrap starting.
I20260811 15:03:27.174569 22979 tablet_bootstrap.cc:492] T fa96e38eb6b949eb82f583c94e7e9c56 P 33f97806ad7344a5b90f7747093f0d39: Bootstrap starting.
I20260811 15:03:27.175366 22977 tablet_bootstrap.cc:654] T fa96e38eb6b949eb82f583c94e7e9c56 P bbeacbb144744a28882b0f355a510bc1: Neither blocks nor log segments found. Creating new log.
I20260811 15:03:27.175499 22979 tablet_bootstrap.cc:654] T fa96e38eb6b949eb82f583c94e7e9c56 P 33f97806ad7344a5b90f7747093f0d39: Neither blocks nor log segments found. Creating new log.
I20260811 15:03:27.176249 22976 tablet_bootstrap.cc:492] T fa96e38eb6b949eb82f583c94e7e9c56 P b67d6353df25414d9414a7f9c0283053: Bootstrap starting.
I20260811 15:03:27.176806 22977 tablet_bootstrap.cc:492] T fa96e38eb6b949eb82f583c94e7e9c56 P bbeacbb144744a28882b0f355a510bc1: No bootstrap required, opened a new log
I20260811 15:03:27.176921 22977 ts_tablet_manager.cc:1397] T fa96e38eb6b949eb82f583c94e7e9c56 P bbeacbb144744a28882b0f355a510bc1: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 15:03:27.177170 22976 tablet_bootstrap.cc:654] T fa96e38eb6b949eb82f583c94e7e9c56 P b67d6353df25414d9414a7f9c0283053: Neither blocks nor log segments found. Creating new log.
I20260811 15:03:27.177376 22977 raft_consensus.cc:348] T fa96e38eb6b949eb82f583c94e7e9c56 P bbeacbb144744a28882b0f355a510bc1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b67d6353df25414d9414a7f9c0283053" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 45709 } } peers { permanent_uuid: "33f97806ad7344a5b90f7747093f0d39" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35093 } } peers { permanent_uuid: "bbeacbb144744a28882b0f355a510bc1" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37315 } }
I20260811 15:03:27.177498 22977 raft_consensus.cc:374] T fa96e38eb6b949eb82f583c94e7e9c56 P bbeacbb144744a28882b0f355a510bc1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:03:27.177568 22977 raft_consensus.cc:729] T fa96e38eb6b949eb82f583c94e7e9c56 P bbeacbb144744a28882b0f355a510bc1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbeacbb144744a28882b0f355a510bc1, State: Initialized, Role: FOLLOWER
I20260811 15:03:27.177758 22977 consensus_queue.cc:260] T fa96e38eb6b949eb82f583c94e7e9c56 P bbeacbb144744a28882b0f355a510bc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b67d6353df25414d9414a7f9c0283053" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 45709 } } peers { permanent_uuid: "33f97806ad7344a5b90f7747093f0d39" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35093 } } peers { permanent_uuid: "bbeacbb144744a28882b0f355a510bc1" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37315 } }
I20260811 15:03:27.178058 22977 ts_tablet_manager.cc:1428] T fa96e38eb6b949eb82f583c94e7e9c56 P bbeacbb144744a28882b0f355a510bc1: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260811 15:03:27.178670 22979 tablet_bootstrap.cc:492] T fa96e38eb6b949eb82f583c94e7e9c56 P 33f97806ad7344a5b90f7747093f0d39: No bootstrap required, opened a new log
I20260811 15:03:27.178066 22982 tablet_replica.cc:439] T fa96e38eb6b949eb82f583c94e7e9c56 P bbeacbb144744a28882b0f355a510bc1: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b67d6353df25414d9414a7f9c0283053" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 45709 } } peers { permanent_uuid: "33f97806ad7344a5b90f7747093f0d39" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35093 } } peers { permanent_uuid: "bbeacbb144744a28882b0f355a510bc1" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37315 } } }
I20260811 15:03:27.178709 22976 tablet_bootstrap.cc:492] T fa96e38eb6b949eb82f583c94e7e9c56 P b67d6353df25414d9414a7f9c0283053: No bootstrap required, opened a new log
I20260811 15:03:27.178757 22979 ts_tablet_manager.cc:1397] T fa96e38eb6b949eb82f583c94e7e9c56 P 33f97806ad7344a5b90f7747093f0d39: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260811 15:03:27.178771 22982 tablet_replica.cc:442] T fa96e38eb6b949eb82f583c94e7e9c56 P bbeacbb144744a28882b0f355a510bc1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 15:03:27.178792 22976 ts_tablet_manager.cc:1397] T fa96e38eb6b949eb82f583c94e7e9c56 P b67d6353df25414d9414a7f9c0283053: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 15:03:27.179289 22979 raft_consensus.cc:348] T fa96e38eb6b949eb82f583c94e7e9c56 P 33f97806ad7344a5b90f7747093f0d39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b67d6353df25414d9414a7f9c0283053" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 45709 } } peers { permanent_uuid: "33f97806ad7344a5b90f7747093f0d39" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35093 } } peers { permanent_uuid: "bbeacbb144744a28882b0f355a510bc1" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37315 } }
I20260811 15:03:27.179296 22976 raft_consensus.cc:348] T fa96e38eb6b949eb82f583c94e7e9c56 P b67d6353df25414d9414a7f9c0283053 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b67d6353df25414d9414a7f9c0283053" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 45709 } } peers { permanent_uuid: "33f97806ad7344a5b90f7747093f0d39" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35093 } } peers { permanent_uuid: "bbeacbb144744a28882b0f355a510bc1" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37315 } }
I20260811 15:03:27.179419 22976 raft_consensus.cc:374] T fa96e38eb6b949eb82f583c94e7e9c56 P b67d6353df25414d9414a7f9c0283053 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:03:27.179422 22979 raft_consensus.cc:374] T fa96e38eb6b949eb82f583c94e7e9c56 P 33f97806ad7344a5b90f7747093f0d39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:03:27.179463 22976 raft_consensus.cc:729] T fa96e38eb6b949eb82f583c94e7e9c56 P b67d6353df25414d9414a7f9c0283053 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b67d6353df25414d9414a7f9c0283053, State: Initialized, Role: FOLLOWER
I20260811 15:03:27.179466 22979 raft_consensus.cc:729] T fa96e38eb6b949eb82f583c94e7e9c56 P 33f97806ad7344a5b90f7747093f0d39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33f97806ad7344a5b90f7747093f0d39, State: Initialized, Role: FOLLOWER
I20260811 15:03:27.179611 22979 consensus_queue.cc:260] T fa96e38eb6b949eb82f583c94e7e9c56 P 33f97806ad7344a5b90f7747093f0d39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b67d6353df25414d9414a7f9c0283053" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 45709 } } peers { permanent_uuid: "33f97806ad7344a5b90f7747093f0d39" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35093 } } peers { permanent_uuid: "bbeacbb144744a28882b0f355a510bc1" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37315 } }
I20260811 15:03:27.179667 22976 consensus_queue.cc:260] T fa96e38eb6b949eb82f583c94e7e9c56 P b67d6353df25414d9414a7f9c0283053 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b67d6353df25414d9414a7f9c0283053" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 45709 } } peers { permanent_uuid: "33f97806ad7344a5b90f7747093f0d39" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35093 } } peers { permanent_uuid: "bbeacbb144744a28882b0f355a510bc1" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37315 } }
I20260811 15:03:27.179896 22984 tablet_replica.cc:439] T fa96e38eb6b949eb82f583c94e7e9c56 P 33f97806ad7344a5b90f7747093f0d39: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b67d6353df25414d9414a7f9c0283053" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 45709 } } peers { permanent_uuid: "33f97806ad7344a5b90f7747093f0d39" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35093 } } peers { permanent_uuid: "bbeacbb144744a28882b0f355a510bc1" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37315 } } }
I20260811 15:03:27.179967 22976 ts_tablet_manager.cc:1428] T fa96e38eb6b949eb82f583c94e7e9c56 P b67d6353df25414d9414a7f9c0283053: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 15:03:27.180059 22984 tablet_replica.cc:442] T fa96e38eb6b949eb82f583c94e7e9c56 P 33f97806ad7344a5b90f7747093f0d39: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 15:03:27.179967 22983 tablet_replica.cc:439] T fa96e38eb6b949eb82f583c94e7e9c56 P b67d6353df25414d9414a7f9c0283053: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b67d6353df25414d9414a7f9c0283053" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 45709 } } peers { permanent_uuid: "33f97806ad7344a5b90f7747093f0d39" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35093 } } peers { permanent_uuid: "bbeacbb144744a28882b0f355a510bc1" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37315 } } }
I20260811 15:03:27.180123 22983 tablet_replica.cc:442] T fa96e38eb6b949eb82f583c94e7e9c56 P b67d6353df25414d9414a7f9c0283053: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 15:03:27.179899 22979 ts_tablet_manager.cc:1428] T fa96e38eb6b949eb82f583c94e7e9c56 P 33f97806ad7344a5b90f7747093f0d39: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
W20260811 15:03:27.180373 22788 tablet.cc:2369] T 47f1950a26534d1ca08a40dfdad7e3bb P 33f97806ad7344a5b90f7747093f0d39: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 15:03:27.184070 22626 tablet.cc:2369] T 47f1950a26534d1ca08a40dfdad7e3bb P b67d6353df25414d9414a7f9c0283053: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 15:03:27.237149 22983 raft_consensus.cc:482] T fa96e38eb6b949eb82f583c94e7e9c56 P b67d6353df25414d9414a7f9c0283053 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 15:03:27.237293 22983 raft_consensus.cc:504] T fa96e38eb6b949eb82f583c94e7e9c56 P b67d6353df25414d9414a7f9c0283053 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b67d6353df25414d9414a7f9c0283053" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 45709 } } peers { permanent_uuid: "33f97806ad7344a5b90f7747093f0d39" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35093 } } peers { permanent_uuid: "bbeacbb144744a28882b0f355a510bc1" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37315 } }
I20260811 15:03:27.237778 22983 leader_election.cc:288] T fa96e38eb6b949eb82f583c94e7e9c56 P b67d6353df25414d9414a7f9c0283053 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33f97806ad7344a5b90f7747093f0d39 (127.19.236.66:35093), bbeacbb144744a28882b0f355a510bc1 (127.19.236.67:37315)
I20260811 15:03:27.238263 22892 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa96e38eb6b949eb82f583c94e7e9c56" candidate_uuid: "b67d6353df25414d9414a7f9c0283053" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbeacbb144744a28882b0f355a510bc1" is_pre_election: true
I20260811 15:03:27.238270 22732 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa96e38eb6b949eb82f583c94e7e9c56" candidate_uuid: "b67d6353df25414d9414a7f9c0283053" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33f97806ad7344a5b90f7747093f0d39" is_pre_election: true
I20260811 15:03:27.238430 22892 raft_consensus.cc:2454] T fa96e38eb6b949eb82f583c94e7e9c56 P bbeacbb144744a28882b0f355a510bc1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b67d6353df25414d9414a7f9c0283053 in term 0.
I20260811 15:03:27.238449 22732 raft_consensus.cc:2454] T fa96e38eb6b949eb82f583c94e7e9c56 P 33f97806ad7344a5b90f7747093f0d39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b67d6353df25414d9414a7f9c0283053 in term 0.
I20260811 15:03:27.238773 22497 leader_election.cc:302] T fa96e38eb6b949eb82f583c94e7e9c56 P b67d6353df25414d9414a7f9c0283053 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b67d6353df25414d9414a7f9c0283053, bbeacbb144744a28882b0f355a510bc1; no voters:
I20260811 15:03:27.238965 22983 raft_consensus.cc:2781] T fa96e38eb6b949eb82f583c94e7e9c56 P b67d6353df25414d9414a7f9c0283053 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 15:03:27.239063 22983 raft_consensus.cc:482] T fa96e38eb6b949eb82f583c94e7e9c56 P b67d6353df25414d9414a7f9c0283053 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 15:03:27.239114 22983 raft_consensus.cc:3037] T fa96e38eb6b949eb82f583c94e7e9c56 P b67d6353df25414d9414a7f9c0283053 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:03:27.240267 22983 raft_consensus.cc:504] T fa96e38eb6b949eb82f583c94e7e9c56 P b67d6353df25414d9414a7f9c0283053 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b67d6353df25414d9414a7f9c0283053" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 45709 } } peers { permanent_uuid: "33f97806ad7344a5b90f7747093f0d39" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35093 } } peers { permanent_uuid: "bbeacbb144744a28882b0f355a510bc1" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37315 } }
I20260811 15:03:27.240767 22983 leader_election.cc:288] T fa96e38eb6b949eb82f583c94e7e9c56 P b67d6353df25414d9414a7f9c0283053 [CANDIDATE]: Term 1 election: Requested vote from peers 33f97806ad7344a5b90f7747093f0d39 (127.19.236.66:35093), bbeacbb144744a28882b0f355a510bc1 (127.19.236.67:37315)
I20260811 15:03:27.241142 22732 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa96e38eb6b949eb82f583c94e7e9c56" candidate_uuid: "b67d6353df25414d9414a7f9c0283053" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33f97806ad7344a5b90f7747093f0d39"
I20260811 15:03:27.241286 22732 raft_consensus.cc:3037] T fa96e38eb6b949eb82f583c94e7e9c56 P 33f97806ad7344a5b90f7747093f0d39 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:03:27.241284 22892 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa96e38eb6b949eb82f583c94e7e9c56" candidate_uuid: "b67d6353df25414d9414a7f9c0283053" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbeacbb144744a28882b0f355a510bc1"
I20260811 15:03:27.241405 22892 raft_consensus.cc:3037] T fa96e38eb6b949eb82f583c94e7e9c56 P bbeacbb144744a28882b0f355a510bc1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:03:27.242377 22892 raft_consensus.cc:2454] T fa96e38eb6b949eb82f583c94e7e9c56 P bbeacbb144744a28882b0f355a510bc1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b67d6353df25414d9414a7f9c0283053 in term 1.
I20260811 15:03:27.242383 22732 raft_consensus.cc:2454] T fa96e38eb6b949eb82f583c94e7e9c56 P 33f97806ad7344a5b90f7747093f0d39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b67d6353df25414d9414a7f9c0283053 in term 1.
I20260811 15:03:27.242713 22494 leader_election.cc:302] T fa96e38eb6b949eb82f583c94e7e9c56 P b67d6353df25414d9414a7f9c0283053 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33f97806ad7344a5b90f7747093f0d39, b67d6353df25414d9414a7f9c0283053; no voters:
I20260811 15:03:27.242966 22983 raft_consensus.cc:2781] T fa96e38eb6b949eb82f583c94e7e9c56 P b67d6353df25414d9414a7f9c0283053 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:03:27.243068 22983 raft_consensus.cc:686] T fa96e38eb6b949eb82f583c94e7e9c56 P b67d6353df25414d9414a7f9c0283053 [term 1 LEADER]: Becoming Leader. State: Replica: b67d6353df25414d9414a7f9c0283053, State: Running, Role: LEADER
I20260811 15:03:27.243218 22983 consensus_queue.cc:237] T fa96e38eb6b949eb82f583c94e7e9c56 P b67d6353df25414d9414a7f9c0283053 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b67d6353df25414d9414a7f9c0283053" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 45709 } } peers { permanent_uuid: "33f97806ad7344a5b90f7747093f0d39" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35093 } } peers { permanent_uuid: "bbeacbb144744a28882b0f355a510bc1" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37315 } }
I20260811 15:03:27.244038 22989 tablet_replica.cc:439] T fa96e38eb6b949eb82f583c94e7e9c56 P b67d6353df25414d9414a7f9c0283053: TxnStatusTablet state changed. Reason: New leader b67d6353df25414d9414a7f9c0283053. Latest consensus state: current_term: 1 leader_uuid: "b67d6353df25414d9414a7f9c0283053" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b67d6353df25414d9414a7f9c0283053" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 45709 } } peers { permanent_uuid: "33f97806ad7344a5b90f7747093f0d39" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35093 } } peers { permanent_uuid: "bbeacbb144744a28882b0f355a510bc1" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37315 } } }
I20260811 15:03:27.244164 22989 tablet_replica.cc:442] T fa96e38eb6b949eb82f583c94e7e9c56 P b67d6353df25414d9414a7f9c0283053: This TxnStatusTablet replica's current role is: LEADER
I20260811 15:03:27.244490 23001 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 15:03:27.244808 23001 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 15:03:27.245391 22387 catalog_manager.cc:5495] T fa96e38eb6b949eb82f583c94e7e9c56 P b67d6353df25414d9414a7f9c0283053 reported cstate change: term changed from 0 to 1, leader changed from <none> to b67d6353df25414d9414a7f9c0283053 (127.19.236.65). New cstate: current_term: 1 leader_uuid: "b67d6353df25414d9414a7f9c0283053" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b67d6353df25414d9414a7f9c0283053" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 45709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33f97806ad7344a5b90f7747093f0d39" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bbeacbb144744a28882b0f355a510bc1" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37315 } health_report { overall_health: UNKNOWN } } }
I20260811 15:03:27.260360 22970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:27.255855 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59572 (local address 127.19.236.65:45709)
0811 15:03:27.255985 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:27.255990 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:27.256169 (+ 179us) server_negotiation.cc:407] Connection header received
0811 15:03:27.256352 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:27.256354 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:27.256416 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:27.256500 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 15:03:27.256830 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:27.257329 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:27.258705 (+ 1376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:27.258946 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:27.259033 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:27.259449 (+ 416us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 15:03:27.259871 (+ 422us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 15:03:27.259967 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:27.260180 (+ 213us) server_negotiation.cc:299] Negotiation successful
0811 15:03:27.260239 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 15:03:27.260408 22996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:27.255763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.65:45709 (local address 127.0.0.1:59572)
0811 15:03:27.256056 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:27.256075 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:27.256208 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:27.256574 (+ 366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:27.256579 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:27.256588 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 15:03:27.256715 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:27.256724 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:27.257454 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:27.257458 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:27.258559 (+ 1101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:27.258572 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:27.259077 (+ 505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:27.259082 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:27.259191 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:27.259260 (+ 69us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 15:03:27.260050 (+ 790us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 15:03:27.260070 (+ 20us) client_negotiation.cc:769] Sending connection context
0811 15:03:27.260160 (+ 90us) client_negotiation.cc:240] Negotiation successful
0811 15:03:27.260260 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165}
I20260811 15:03:27.266359 22892 raft_consensus.cc:1261] T fa96e38eb6b949eb82f583c94e7e9c56 P bbeacbb144744a28882b0f355a510bc1 [term 1 FOLLOWER]: Refusing update from remote peer b67d6353df25414d9414a7f9c0283053: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:03:27.266359 22732 raft_consensus.cc:1261] T fa96e38eb6b949eb82f583c94e7e9c56 P 33f97806ad7344a5b90f7747093f0d39 [term 1 FOLLOWER]: Refusing update from remote peer b67d6353df25414d9414a7f9c0283053: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:03:27.267127 22983 consensus_queue.cc:1035] T fa96e38eb6b949eb82f583c94e7e9c56 P b67d6353df25414d9414a7f9c0283053 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33f97806ad7344a5b90f7747093f0d39" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:03:27.267302 22989 consensus_queue.cc:1035] T fa96e38eb6b949eb82f583c94e7e9c56 P b67d6353df25414d9414a7f9c0283053 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbeacbb144744a28882b0f355a510bc1" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:03:27.271513 22984 tablet_replica.cc:439] T fa96e38eb6b949eb82f583c94e7e9c56 P 33f97806ad7344a5b90f7747093f0d39: TxnStatusTablet state changed. Reason: New leader b67d6353df25414d9414a7f9c0283053. Latest consensus state: current_term: 1 leader_uuid: "b67d6353df25414d9414a7f9c0283053" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b67d6353df25414d9414a7f9c0283053" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 45709 } } peers { permanent_uuid: "33f97806ad7344a5b90f7747093f0d39" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35093 } } peers { permanent_uuid: "bbeacbb144744a28882b0f355a510bc1" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37315 } } }
I20260811 15:03:27.271513 22982 tablet_replica.cc:439] T fa96e38eb6b949eb82f583c94e7e9c56 P bbeacbb144744a28882b0f355a510bc1: TxnStatusTablet state changed. Reason: New leader b67d6353df25414d9414a7f9c0283053. Latest consensus state: current_term: 1 leader_uuid: "b67d6353df25414d9414a7f9c0283053" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b67d6353df25414d9414a7f9c0283053" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 45709 } } peers { permanent_uuid: "33f97806ad7344a5b90f7747093f0d39" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35093 } } peers { permanent_uuid: "bbeacbb144744a28882b0f355a510bc1" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37315 } } }
I20260811 15:03:27.271648 22982 tablet_replica.cc:442] T fa96e38eb6b949eb82f583c94e7e9c56 P bbeacbb144744a28882b0f355a510bc1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 15:03:27.271648 22984 tablet_replica.cc:442] T fa96e38eb6b949eb82f583c94e7e9c56 P 33f97806ad7344a5b90f7747093f0d39: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 15:03:27.275204 22989 tablet_replica.cc:439] T fa96e38eb6b949eb82f583c94e7e9c56 P b67d6353df25414d9414a7f9c0283053: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b67d6353df25414d9414a7f9c0283053" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b67d6353df25414d9414a7f9c0283053" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 45709 } } peers { permanent_uuid: "33f97806ad7344a5b90f7747093f0d39" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35093 } } peers { permanent_uuid: "bbeacbb144744a28882b0f355a510bc1" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37315 } } }
I20260811 15:03:27.275369 22989 tablet_replica.cc:442] T fa96e38eb6b949eb82f583c94e7e9c56 P b67d6353df25414d9414a7f9c0283053: This TxnStatusTablet replica's current role is: LEADER
I20260811 15:03:27.275422 22983 tablet_replica.cc:439] T fa96e38eb6b949eb82f583c94e7e9c56 P b67d6353df25414d9414a7f9c0283053: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b67d6353df25414d9414a7f9c0283053" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b67d6353df25414d9414a7f9c0283053" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 45709 } } peers { permanent_uuid: "33f97806ad7344a5b90f7747093f0d39" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35093 } } peers { permanent_uuid: "bbeacbb144744a28882b0f355a510bc1" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37315 } } }
I20260811 15:03:27.275535 22983 tablet_replica.cc:442] T fa96e38eb6b949eb82f583c94e7e9c56 P b67d6353df25414d9414a7f9c0283053: This TxnStatusTablet replica's current role is: LEADER
I20260811 15:03:27.275544 22984 tablet_replica.cc:439] T fa96e38eb6b949eb82f583c94e7e9c56 P 33f97806ad7344a5b90f7747093f0d39: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b67d6353df25414d9414a7f9c0283053" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b67d6353df25414d9414a7f9c0283053" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 45709 } } peers { permanent_uuid: "33f97806ad7344a5b90f7747093f0d39" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35093 } } peers { permanent_uuid: "bbeacbb144744a28882b0f355a510bc1" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37315 } } }
I20260811 15:03:27.275660 22984 tablet_replica.cc:442] T fa96e38eb6b949eb82f583c94e7e9c56 P 33f97806ad7344a5b90f7747093f0d39: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 15:03:27.275676 23006 mvcc.cc:205] Tried to move back new op lower bound from 7317342647355387904 to 7317342647269789696. Current Snapshot: MvccSnapshot[applied={T|T < 7317342647355387904}]
I20260811 15:03:27.276319 23005 mvcc.cc:205] Tried to move back new op lower bound from 7317342647355387904 to 7317342647269789696. Current Snapshot: MvccSnapshot[applied={T|T < 7317342647355387904}]
I20260811 15:03:27.277523 22982 tablet_replica.cc:439] T fa96e38eb6b949eb82f583c94e7e9c56 P bbeacbb144744a28882b0f355a510bc1: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b67d6353df25414d9414a7f9c0283053" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b67d6353df25414d9414a7f9c0283053" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 45709 } } peers { permanent_uuid: "33f97806ad7344a5b90f7747093f0d39" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35093 } } peers { permanent_uuid: "bbeacbb144744a28882b0f355a510bc1" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37315 } } }
I20260811 15:03:27.277642 22982 tablet_replica.cc:442] T fa96e38eb6b949eb82f583c94e7e9c56 P bbeacbb144744a28882b0f355a510bc1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 15:03:27.280362 23007 mvcc.cc:205] Tried to move back new op lower bound from 7317342647355387904 to 7317342647269789696. Current Snapshot: MvccSnapshot[applied={T|T < 7317342647355387904}]
I20260811 15:03:27.287544 22970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:27.283863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59588 (local address 127.19.236.65:45709)
0811 15:03:27.283989 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:27.283994 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:27.284052 (+ 58us) server_negotiation.cc:407] Connection header received
0811 15:03:27.284206 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:27.284208 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:27.284253 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:27.284318 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 15:03:27.284641 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:27.285144 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:27.286413 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:27.286623 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:27.286705 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:27.287041 (+ 336us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 15:03:27.287116 (+ 75us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 15:03:27.287184 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:27.287314 (+ 130us) server_negotiation.cc:299] Negotiation successful
0811 15:03:27.287362 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 15:03:27.299978 22970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:27.295981 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.65:49369 (local address 127.19.236.65:45709)
0811 15:03:27.296121 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:27.296128 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:27.296415 (+ 287us) server_negotiation.cc:407] Connection header received
0811 15:03:27.296525 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:27.296528 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:27.296616 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:27.296694 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 15:03:27.296970 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:27.297749 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:27.298633 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:27.298981 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:27.299084 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:27.299421 (+ 337us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 15:03:27.299507 (+ 86us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 15:03:27.299581 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:27.299729 (+ 148us) server_negotiation.cc:299] Negotiation successful
0811 15:03:27.299780 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":25,"server-negotiator.queue_time_us":36}
I20260811 15:03:27.299979 23020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:27.295991 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.65:45709 (local address 127.19.236.65:49369)
0811 15:03:27.296306 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:27.296323 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:27.296434 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:27.296699 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:27.296701 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:27.296707 (+ 6us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 15:03:27.296862 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:27.296867 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:27.297882 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:27.297885 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:27.298514 (+ 629us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:27.298523 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:27.299118 (+ 595us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:27.299121 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:27.299206 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:27.299255 (+ 49us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 15:03:27.299616 (+ 361us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 15:03:27.299623 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 15:03:27.299695 (+ 72us) client_negotiation.cc:240] Negotiation successful
0811 15:03:27.299766 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":219,"mutex_wait_us":28,"thread_start_us":134,"threads_started":1}
I20260811 15:03:27.307588 22732 raft_consensus.cc:1261] T 47f1950a26534d1ca08a40dfdad7e3bb P 33f97806ad7344a5b90f7747093f0d39 [term 1 FOLLOWER]: Refusing update from remote peer b67d6353df25414d9414a7f9c0283053: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:03:27.307588 22892 raft_consensus.cc:1261] T 47f1950a26534d1ca08a40dfdad7e3bb P bbeacbb144744a28882b0f355a510bc1 [term 1 FOLLOWER]: Refusing update from remote peer b67d6353df25414d9414a7f9c0283053: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:03:27.308007 22983 consensus_queue.cc:1035] T 47f1950a26534d1ca08a40dfdad7e3bb P b67d6353df25414d9414a7f9c0283053 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33f97806ad7344a5b90f7747093f0d39" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:03:27.308207 23012 consensus_queue.cc:1035] T 47f1950a26534d1ca08a40dfdad7e3bb P b67d6353df25414d9414a7f9c0283053 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbeacbb144744a28882b0f355a510bc1" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:03:27.354821 22387 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51106:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 15:03:27.355003 22387 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51106:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 15:03:27.357692 22387 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ba30c716efa142439fa243bd54345453: Sending DeleteTablet for 3 replicas of tablet 47f1950a26534d1ca08a40dfdad7e3bb
I20260811 15:03:27.358453 22861 tablet_service.cc:1514] Processing DeleteTablet for tablet 47f1950a26534d1ca08a40dfdad7e3bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:03:27 UTC) from {username='kudu', principal='kudu/127.19.236.126@KRBTEST.COM'} at 127.0.0.1:42474
I20260811 15:03:27.358578 22709 tablet_service.cc:1514] Processing DeleteTablet for tablet 47f1950a26534d1ca08a40dfdad7e3bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:03:27 UTC) from {username='kudu', principal='kudu/127.19.236.126@KRBTEST.COM'} at 127.0.0.1:55254
I20260811 15:03:27.359040 23024 tablet_replica.cc:330] T 47f1950a26534d1ca08a40dfdad7e3bb P bbeacbb144744a28882b0f355a510bc1: stopping tablet replica
I20260811 15:03:27.359136 22547 tablet_service.cc:1514] Processing DeleteTablet for tablet 47f1950a26534d1ca08a40dfdad7e3bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:03:27 UTC) from {username='kudu', principal='kudu/127.19.236.126@KRBTEST.COM'} at 127.0.0.1:59558
I20260811 15:03:27.359426 23024 raft_consensus.cc:2229] T 47f1950a26534d1ca08a40dfdad7e3bb P bbeacbb144744a28882b0f355a510bc1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 15:03:27.359678 23026 tablet_replica.cc:330] T 47f1950a26534d1ca08a40dfdad7e3bb P b67d6353df25414d9414a7f9c0283053: stopping tablet replica
I20260811 15:03:27.359699 23024 raft_consensus.cc:2258] T 47f1950a26534d1ca08a40dfdad7e3bb P bbeacbb144744a28882b0f355a510bc1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:03:27.360067 23026 raft_consensus.cc:2229] T 47f1950a26534d1ca08a40dfdad7e3bb P b67d6353df25414d9414a7f9c0283053 [term 1 LEADER]: Raft consensus shutting down.
I20260811 15:03:27.360268 23025 tablet_replica.cc:330] T 47f1950a26534d1ca08a40dfdad7e3bb P 33f97806ad7344a5b90f7747093f0d39: stopping tablet replica
I20260811 15:03:27.360296 22387 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51106:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 15:03:27.360544 23025 raft_consensus.cc:2229] T 47f1950a26534d1ca08a40dfdad7e3bb P 33f97806ad7344a5b90f7747093f0d39 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 15:03:27.360767 23025 raft_consensus.cc:2258] T 47f1950a26534d1ca08a40dfdad7e3bb P 33f97806ad7344a5b90f7747093f0d39 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:03:27.360882 23026 raft_consensus.cc:2258] T 47f1950a26534d1ca08a40dfdad7e3bb P b67d6353df25414d9414a7f9c0283053 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260811 15:03:27.361078 22387 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 15:03:27.362416 23024 ts_tablet_manager.cc:1905] T 47f1950a26534d1ca08a40dfdad7e3bb P bbeacbb144744a28882b0f355a510bc1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 15:03:27.363706 23026 ts_tablet_manager.cc:1905] T 47f1950a26534d1ca08a40dfdad7e3bb P b67d6353df25414d9414a7f9c0283053: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 15:03:27.364356 23025 ts_tablet_manager.cc:1905] T 47f1950a26534d1ca08a40dfdad7e3bb P 33f97806ad7344a5b90f7747093f0d39: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 15:03:27.365722 23024 ts_tablet_manager.cc:1918] T 47f1950a26534d1ca08a40dfdad7e3bb P bbeacbb144744a28882b0f355a510bc1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 15:03:27.365826 23024 log.cc:1196] T 47f1950a26534d1ca08a40dfdad7e3bb P bbeacbb144744a28882b0f355a510bc1: Deleting WAL directory at /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/minicluster-data/ts-2/wal/wals/47f1950a26534d1ca08a40dfdad7e3bb
I20260811 15:03:27.366164 23024 ts_tablet_manager.cc:1939] T 47f1950a26534d1ca08a40dfdad7e3bb P bbeacbb144744a28882b0f355a510bc1: Deleting consensus metadata
I20260811 15:03:27.367451 22709 tablet_service.cc:1467] Processing CreateTablet for tablet 312a3ebeabca41cd8ece4520cbe17a55 (DEFAULT_TABLE table=test-table [id=5b499805d69942019fd4699541aa8c47]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:03:27.367705 22709 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 312a3ebeabca41cd8ece4520cbe17a55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:03:27.369457 22861 tablet_service.cc:1467] Processing CreateTablet for tablet 312a3ebeabca41cd8ece4520cbe17a55 (DEFAULT_TABLE table=test-table [id=5b499805d69942019fd4699541aa8c47]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:03:27.369761 22861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 312a3ebeabca41cd8ece4520cbe17a55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:03:27.372084 22977 tablet_bootstrap.cc:492] T 312a3ebeabca41cd8ece4520cbe17a55 P bbeacbb144744a28882b0f355a510bc1: Bootstrap starting.
I20260811 15:03:27.367455 22372 catalog_manager.cc:4841] TS bbeacbb144744a28882b0f355a510bc1 (127.19.236.67:37315): tablet 47f1950a26534d1ca08a40dfdad7e3bb (table test-table [id=c6ce71753dcd4c0cac592599a5bba247]) successfully deleted
I20260811 15:03:27.373340 22977 tablet_bootstrap.cc:654] T 312a3ebeabca41cd8ece4520cbe17a55 P bbeacbb144744a28882b0f355a510bc1: Neither blocks nor log segments found. Creating new log.
I20260811 15:03:27.375406 22979 tablet_bootstrap.cc:492] T 312a3ebeabca41cd8ece4520cbe17a55 P 33f97806ad7344a5b90f7747093f0d39: Bootstrap starting.
I20260811 15:03:27.376369 22979 tablet_bootstrap.cc:654] T 312a3ebeabca41cd8ece4520cbe17a55 P 33f97806ad7344a5b90f7747093f0d39: Neither blocks nor log segments found. Creating new log.
I20260811 15:03:27.367120 22547 tablet_service.cc:1467] Processing CreateTablet for tablet 312a3ebeabca41cd8ece4520cbe17a55 (DEFAULT_TABLE table=test-table [id=5b499805d69942019fd4699541aa8c47]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:03:27.377681 22977 tablet_bootstrap.cc:492] T 312a3ebeabca41cd8ece4520cbe17a55 P bbeacbb144744a28882b0f355a510bc1: No bootstrap required, opened a new log
I20260811 15:03:27.377799 22977 ts_tablet_manager.cc:1397] T 312a3ebeabca41cd8ece4520cbe17a55 P bbeacbb144744a28882b0f355a510bc1: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260811 15:03:27.378297 22977 raft_consensus.cc:348] T 312a3ebeabca41cd8ece4520cbe17a55 P bbeacbb144744a28882b0f355a510bc1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b67d6353df25414d9414a7f9c0283053" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 45709 } } peers { permanent_uuid: "33f97806ad7344a5b90f7747093f0d39" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35093 } } peers { permanent_uuid: "bbeacbb144744a28882b0f355a510bc1" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37315 } }
I20260811 15:03:27.378451 22977 raft_consensus.cc:374] T 312a3ebeabca41cd8ece4520cbe17a55 P bbeacbb144744a28882b0f355a510bc1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:03:27.378494 22977 raft_consensus.cc:729] T 312a3ebeabca41cd8ece4520cbe17a55 P bbeacbb144744a28882b0f355a510bc1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbeacbb144744a28882b0f355a510bc1, State: Initialized, Role: FOLLOWER
I20260811 15:03:27.378719 22547 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 312a3ebeabca41cd8ece4520cbe17a55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:03:27.381778 23025 ts_tablet_manager.cc:1918] T 47f1950a26534d1ca08a40dfdad7e3bb P 33f97806ad7344a5b90f7747093f0d39: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 15:03:27.382125 22976 tablet_bootstrap.cc:492] T 312a3ebeabca41cd8ece4520cbe17a55 P b67d6353df25414d9414a7f9c0283053: Bootstrap starting.
I20260811 15:03:27.383174 22976 tablet_bootstrap.cc:654] T 312a3ebeabca41cd8ece4520cbe17a55 P b67d6353df25414d9414a7f9c0283053: Neither blocks nor log segments found. Creating new log.
I20260811 15:03:27.383735 23026 ts_tablet_manager.cc:1918] T 47f1950a26534d1ca08a40dfdad7e3bb P b67d6353df25414d9414a7f9c0283053: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 15:03:27.383899 22977 consensus_queue.cc:260] T 312a3ebeabca41cd8ece4520cbe17a55 P bbeacbb144744a28882b0f355a510bc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b67d6353df25414d9414a7f9c0283053" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 45709 } } peers { permanent_uuid: "33f97806ad7344a5b90f7747093f0d39" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35093 } } peers { permanent_uuid: "bbeacbb144744a28882b0f355a510bc1" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37315 } }
I20260811 15:03:27.384897 23025 log.cc:1196] T 47f1950a26534d1ca08a40dfdad7e3bb P 33f97806ad7344a5b90f7747093f0d39: Deleting WAL directory at /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/minicluster-data/ts-1/wal/wals/47f1950a26534d1ca08a40dfdad7e3bb
I20260811 15:03:27.384941 22976 tablet_bootstrap.cc:492] T 312a3ebeabca41cd8ece4520cbe17a55 P b67d6353df25414d9414a7f9c0283053: No bootstrap required, opened a new log
I20260811 15:03:27.385067 22976 ts_tablet_manager.cc:1397] T 312a3ebeabca41cd8ece4520cbe17a55 P b67d6353df25414d9414a7f9c0283053: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.001s
I20260811 15:03:27.385303 22977 ts_tablet_manager.cc:1428] T 312a3ebeabca41cd8ece4520cbe17a55 P bbeacbb144744a28882b0f355a510bc1: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260811 15:03:27.385553 22976 raft_consensus.cc:348] T 312a3ebeabca41cd8ece4520cbe17a55 P b67d6353df25414d9414a7f9c0283053 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b67d6353df25414d9414a7f9c0283053" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 45709 } } peers { permanent_uuid: "33f97806ad7344a5b90f7747093f0d39" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35093 } } peers { permanent_uuid: "bbeacbb144744a28882b0f355a510bc1" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37315 } }
I20260811 15:03:27.385682 22976 raft_consensus.cc:374] T 312a3ebeabca41cd8ece4520cbe17a55 P b67d6353df25414d9414a7f9c0283053 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:03:27.385718 22976 raft_consensus.cc:729] T 312a3ebeabca41cd8ece4520cbe17a55 P b67d6353df25414d9414a7f9c0283053 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b67d6353df25414d9414a7f9c0283053, State: Initialized, Role: FOLLOWER
I20260811 15:03:27.386427 22976 consensus_queue.cc:260] T 312a3ebeabca41cd8ece4520cbe17a55 P b67d6353df25414d9414a7f9c0283053 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b67d6353df25414d9414a7f9c0283053" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 45709 } } peers { permanent_uuid: "33f97806ad7344a5b90f7747093f0d39" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35093 } } peers { permanent_uuid: "bbeacbb144744a28882b0f355a510bc1" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37315 } }
I20260811 15:03:27.386827 22976 ts_tablet_manager.cc:1428] T 312a3ebeabca41cd8ece4520cbe17a55 P b67d6353df25414d9414a7f9c0283053: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260811 15:03:27.387037 23026 log.cc:1196] T 47f1950a26534d1ca08a40dfdad7e3bb P b67d6353df25414d9414a7f9c0283053: Deleting WAL directory at /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/minicluster-data/ts-0/wal/wals/47f1950a26534d1ca08a40dfdad7e3bb
I20260811 15:03:27.387851 23026 ts_tablet_manager.cc:1939] T 47f1950a26534d1ca08a40dfdad7e3bb P b67d6353df25414d9414a7f9c0283053: Deleting consensus metadata
I20260811 15:03:27.388173 23025 ts_tablet_manager.cc:1939] T 47f1950a26534d1ca08a40dfdad7e3bb P 33f97806ad7344a5b90f7747093f0d39: Deleting consensus metadata
I20260811 15:03:27.386485 22979 tablet_bootstrap.cc:492] T 312a3ebeabca41cd8ece4520cbe17a55 P 33f97806ad7344a5b90f7747093f0d39: No bootstrap required, opened a new log
I20260811 15:03:27.388659 22979 ts_tablet_manager.cc:1397] T 312a3ebeabca41cd8ece4520cbe17a55 P 33f97806ad7344a5b90f7747093f0d39: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.002s
I20260811 15:03:27.389199 22979 raft_consensus.cc:348] T 312a3ebeabca41cd8ece4520cbe17a55 P 33f97806ad7344a5b90f7747093f0d39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b67d6353df25414d9414a7f9c0283053" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 45709 } } peers { permanent_uuid: "33f97806ad7344a5b90f7747093f0d39" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35093 } } peers { permanent_uuid: "bbeacbb144744a28882b0f355a510bc1" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37315 } }
I20260811 15:03:27.389359 22979 raft_consensus.cc:374] T 312a3ebeabca41cd8ece4520cbe17a55 P 33f97806ad7344a5b90f7747093f0d39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:03:27.389408 22979 raft_consensus.cc:729] T 312a3ebeabca41cd8ece4520cbe17a55 P 33f97806ad7344a5b90f7747093f0d39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33f97806ad7344a5b90f7747093f0d39, State: Initialized, Role: FOLLOWER
I20260811 15:03:27.389551 22979 consensus_queue.cc:260] T 312a3ebeabca41cd8ece4520cbe17a55 P 33f97806ad7344a5b90f7747093f0d39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b67d6353df25414d9414a7f9c0283053" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 45709 } } peers { permanent_uuid: "33f97806ad7344a5b90f7747093f0d39" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35093 } } peers { permanent_uuid: "bbeacbb144744a28882b0f355a510bc1" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37315 } }
I20260811 15:03:27.389870 22982 raft_consensus.cc:482] T 312a3ebeabca41cd8ece4520cbe17a55 P bbeacbb144744a28882b0f355a510bc1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 15:03:27.389974 22982 raft_consensus.cc:504] T 312a3ebeabca41cd8ece4520cbe17a55 P bbeacbb144744a28882b0f355a510bc1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b67d6353df25414d9414a7f9c0283053" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 45709 } } peers { permanent_uuid: "33f97806ad7344a5b90f7747093f0d39" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35093 } } peers { permanent_uuid: "bbeacbb144744a28882b0f355a510bc1" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37315 } }
I20260811 15:03:27.391172 22982 leader_election.cc:288] T 312a3ebeabca41cd8ece4520cbe17a55 P bbeacbb144744a28882b0f355a510bc1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b67d6353df25414d9414a7f9c0283053 (127.19.236.65:45709), 33f97806ad7344a5b90f7747093f0d39 (127.19.236.66:35093)
I20260811 15:03:27.391330 22370 catalog_manager.cc:4841] TS b67d6353df25414d9414a7f9c0283053 (127.19.236.65:45709): tablet 47f1950a26534d1ca08a40dfdad7e3bb (table test-table [id=c6ce71753dcd4c0cac592599a5bba247]) successfully deleted
I20260811 15:03:27.392859 22370 catalog_manager.cc:4841] TS 33f97806ad7344a5b90f7747093f0d39 (127.19.236.66:35093): tablet 47f1950a26534d1ca08a40dfdad7e3bb (table test-table [id=c6ce71753dcd4c0cac592599a5bba247]) successfully deleted
I20260811 15:03:27.394295 22979 ts_tablet_manager.cc:1428] T 312a3ebeabca41cd8ece4520cbe17a55 P 33f97806ad7344a5b90f7747093f0d39: Time spent starting tablet: real 0.006s user 0.000s sys 0.001s
I20260811 15:03:27.397743 22823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:27.391757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.66:35093 (local address 127.19.236.67:37207)
0811 15:03:27.392085 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:27.392102 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:27.392213 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:27.393053 (+ 840us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:27.393056 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:27.393079 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:03:27.393770 (+ 691us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:27.393782 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:27.395247 (+ 1465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:27.395250 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:27.396473 (+ 1223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:27.396486 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:27.397272 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:27.397276 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:27.397388 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:27.397410 (+ 22us) client_negotiation.cc:769] Sending connection context
0811 15:03:27.397514 (+ 104us) client_negotiation.cc:240] Negotiation successful
0811 15:03:27.397598 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":272,"spinlock_wait_cycles":3328,"thread_start_us":99,"threads_started":1}
I20260811 15:03:27.397737 22974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:27.392458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.67:37207 (local address 127.19.236.66:35093)
0811 15:03:27.392628 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:27.392634 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:27.392663 (+ 29us) server_negotiation.cc:407] Connection header received
0811 15:03:27.392715 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:27.392718 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:27.392771 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:27.392839 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:03:27.393920 (+ 1081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:27.394635 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:27.396651 (+ 2016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:27.397132 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:27.397276 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:27.397330 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:27.397550 (+ 220us) server_negotiation.cc:299] Negotiation successful
0811 15:03:27.397619 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260811 15:03:27.398447 22732 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "312a3ebeabca41cd8ece4520cbe17a55" candidate_uuid: "bbeacbb144744a28882b0f355a510bc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33f97806ad7344a5b90f7747093f0d39" is_pre_election: true
I20260811 15:03:27.398617 22732 raft_consensus.cc:2454] T 312a3ebeabca41cd8ece4520cbe17a55 P 33f97806ad7344a5b90f7747093f0d39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbeacbb144744a28882b0f355a510bc1 in term 0.
I20260811 15:03:27.399119 22814 leader_election.cc:302] T 312a3ebeabca41cd8ece4520cbe17a55 P bbeacbb144744a28882b0f355a510bc1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33f97806ad7344a5b90f7747093f0d39, bbeacbb144744a28882b0f355a510bc1; no voters:
I20260811 15:03:27.399411 22982 raft_consensus.cc:2781] T 312a3ebeabca41cd8ece4520cbe17a55 P bbeacbb144744a28882b0f355a510bc1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 15:03:27.399475 22982 raft_consensus.cc:482] T 312a3ebeabca41cd8ece4520cbe17a55 P bbeacbb144744a28882b0f355a510bc1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 15:03:27.399524 22982 raft_consensus.cc:3037] T 312a3ebeabca41cd8ece4520cbe17a55 P bbeacbb144744a28882b0f355a510bc1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:03:27.400480 23030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:27.391514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.65:45709 (local address 127.19.236.67:56025)
0811 15:03:27.392086 (+ 572us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:27.392102 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:27.392213 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:27.396459 (+ 4246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:27.396462 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:27.396488 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:03:27.396670 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:27.396678 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:27.397717 (+ 1039us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:27.397721 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:27.398908 (+ 1187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:27.398921 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:27.399986 (+ 1065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:27.399990 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:27.400137 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:27.400163 (+ 26us) client_negotiation.cc:769] Sending connection context
0811 15:03:27.400249 (+ 86us) client_negotiation.cc:240] Negotiation successful
0811 15:03:27.400325 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":489,"spinlock_wait_cycles":33024}
I20260811 15:03:27.400514 22970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:27.392638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.67:56025 (local address 127.19.236.65:45709)
0811 15:03:27.392769 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:27.392774 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:27.392790 (+ 16us) server_negotiation.cc:407] Connection header received
0811 15:03:27.392840 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:27.392843 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:27.392893 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:27.392988 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:03:27.396827 (+ 3839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:27.397556 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:27.399076 (+ 1520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:27.399692 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:27.399793 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:27.399845 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:27.400287 (+ 442us) server_negotiation.cc:299] Negotiation successful
0811 15:03:27.400372 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 15:03:27.400882 22982 raft_consensus.cc:504] T 312a3ebeabca41cd8ece4520cbe17a55 P bbeacbb144744a28882b0f355a510bc1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b67d6353df25414d9414a7f9c0283053" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 45709 } } peers { permanent_uuid: "33f97806ad7344a5b90f7747093f0d39" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35093 } } peers { permanent_uuid: "bbeacbb144744a28882b0f355a510bc1" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37315 } }
I20260811 15:03:27.401298 22982 leader_election.cc:288] T 312a3ebeabca41cd8ece4520cbe17a55 P bbeacbb144744a28882b0f355a510bc1 [CANDIDATE]: Term 1 election: Requested vote from peers b67d6353df25414d9414a7f9c0283053 (127.19.236.65:45709), 33f97806ad7344a5b90f7747093f0d39 (127.19.236.66:35093)
I20260811 15:03:27.401515 22572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "312a3ebeabca41cd8ece4520cbe17a55" candidate_uuid: "bbeacbb144744a28882b0f355a510bc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b67d6353df25414d9414a7f9c0283053" is_pre_election: true
I20260811 15:03:27.401757 22572 raft_consensus.cc:2454] T 312a3ebeabca41cd8ece4520cbe17a55 P b67d6353df25414d9414a7f9c0283053 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbeacbb144744a28882b0f355a510bc1 in term 0.
I20260811 15:03:27.401906 22732 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "312a3ebeabca41cd8ece4520cbe17a55" candidate_uuid: "bbeacbb144744a28882b0f355a510bc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33f97806ad7344a5b90f7747093f0d39"
I20260811 15:03:27.402041 22732 raft_consensus.cc:3037] T 312a3ebeabca41cd8ece4520cbe17a55 P 33f97806ad7344a5b90f7747093f0d39 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:03:27.402083 22570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "312a3ebeabca41cd8ece4520cbe17a55" candidate_uuid: "bbeacbb144744a28882b0f355a510bc1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b67d6353df25414d9414a7f9c0283053"
I20260811 15:03:27.402204 22570 raft_consensus.cc:3037] T 312a3ebeabca41cd8ece4520cbe17a55 P b67d6353df25414d9414a7f9c0283053 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:03:27.403066 22732 raft_consensus.cc:2454] T 312a3ebeabca41cd8ece4520cbe17a55 P 33f97806ad7344a5b90f7747093f0d39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbeacbb144744a28882b0f355a510bc1 in term 1.
I20260811 15:03:27.403400 22814 leader_election.cc:302] T 312a3ebeabca41cd8ece4520cbe17a55 P bbeacbb144744a28882b0f355a510bc1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33f97806ad7344a5b90f7747093f0d39, bbeacbb144744a28882b0f355a510bc1; no voters:
I20260811 15:03:27.403458 22570 raft_consensus.cc:2454] T 312a3ebeabca41cd8ece4520cbe17a55 P b67d6353df25414d9414a7f9c0283053 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbeacbb144744a28882b0f355a510bc1 in term 1.
I20260811 15:03:27.403611 22982 raft_consensus.cc:2781] T 312a3ebeabca41cd8ece4520cbe17a55 P bbeacbb144744a28882b0f355a510bc1 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:03:27.403800 22982 raft_consensus.cc:686] T 312a3ebeabca41cd8ece4520cbe17a55 P bbeacbb144744a28882b0f355a510bc1 [term 1 LEADER]: Becoming Leader. State: Replica: bbeacbb144744a28882b0f355a510bc1, State: Running, Role: LEADER
I20260811 15:03:27.404058 22982 consensus_queue.cc:237] T 312a3ebeabca41cd8ece4520cbe17a55 P bbeacbb144744a28882b0f355a510bc1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b67d6353df25414d9414a7f9c0283053" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 45709 } } peers { permanent_uuid: "33f97806ad7344a5b90f7747093f0d39" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35093 } } peers { permanent_uuid: "bbeacbb144744a28882b0f355a510bc1" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37315 } }
I20260811 15:03:27.406860 22387 catalog_manager.cc:5495] T 312a3ebeabca41cd8ece4520cbe17a55 P bbeacbb144744a28882b0f355a510bc1 reported cstate change: term changed from 0 to 1, leader changed from <none> to bbeacbb144744a28882b0f355a510bc1 (127.19.236.67). New cstate: current_term: 1 leader_uuid: "bbeacbb144744a28882b0f355a510bc1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b67d6353df25414d9414a7f9c0283053" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 45709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33f97806ad7344a5b90f7747093f0d39" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bbeacbb144744a28882b0f355a510bc1" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37315 } health_report { overall_health: HEALTHY } } }
I20260811 15:03:27.425196 22971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:27.420848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42482 (local address 127.19.236.67:37315)
0811 15:03:27.420974 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:27.420978 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:27.421011 (+ 33us) server_negotiation.cc:407] Connection header received
0811 15:03:27.421190 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:27.421193 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:27.421258 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:27.421373 (+ 115us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 15:03:27.421575 (+ 202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:27.422348 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:27.423203 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:27.423535 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:27.423639 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:27.423910 (+ 271us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 15:03:27.424495 (+ 585us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 15:03:27.424649 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:27.424969 (+ 320us) server_negotiation.cc:299] Negotiation successful
0811 15:03:27.425032 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 15:03:27.438055 22970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:27.433701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.67:33187 (local address 127.19.236.65:45709)
0811 15:03:27.433822 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:27.433827 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:27.434099 (+ 272us) server_negotiation.cc:407] Connection header received
0811 15:03:27.434228 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:27.434231 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:27.434284 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:27.434366 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 15:03:27.434740 (+ 374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:27.435516 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:27.436815 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:27.437170 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:27.437275 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:27.437590 (+ 315us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 15:03:27.437674 (+ 84us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 15:03:27.437751 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:27.437866 (+ 115us) server_negotiation.cc:299] Negotiation successful
0811 15:03:27.437922 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 15:03:27.438087 23036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:27.433606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.65:45709 (local address 127.19.236.67:33187)
0811 15:03:27.433996 (+ 390us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:27.434013 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:27.434126 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:27.434397 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:27.434401 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:27.434413 (+ 12us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 15:03:27.434569 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:27.434577 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:27.435672 (+ 1095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:27.435675 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:27.436694 (+ 1019us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:27.436704 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:27.437293 (+ 589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:27.437297 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:27.437392 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:27.437447 (+ 55us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 15:03:27.437766 (+ 319us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 15:03:27.437772 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 15:03:27.437833 (+ 61us) client_negotiation.cc:240] Negotiation successful
0811 15:03:27.437912 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":267,"thread_start_us":99,"threads_started":1}
I20260811 15:03:27.446414 22732 raft_consensus.cc:1261] T 312a3ebeabca41cd8ece4520cbe17a55 P 33f97806ad7344a5b90f7747093f0d39 [term 1 FOLLOWER]: Refusing update from remote peer bbeacbb144744a28882b0f355a510bc1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:03:27.446547 22570 raft_consensus.cc:1261] T 312a3ebeabca41cd8ece4520cbe17a55 P b67d6353df25414d9414a7f9c0283053 [term 1 FOLLOWER]: Refusing update from remote peer bbeacbb144744a28882b0f355a510bc1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:03:27.447057 23031 consensus_queue.cc:1035] T 312a3ebeabca41cd8ece4520cbe17a55 P bbeacbb144744a28882b0f355a510bc1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33f97806ad7344a5b90f7747093f0d39" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:03:27.447258 22982 consensus_queue.cc:1035] T 312a3ebeabca41cd8ece4520cbe17a55 P bbeacbb144744a28882b0f355a510bc1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b67d6353df25414d9414a7f9c0283053" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 45709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:03:27.469372 23020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:27.465003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.67:37315 (local address 127.19.236.65:39357)
0811 15:03:27.465582 (+ 579us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:27.465600 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:27.465695 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:27.466028 (+ 333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:27.466031 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:27.466039 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 15:03:27.466142 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:27.466149 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:27.467141 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:27.467145 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:27.468057 (+ 912us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:27.468068 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:27.468622 (+ 554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:27.468627 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:27.468723 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:27.468759 (+ 36us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 15:03:27.469056 (+ 297us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 15:03:27.469063 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 15:03:27.469129 (+ 66us) client_negotiation.cc:240] Negotiation successful
0811 15:03:27.469221 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":476}
I20260811 15:03:27.469753 22971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:27.465217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.65:39357 (local address 127.19.236.67:37315)
0811 15:03:27.465349 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:27.465354 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:27.465675 (+ 321us) server_negotiation.cc:407] Connection header received
0811 15:03:27.465794 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:27.465797 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:27.465847 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:27.465913 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 15:03:27.466274 (+ 361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:27.467006 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:27.468184 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:27.468471 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:27.468618 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:27.468874 (+ 256us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 15:03:27.468960 (+ 86us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 15:03:27.469041 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:27.469574 (+ 533us) server_negotiation.cc:299] Negotiation successful
0811 15:03:27.469634 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
W20260811 15:03:27.470448 23007 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260811 15:03:29.035718 22386 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51106:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 15:03:29.035912 22386 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51106:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 15:03:29.038628 22386 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ba30c716efa142439fa243bd54345453: Sending DeleteTablet for 3 replicas of tablet 312a3ebeabca41cd8ece4520cbe17a55
I20260811 15:03:29.039302 22547 tablet_service.cc:1514] Processing DeleteTablet for tablet 312a3ebeabca41cd8ece4520cbe17a55 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:03:29 UTC) from {username='kudu', principal='kudu/127.19.236.126@KRBTEST.COM'} at 127.0.0.1:59558
I20260811 15:03:29.039343 22709 tablet_service.cc:1514] Processing DeleteTablet for tablet 312a3ebeabca41cd8ece4520cbe17a55 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:03:29 UTC) from {username='kudu', principal='kudu/127.19.236.126@KRBTEST.COM'} at 127.0.0.1:55254
I20260811 15:03:29.039397 22861 tablet_service.cc:1514] Processing DeleteTablet for tablet 312a3ebeabca41cd8ece4520cbe17a55 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:03:29 UTC) from {username='kudu', principal='kudu/127.19.236.126@KRBTEST.COM'} at 127.0.0.1:42474
I20260811 15:03:29.041079 23071 tablet_replica.cc:330] T 312a3ebeabca41cd8ece4520cbe17a55 P bbeacbb144744a28882b0f355a510bc1: stopping tablet replica
I20260811 15:03:29.041293 23071 raft_consensus.cc:2229] T 312a3ebeabca41cd8ece4520cbe17a55 P bbeacbb144744a28882b0f355a510bc1 [term 1 LEADER]: Raft consensus shutting down.
I20260811 15:03:29.041756 23071 raft_consensus.cc:2258] T 312a3ebeabca41cd8ece4520cbe17a55 P bbeacbb144744a28882b0f355a510bc1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:03:29.042147 23070 tablet_replica.cc:330] T 312a3ebeabca41cd8ece4520cbe17a55 P b67d6353df25414d9414a7f9c0283053: stopping tablet replica
I20260811 15:03:29.042418 23069 tablet_replica.cc:330] T 312a3ebeabca41cd8ece4520cbe17a55 P 33f97806ad7344a5b90f7747093f0d39: stopping tablet replica
I20260811 15:03:29.042629 23069 raft_consensus.cc:2229] T 312a3ebeabca41cd8ece4520cbe17a55 P 33f97806ad7344a5b90f7747093f0d39 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 15:03:29.042821 23071 ts_tablet_manager.cc:1905] T 312a3ebeabca41cd8ece4520cbe17a55 P bbeacbb144744a28882b0f355a510bc1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 15:03:29.042834 23070 raft_consensus.cc:2229] T 312a3ebeabca41cd8ece4520cbe17a55 P b67d6353df25414d9414a7f9c0283053 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 15:03:29.043054 23069 raft_consensus.cc:2258] T 312a3ebeabca41cd8ece4520cbe17a55 P 33f97806ad7344a5b90f7747093f0d39 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:03:29.043280 23070 raft_consensus.cc:2258] T 312a3ebeabca41cd8ece4520cbe17a55 P b67d6353df25414d9414a7f9c0283053 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:03:29.043788 23069 ts_tablet_manager.cc:1905] T 312a3ebeabca41cd8ece4520cbe17a55 P 33f97806ad7344a5b90f7747093f0d39: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 15:03:29.044013 23070 ts_tablet_manager.cc:1905] T 312a3ebeabca41cd8ece4520cbe17a55 P b67d6353df25414d9414a7f9c0283053: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 15:03:29.046193 23071 ts_tablet_manager.cc:1918] T 312a3ebeabca41cd8ece4520cbe17a55 P bbeacbb144744a28882b0f355a510bc1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 15:03:29.046288 23071 log.cc:1196] T 312a3ebeabca41cd8ece4520cbe17a55 P bbeacbb144744a28882b0f355a510bc1: Deleting WAL directory at /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/minicluster-data/ts-2/wal/wals/312a3ebeabca41cd8ece4520cbe17a55
I20260811 15:03:29.046620 23071 ts_tablet_manager.cc:1939] T 312a3ebeabca41cd8ece4520cbe17a55 P bbeacbb144744a28882b0f355a510bc1: Deleting consensus metadata
I20260811 15:03:29.046988 23069 ts_tablet_manager.cc:1918] T 312a3ebeabca41cd8ece4520cbe17a55 P 33f97806ad7344a5b90f7747093f0d39: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 15:03:29.047140 23069 log.cc:1196] T 312a3ebeabca41cd8ece4520cbe17a55 P 33f97806ad7344a5b90f7747093f0d39: Deleting WAL directory at /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/minicluster-data/ts-1/wal/wals/312a3ebeabca41cd8ece4520cbe17a55
I20260811 15:03:29.047309 23070 ts_tablet_manager.cc:1918] T 312a3ebeabca41cd8ece4520cbe17a55 P b67d6353df25414d9414a7f9c0283053: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 15:03:29.047401 23070 log.cc:1196] T 312a3ebeabca41cd8ece4520cbe17a55 P b67d6353df25414d9414a7f9c0283053: Deleting WAL directory at /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/minicluster-data/ts-0/wal/wals/312a3ebeabca41cd8ece4520cbe17a55
I20260811 15:03:29.047508 22372 catalog_manager.cc:4841] TS bbeacbb144744a28882b0f355a510bc1 (127.19.236.67:37315): tablet 312a3ebeabca41cd8ece4520cbe17a55 (table test-table [id=5b499805d69942019fd4699541aa8c47]) successfully deleted
I20260811 15:03:29.047592 23069 ts_tablet_manager.cc:1939] T 312a3ebeabca41cd8ece4520cbe17a55 P 33f97806ad7344a5b90f7747093f0d39: Deleting consensus metadata
I20260811 15:03:29.047695 23070 ts_tablet_manager.cc:1939] T 312a3ebeabca41cd8ece4520cbe17a55 P b67d6353df25414d9414a7f9c0283053: Deleting consensus metadata
I20260811 15:03:29.048398 22370 catalog_manager.cc:4841] TS b67d6353df25414d9414a7f9c0283053 (127.19.236.65:45709): tablet 312a3ebeabca41cd8ece4520cbe17a55 (table test-table [id=5b499805d69942019fd4699541aa8c47]) successfully deleted
I20260811 15:03:29.049624 22370 catalog_manager.cc:4841] TS 33f97806ad7344a5b90f7747093f0d39 (127.19.236.66:35093): tablet 312a3ebeabca41cd8ece4520cbe17a55 (table test-table [id=5b499805d69942019fd4699541aa8c47]) successfully deleted
Aug 11 15:03:29 dist-test-slave-8n49 krb5kdc[22337](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460609, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 15:03:29 dist-test-slave-8n49 krb5kdc[22337](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460609, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
I20260811 15:03:29.069691 23082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:29.061113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51122 (local address 127.19.236.126:41441)
0811 15:03:29.061466 (+ 353us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:29.061473 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:29.061489 (+ 16us) server_negotiation.cc:407] Connection header received
0811 15:03:29.061533 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:29.061535 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:29.061581 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:29.061663 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:29.062330 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:29.062901 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:29.063725 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:29.063977 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:29.064067 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:29.066633 (+ 2566us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:29.066636 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:29.066638 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:29.066663 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:29.068043 (+ 1380us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:29.068457 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:29.068460 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:29.068462 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:29.068609 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:29.068866 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:29.068869 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:29.068870 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:29.069058 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:29.069165 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:29.069400 (+ 235us) server_negotiation.cc:299] Negotiation successful
0811 15:03:29.069551 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":260,"thread_start_us":138,"threads_started":1}
I20260811 15:03:29.072255 22386 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51122:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 15:03:29.072794 22386 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 15:03:29.077732 22547 tablet_service.cc:1467] Processing CreateTablet for tablet 3e2e29f1d4f342f48100eca5661b3ccf (DEFAULT_TABLE table=test-table [id=e71e145678624dd5956f5994a93657fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:03:29.077963 22709 tablet_service.cc:1467] Processing CreateTablet for tablet 3e2e29f1d4f342f48100eca5661b3ccf (DEFAULT_TABLE table=test-table [id=e71e145678624dd5956f5994a93657fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:03:29.077957 22861 tablet_service.cc:1467] Processing CreateTablet for tablet 3e2e29f1d4f342f48100eca5661b3ccf (DEFAULT_TABLE table=test-table [id=e71e145678624dd5956f5994a93657fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:03:29.078086 22547 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3e2e29f1d4f342f48100eca5661b3ccf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:03:29.078209 22709 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3e2e29f1d4f342f48100eca5661b3ccf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:03:29.078222 22861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3e2e29f1d4f342f48100eca5661b3ccf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:03:29.080569 23083 tablet_bootstrap.cc:492] T 3e2e29f1d4f342f48100eca5661b3ccf P 33f97806ad7344a5b90f7747093f0d39: Bootstrap starting.
I20260811 15:03:29.081015 23085 tablet_bootstrap.cc:492] T 3e2e29f1d4f342f48100eca5661b3ccf P bbeacbb144744a28882b0f355a510bc1: Bootstrap starting.
I20260811 15:03:29.081365 23084 tablet_bootstrap.cc:492] T 3e2e29f1d4f342f48100eca5661b3ccf P b67d6353df25414d9414a7f9c0283053: Bootstrap starting.
I20260811 15:03:29.081568 23083 tablet_bootstrap.cc:654] T 3e2e29f1d4f342f48100eca5661b3ccf P 33f97806ad7344a5b90f7747093f0d39: Neither blocks nor log segments found. Creating new log.
I20260811 15:03:29.082016 23085 tablet_bootstrap.cc:654] T 3e2e29f1d4f342f48100eca5661b3ccf P bbeacbb144744a28882b0f355a510bc1: Neither blocks nor log segments found. Creating new log.
I20260811 15:03:29.082222 23084 tablet_bootstrap.cc:654] T 3e2e29f1d4f342f48100eca5661b3ccf P b67d6353df25414d9414a7f9c0283053: Neither blocks nor log segments found. Creating new log.
I20260811 15:03:29.083317 23083 tablet_bootstrap.cc:492] T 3e2e29f1d4f342f48100eca5661b3ccf P 33f97806ad7344a5b90f7747093f0d39: No bootstrap required, opened a new log
I20260811 15:03:29.083415 23083 ts_tablet_manager.cc:1397] T 3e2e29f1d4f342f48100eca5661b3ccf P 33f97806ad7344a5b90f7747093f0d39: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 15:03:29.083537 23084 tablet_bootstrap.cc:492] T 3e2e29f1d4f342f48100eca5661b3ccf P b67d6353df25414d9414a7f9c0283053: No bootstrap required, opened a new log
I20260811 15:03:29.083634 23084 ts_tablet_manager.cc:1397] T 3e2e29f1d4f342f48100eca5661b3ccf P b67d6353df25414d9414a7f9c0283053: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 15:03:29.083779 23085 tablet_bootstrap.cc:492] T 3e2e29f1d4f342f48100eca5661b3ccf P bbeacbb144744a28882b0f355a510bc1: No bootstrap required, opened a new log
I20260811 15:03:29.083932 23085 ts_tablet_manager.cc:1397] T 3e2e29f1d4f342f48100eca5661b3ccf P bbeacbb144744a28882b0f355a510bc1: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 15:03:29.083936 23083 raft_consensus.cc:348] T 3e2e29f1d4f342f48100eca5661b3ccf P 33f97806ad7344a5b90f7747093f0d39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b67d6353df25414d9414a7f9c0283053" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 45709 } } peers { permanent_uuid: "33f97806ad7344a5b90f7747093f0d39" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35093 } } peers { permanent_uuid: "bbeacbb144744a28882b0f355a510bc1" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37315 } }
I20260811 15:03:29.084070 23083 raft_consensus.cc:374] T 3e2e29f1d4f342f48100eca5661b3ccf P 33f97806ad7344a5b90f7747093f0d39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:03:29.084113 23083 raft_consensus.cc:729] T 3e2e29f1d4f342f48100eca5661b3ccf P 33f97806ad7344a5b90f7747093f0d39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33f97806ad7344a5b90f7747093f0d39, State: Initialized, Role: FOLLOWER
I20260811 15:03:29.084059 23084 raft_consensus.cc:348] T 3e2e29f1d4f342f48100eca5661b3ccf P b67d6353df25414d9414a7f9c0283053 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b67d6353df25414d9414a7f9c0283053" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 45709 } } peers { permanent_uuid: "33f97806ad7344a5b90f7747093f0d39" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35093 } } peers { permanent_uuid: "bbeacbb144744a28882b0f355a510bc1" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37315 } }
I20260811 15:03:29.084177 23084 raft_consensus.cc:374] T 3e2e29f1d4f342f48100eca5661b3ccf P b67d6353df25414d9414a7f9c0283053 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:03:29.084218 23084 raft_consensus.cc:729] T 3e2e29f1d4f342f48100eca5661b3ccf P b67d6353df25414d9414a7f9c0283053 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b67d6353df25414d9414a7f9c0283053, State: Initialized, Role: FOLLOWER
I20260811 15:03:29.084250 23083 consensus_queue.cc:260] T 3e2e29f1d4f342f48100eca5661b3ccf P 33f97806ad7344a5b90f7747093f0d39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b67d6353df25414d9414a7f9c0283053" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 45709 } } peers { permanent_uuid: "33f97806ad7344a5b90f7747093f0d39" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35093 } } peers { permanent_uuid: "bbeacbb144744a28882b0f355a510bc1" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37315 } }
I20260811 15:03:29.084342 23084 consensus_queue.cc:260] T 3e2e29f1d4f342f48100eca5661b3ccf P b67d6353df25414d9414a7f9c0283053 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b67d6353df25414d9414a7f9c0283053" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 45709 } } peers { permanent_uuid: "33f97806ad7344a5b90f7747093f0d39" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35093 } } peers { permanent_uuid: "bbeacbb144744a28882b0f355a510bc1" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37315 } }
I20260811 15:03:29.084542 23085 raft_consensus.cc:348] T 3e2e29f1d4f342f48100eca5661b3ccf P bbeacbb144744a28882b0f355a510bc1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b67d6353df25414d9414a7f9c0283053" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 45709 } } peers { permanent_uuid: "33f97806ad7344a5b90f7747093f0d39" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35093 } } peers { permanent_uuid: "bbeacbb144744a28882b0f355a510bc1" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37315 } }
I20260811 15:03:29.084666 23084 ts_tablet_manager.cc:1428] T 3e2e29f1d4f342f48100eca5661b3ccf P b67d6353df25414d9414a7f9c0283053: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260811 15:03:29.084685 23083 ts_tablet_manager.cc:1428] T 3e2e29f1d4f342f48100eca5661b3ccf P 33f97806ad7344a5b90f7747093f0d39: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260811 15:03:29.084718 23085 raft_consensus.cc:374] T 3e2e29f1d4f342f48100eca5661b3ccf P bbeacbb144744a28882b0f355a510bc1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:03:29.084762 23085 raft_consensus.cc:729] T 3e2e29f1d4f342f48100eca5661b3ccf P bbeacbb144744a28882b0f355a510bc1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbeacbb144744a28882b0f355a510bc1, State: Initialized, Role: FOLLOWER
I20260811 15:03:29.084929 23085 consensus_queue.cc:260] T 3e2e29f1d4f342f48100eca5661b3ccf P bbeacbb144744a28882b0f355a510bc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b67d6353df25414d9414a7f9c0283053" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 45709 } } peers { permanent_uuid: "33f97806ad7344a5b90f7747093f0d39" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35093 } } peers { permanent_uuid: "bbeacbb144744a28882b0f355a510bc1" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37315 } }
I20260811 15:03:29.085649 23085 ts_tablet_manager.cc:1428] T 3e2e29f1d4f342f48100eca5661b3ccf P bbeacbb144744a28882b0f355a510bc1: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260811 15:03:29.321879 23090 raft_consensus.cc:482] T 3e2e29f1d4f342f48100eca5661b3ccf P 33f97806ad7344a5b90f7747093f0d39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 15:03:29.322043 23090 raft_consensus.cc:504] T 3e2e29f1d4f342f48100eca5661b3ccf P 33f97806ad7344a5b90f7747093f0d39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b67d6353df25414d9414a7f9c0283053" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 45709 } } peers { permanent_uuid: "33f97806ad7344a5b90f7747093f0d39" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35093 } } peers { permanent_uuid: "bbeacbb144744a28882b0f355a510bc1" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37315 } }
I20260811 15:03:29.323110 23090 leader_election.cc:288] T 3e2e29f1d4f342f48100eca5661b3ccf P 33f97806ad7344a5b90f7747093f0d39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b67d6353df25414d9414a7f9c0283053 (127.19.236.65:45709), bbeacbb144744a28882b0f355a510bc1 (127.19.236.67:37315)
I20260811 15:03:29.327469 23093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:29.323557 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.66:39771 (local address 127.19.236.67:37315)
0811 15:03:29.323960 (+ 403us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:29.323975 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:29.324098 (+ 123us) server_negotiation.cc:407] Connection header received
0811 15:03:29.324249 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:29.324251 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:29.324325 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:29.324413 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:03:29.324748 (+ 335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:29.325260 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:29.326447 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:29.326871 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:29.327012 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:29.327067 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:29.327237 (+ 170us) server_negotiation.cc:299] Negotiation successful
0811 15:03:29.327318 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":297,"thread_start_us":145,"threads_started":1}
I20260811 15:03:29.327481 23092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:29.323404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.67:37315 (local address 127.19.236.66:39771)
0811 15:03:29.323984 (+ 580us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:29.323999 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:29.324140 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:29.324455 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:29.324457 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:29.324471 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:03:29.324608 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:29.324613 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:29.325374 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:29.325379 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:29.326315 (+ 936us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:29.326324 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:29.326998 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:29.327002 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:29.327097 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:29.327132 (+ 35us) client_negotiation.cc:769] Sending connection context
0811 15:03:29.327192 (+ 60us) client_negotiation.cc:240] Negotiation successful
0811 15:03:29.327281 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":506,"mutex_wait_us":190,"thread_start_us":93,"threads_started":1}
I20260811 15:03:29.327486 23091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:29.323404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.65:45709 (local address 127.19.236.66:34035)
0811 15:03:29.323872 (+ 468us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:29.323890 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:29.324011 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:29.324327 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:29.324330 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:29.324350 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:03:29.324579 (+ 229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:29.324587 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:29.325396 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:29.325399 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:29.326319 (+ 920us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:29.326329 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:29.327037 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:29.327041 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:29.327146 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:29.327165 (+ 19us) client_negotiation.cc:769] Sending connection context
0811 15:03:29.327263 (+ 98us) client_negotiation.cc:240] Negotiation successful
0811 15:03:29.327326 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":387,"mutex_wait_us":88,"thread_start_us":156,"threads_started":1}
I20260811 15:03:29.327500 23094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:29.323648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.66:34035 (local address 127.19.236.65:45709)
0811 15:03:29.323923 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:29.323933 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:29.323953 (+ 20us) server_negotiation.cc:407] Connection header received
0811 15:03:29.324145 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:29.324149 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:29.324208 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:29.324300 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:03:29.324699 (+ 399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:29.325257 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:29.326467 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:29.326882 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:29.327026 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:29.327082 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:29.327297 (+ 215us) server_negotiation.cc:299] Negotiation successful
0811 15:03:29.327380 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":183,"thread_start_us":97,"threads_started":1}
I20260811 15:03:29.328037 22892 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e2e29f1d4f342f48100eca5661b3ccf" candidate_uuid: "33f97806ad7344a5b90f7747093f0d39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbeacbb144744a28882b0f355a510bc1" is_pre_election: true
I20260811 15:03:29.328227 22892 raft_consensus.cc:2454] T 3e2e29f1d4f342f48100eca5661b3ccf P bbeacbb144744a28882b0f355a510bc1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33f97806ad7344a5b90f7747093f0d39 in term 0.
I20260811 15:03:29.328290 22570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e2e29f1d4f342f48100eca5661b3ccf" candidate_uuid: "33f97806ad7344a5b90f7747093f0d39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b67d6353df25414d9414a7f9c0283053" is_pre_election: true
I20260811 15:03:29.328426 22570 raft_consensus.cc:2454] T 3e2e29f1d4f342f48100eca5661b3ccf P b67d6353df25414d9414a7f9c0283053 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33f97806ad7344a5b90f7747093f0d39 in term 0.
I20260811 15:03:29.328670 22656 leader_election.cc:302] T 3e2e29f1d4f342f48100eca5661b3ccf P 33f97806ad7344a5b90f7747093f0d39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33f97806ad7344a5b90f7747093f0d39, bbeacbb144744a28882b0f355a510bc1; no voters:
I20260811 15:03:29.328955 23090 raft_consensus.cc:2781] T 3e2e29f1d4f342f48100eca5661b3ccf P 33f97806ad7344a5b90f7747093f0d39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 15:03:29.329010 23090 raft_consensus.cc:482] T 3e2e29f1d4f342f48100eca5661b3ccf P 33f97806ad7344a5b90f7747093f0d39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 15:03:29.329037 23090 raft_consensus.cc:3037] T 3e2e29f1d4f342f48100eca5661b3ccf P 33f97806ad7344a5b90f7747093f0d39 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:03:29.330057 23090 raft_consensus.cc:504] T 3e2e29f1d4f342f48100eca5661b3ccf P 33f97806ad7344a5b90f7747093f0d39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b67d6353df25414d9414a7f9c0283053" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 45709 } } peers { permanent_uuid: "33f97806ad7344a5b90f7747093f0d39" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35093 } } peers { permanent_uuid: "bbeacbb144744a28882b0f355a510bc1" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37315 } }
I20260811 15:03:29.330416 23090 leader_election.cc:288] T 3e2e29f1d4f342f48100eca5661b3ccf P 33f97806ad7344a5b90f7747093f0d39 [CANDIDATE]: Term 1 election: Requested vote from peers b67d6353df25414d9414a7f9c0283053 (127.19.236.65:45709), bbeacbb144744a28882b0f355a510bc1 (127.19.236.67:37315)
I20260811 15:03:29.330781 22892 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e2e29f1d4f342f48100eca5661b3ccf" candidate_uuid: "33f97806ad7344a5b90f7747093f0d39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbeacbb144744a28882b0f355a510bc1"
I20260811 15:03:29.330785 22570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e2e29f1d4f342f48100eca5661b3ccf" candidate_uuid: "33f97806ad7344a5b90f7747093f0d39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b67d6353df25414d9414a7f9c0283053"
I20260811 15:03:29.330888 22892 raft_consensus.cc:3037] T 3e2e29f1d4f342f48100eca5661b3ccf P bbeacbb144744a28882b0f355a510bc1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:03:29.330914 22570 raft_consensus.cc:3037] T 3e2e29f1d4f342f48100eca5661b3ccf P b67d6353df25414d9414a7f9c0283053 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:03:29.331884 22570 raft_consensus.cc:2454] T 3e2e29f1d4f342f48100eca5661b3ccf P b67d6353df25414d9414a7f9c0283053 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33f97806ad7344a5b90f7747093f0d39 in term 1.
I20260811 15:03:29.332026 22892 raft_consensus.cc:2454] T 3e2e29f1d4f342f48100eca5661b3ccf P bbeacbb144744a28882b0f355a510bc1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33f97806ad7344a5b90f7747093f0d39 in term 1.
I20260811 15:03:29.332211 22654 leader_election.cc:302] T 3e2e29f1d4f342f48100eca5661b3ccf P 33f97806ad7344a5b90f7747093f0d39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33f97806ad7344a5b90f7747093f0d39, b67d6353df25414d9414a7f9c0283053; no voters:
I20260811 15:03:29.332384 23090 raft_consensus.cc:2781] T 3e2e29f1d4f342f48100eca5661b3ccf P 33f97806ad7344a5b90f7747093f0d39 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:03:29.332676 23090 raft_consensus.cc:686] T 3e2e29f1d4f342f48100eca5661b3ccf P 33f97806ad7344a5b90f7747093f0d39 [term 1 LEADER]: Becoming Leader. State: Replica: 33f97806ad7344a5b90f7747093f0d39, State: Running, Role: LEADER
I20260811 15:03:29.332942 23090 consensus_queue.cc:237] T 3e2e29f1d4f342f48100eca5661b3ccf P 33f97806ad7344a5b90f7747093f0d39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b67d6353df25414d9414a7f9c0283053" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 45709 } } peers { permanent_uuid: "33f97806ad7344a5b90f7747093f0d39" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35093 } } peers { permanent_uuid: "bbeacbb144744a28882b0f355a510bc1" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37315 } }
I20260811 15:03:29.335198 22386 catalog_manager.cc:5495] T 3e2e29f1d4f342f48100eca5661b3ccf P 33f97806ad7344a5b90f7747093f0d39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 33f97806ad7344a5b90f7747093f0d39 (127.19.236.66). New cstate: current_term: 1 leader_uuid: "33f97806ad7344a5b90f7747093f0d39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b67d6353df25414d9414a7f9c0283053" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 45709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33f97806ad7344a5b90f7747093f0d39" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bbeacbb144744a28882b0f355a510bc1" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37315 } health_report { overall_health: UNKNOWN } } }
I20260811 15:03:29.387418 23099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:29.383687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55270 (local address 127.19.236.66:35093)
0811 15:03:29.383973 (+ 286us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:29.383981 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:29.384014 (+ 33us) server_negotiation.cc:407] Connection header received
0811 15:03:29.384106 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:29.384108 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:29.384161 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:29.384273 (+ 112us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 15:03:29.384514 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:29.385141 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:29.385974 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:29.386206 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:29.386284 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:29.386531 (+ 247us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 15:03:29.387008 (+ 477us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 15:03:29.387096 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:29.387159 (+ 63us) server_negotiation.cc:299] Negotiation successful
0811 15:03:29.387208 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":219,"thread_start_us":139,"threads_started":1}
I20260811 15:03:29.397485 23094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:29.394228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.66:60095 (local address 127.19.236.65:45709)
0811 15:03:29.394347 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:29.394351 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:29.394386 (+ 35us) server_negotiation.cc:407] Connection header received
0811 15:03:29.394511 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:29.394514 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:29.394558 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:29.394621 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 15:03:29.394836 (+ 215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:29.395324 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:29.396258 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:29.396603 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:29.396735 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:29.397044 (+ 309us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 15:03:29.397123 (+ 79us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 15:03:29.397204 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:29.397291 (+ 87us) server_negotiation.cc:299] Negotiation successful
0811 15:03:29.397343 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 15:03:29.397500 23102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:29.394032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.65:45709 (local address 127.19.236.66:60095)
0811 15:03:29.394328 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:29.394340 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:29.394424 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:29.394646 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:29.394648 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:29.394654 (+ 6us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 15:03:29.394748 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:29.394752 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:29.395411 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:29.395413 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:29.396131 (+ 718us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:29.396145 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:29.396745 (+ 600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:29.396748 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:29.396851 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:29.396906 (+ 55us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 15:03:29.397209 (+ 303us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 15:03:29.397218 (+ 9us) client_negotiation.cc:769] Sending connection context
0811 15:03:29.397283 (+ 65us) client_negotiation.cc:240] Negotiation successful
0811 15:03:29.397360 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":106,"threads_started":1}
I20260811 15:03:29.403644 22892 raft_consensus.cc:1261] T 3e2e29f1d4f342f48100eca5661b3ccf P bbeacbb144744a28882b0f355a510bc1 [term 1 FOLLOWER]: Refusing update from remote peer 33f97806ad7344a5b90f7747093f0d39: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:03:29.403698 22570 raft_consensus.cc:1261] T 3e2e29f1d4f342f48100eca5661b3ccf P b67d6353df25414d9414a7f9c0283053 [term 1 FOLLOWER]: Refusing update from remote peer 33f97806ad7344a5b90f7747093f0d39: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:03:29.404165 23090 consensus_queue.cc:1035] T 3e2e29f1d4f342f48100eca5661b3ccf P 33f97806ad7344a5b90f7747093f0d39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b67d6353df25414d9414a7f9c0283053" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 45709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:03:29.404395 23095 consensus_queue.cc:1035] T 3e2e29f1d4f342f48100eca5661b3ccf P 33f97806ad7344a5b90f7747093f0d39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbeacbb144744a28882b0f355a510bc1" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:03:29.422559 23107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:29.418856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.66:35093 (local address 127.19.236.65:58839)
0811 15:03:29.419134 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:29.419151 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:29.419265 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:29.419522 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:29.419525 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:29.419534 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 15:03:29.419648 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:29.419659 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:29.420407 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:29.420410 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:29.421231 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:29.421242 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:29.421718 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:29.421721 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:29.421816 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:29.421856 (+ 40us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 15:03:29.422198 (+ 342us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 15:03:29.422205 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 15:03:29.422282 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 15:03:29.422374 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":98,"threads_started":1}
I20260811 15:03:29.422619 23099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:29.418946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.65:58839 (local address 127.19.236.66:35093)
0811 15:03:29.419064 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:29.419069 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:29.419217 (+ 148us) server_negotiation.cc:407] Connection header received
0811 15:03:29.419363 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:29.419366 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:29.419412 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:29.419500 (+ 88us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 15:03:29.419761 (+ 261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:29.420292 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:29.421361 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:29.421600 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:29.421716 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:29.421990 (+ 274us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 15:03:29.422095 (+ 105us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 15:03:29.422173 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:29.422413 (+ 240us) server_negotiation.cc:299] Negotiation successful
0811 15:03:29.422476 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 15:03:29.449705 22386 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51122:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 15:03:29.449906 22386 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51122:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 15:03:29.452203 22386 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ba30c716efa142439fa243bd54345453: Sending DeleteTablet for 3 replicas of tablet 3e2e29f1d4f342f48100eca5661b3ccf
I20260811 15:03:29.452875 22861 tablet_service.cc:1514] Processing DeleteTablet for tablet 3e2e29f1d4f342f48100eca5661b3ccf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:03:29 UTC) from {username='kudu', principal='kudu/127.19.236.126@KRBTEST.COM'} at 127.0.0.1:42474
I20260811 15:03:29.452858 22709 tablet_service.cc:1514] Processing DeleteTablet for tablet 3e2e29f1d4f342f48100eca5661b3ccf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:03:29 UTC) from {username='kudu', principal='kudu/127.19.236.126@KRBTEST.COM'} at 127.0.0.1:55254
I20260811 15:03:29.453054 23069 tablet_replica.cc:330] T 3e2e29f1d4f342f48100eca5661b3ccf P 33f97806ad7344a5b90f7747093f0d39: stopping tablet replica
I20260811 15:03:29.453130 23071 tablet_replica.cc:330] T 3e2e29f1d4f342f48100eca5661b3ccf P bbeacbb144744a28882b0f355a510bc1: stopping tablet replica
I20260811 15:03:29.453169 23069 raft_consensus.cc:2229] T 3e2e29f1d4f342f48100eca5661b3ccf P 33f97806ad7344a5b90f7747093f0d39 [term 1 LEADER]: Raft consensus shutting down.
I20260811 15:03:29.453261 23071 raft_consensus.cc:2229] T 3e2e29f1d4f342f48100eca5661b3ccf P bbeacbb144744a28882b0f355a510bc1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 15:03:29.453378 23071 raft_consensus.cc:2258] T 3e2e29f1d4f342f48100eca5661b3ccf P bbeacbb144744a28882b0f355a510bc1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:03:29.453469 23069 raft_consensus.cc:2258] T 3e2e29f1d4f342f48100eca5661b3ccf P 33f97806ad7344a5b90f7747093f0d39 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:03:29.453855 22386 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51122:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 15:03:29.454272 22386 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 15:03:29.454517 23071 ts_tablet_manager.cc:1905] T 3e2e29f1d4f342f48100eca5661b3ccf P bbeacbb144744a28882b0f355a510bc1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 15:03:29.455152 22547 tablet_service.cc:1514] Processing DeleteTablet for tablet 3e2e29f1d4f342f48100eca5661b3ccf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:03:29 UTC) from {username='kudu', principal='kudu/127.19.236.126@KRBTEST.COM'} at 127.0.0.1:59558
I20260811 15:03:29.457265 23070 tablet_replica.cc:330] T 3e2e29f1d4f342f48100eca5661b3ccf P b67d6353df25414d9414a7f9c0283053: stopping tablet replica
I20260811 15:03:29.457404 23070 raft_consensus.cc:2229] T 3e2e29f1d4f342f48100eca5661b3ccf P b67d6353df25414d9414a7f9c0283053 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 15:03:29.457527 23070 raft_consensus.cc:2258] T 3e2e29f1d4f342f48100eca5661b3ccf P b67d6353df25414d9414a7f9c0283053 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:03:29.458559 23070 ts_tablet_manager.cc:1905] T 3e2e29f1d4f342f48100eca5661b3ccf P b67d6353df25414d9414a7f9c0283053: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 15:03:29.458573 23069 ts_tablet_manager.cc:1905] T 3e2e29f1d4f342f48100eca5661b3ccf P 33f97806ad7344a5b90f7747093f0d39: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 15:03:29.461166 23069 ts_tablet_manager.cc:1918] T 3e2e29f1d4f342f48100eca5661b3ccf P 33f97806ad7344a5b90f7747093f0d39: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 15:03:29.461169 23070 ts_tablet_manager.cc:1918] T 3e2e29f1d4f342f48100eca5661b3ccf P b67d6353df25414d9414a7f9c0283053: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 15:03:29.461238 23070 log.cc:1196] T 3e2e29f1d4f342f48100eca5661b3ccf P b67d6353df25414d9414a7f9c0283053: Deleting WAL directory at /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/minicluster-data/ts-0/wal/wals/3e2e29f1d4f342f48100eca5661b3ccf
I20260811 15:03:29.461238 23069 log.cc:1196] T 3e2e29f1d4f342f48100eca5661b3ccf P 33f97806ad7344a5b90f7747093f0d39: Deleting WAL directory at /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/minicluster-data/ts-1/wal/wals/3e2e29f1d4f342f48100eca5661b3ccf
I20260811 15:03:29.461529 23070 ts_tablet_manager.cc:1939] T 3e2e29f1d4f342f48100eca5661b3ccf P b67d6353df25414d9414a7f9c0283053: Deleting consensus metadata
I20260811 15:03:29.461529 23069 ts_tablet_manager.cc:1939] T 3e2e29f1d4f342f48100eca5661b3ccf P 33f97806ad7344a5b90f7747093f0d39: Deleting consensus metadata
I20260811 15:03:29.462289 22370 catalog_manager.cc:4841] TS 33f97806ad7344a5b90f7747093f0d39 (127.19.236.66:35093): tablet 3e2e29f1d4f342f48100eca5661b3ccf (table test-table [id=e71e145678624dd5956f5994a93657fb]) successfully deleted
I20260811 15:03:29.462464 22370 catalog_manager.cc:4841] TS b67d6353df25414d9414a7f9c0283053 (127.19.236.65:45709): tablet 3e2e29f1d4f342f48100eca5661b3ccf (table test-table [id=e71e145678624dd5956f5994a93657fb]) successfully deleted
I20260811 15:03:29.462664 22861 tablet_service.cc:1467] Processing CreateTablet for tablet 08d34fa439744d24850e0fb5eb461d73 (DEFAULT_TABLE table=test-table [id=4b2eee06829c4cc49d9ab70453e36680]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:03:29.462935 22861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 08d34fa439744d24850e0fb5eb461d73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:03:29.463011 22709 tablet_service.cc:1467] Processing CreateTablet for tablet 08d34fa439744d24850e0fb5eb461d73 (DEFAULT_TABLE table=test-table [id=4b2eee06829c4cc49d9ab70453e36680]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:03:29.463232 22709 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 08d34fa439744d24850e0fb5eb461d73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:03:29.465335 23085 tablet_bootstrap.cc:492] T 08d34fa439744d24850e0fb5eb461d73 P bbeacbb144744a28882b0f355a510bc1: Bootstrap starting.
I20260811 15:03:29.465410 23083 tablet_bootstrap.cc:492] T 08d34fa439744d24850e0fb5eb461d73 P 33f97806ad7344a5b90f7747093f0d39: Bootstrap starting.
I20260811 15:03:29.465932 22547 tablet_service.cc:1467] Processing CreateTablet for tablet 08d34fa439744d24850e0fb5eb461d73 (DEFAULT_TABLE table=test-table [id=4b2eee06829c4cc49d9ab70453e36680]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:03:29.466187 22547 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 08d34fa439744d24850e0fb5eb461d73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:03:29.466212 23085 tablet_bootstrap.cc:654] T 08d34fa439744d24850e0fb5eb461d73 P bbeacbb144744a28882b0f355a510bc1: Neither blocks nor log segments found. Creating new log.
I20260811 15:03:29.466401 23083 tablet_bootstrap.cc:654] T 08d34fa439744d24850e0fb5eb461d73 P 33f97806ad7344a5b90f7747093f0d39: Neither blocks nor log segments found. Creating new log.
I20260811 15:03:29.467741 23083 tablet_bootstrap.cc:492] T 08d34fa439744d24850e0fb5eb461d73 P 33f97806ad7344a5b90f7747093f0d39: No bootstrap required, opened a new log
I20260811 15:03:29.467821 23083 ts_tablet_manager.cc:1397] T 08d34fa439744d24850e0fb5eb461d73 P 33f97806ad7344a5b90f7747093f0d39: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 15:03:29.468263 23083 raft_consensus.cc:348] T 08d34fa439744d24850e0fb5eb461d73 P 33f97806ad7344a5b90f7747093f0d39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b67d6353df25414d9414a7f9c0283053" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 45709 } } peers { permanent_uuid: "33f97806ad7344a5b90f7747093f0d39" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35093 } } peers { permanent_uuid: "bbeacbb144744a28882b0f355a510bc1" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37315 } }
I20260811 15:03:29.468343 23071 ts_tablet_manager.cc:1918] T 3e2e29f1d4f342f48100eca5661b3ccf P bbeacbb144744a28882b0f355a510bc1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 15:03:29.468372 23083 raft_consensus.cc:374] T 08d34fa439744d24850e0fb5eb461d73 P 33f97806ad7344a5b90f7747093f0d39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:03:29.468406 23083 raft_consensus.cc:729] T 08d34fa439744d24850e0fb5eb461d73 P 33f97806ad7344a5b90f7747093f0d39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33f97806ad7344a5b90f7747093f0d39, State: Initialized, Role: FOLLOWER
I20260811 15:03:29.468423 23071 log.cc:1196] T 3e2e29f1d4f342f48100eca5661b3ccf P bbeacbb144744a28882b0f355a510bc1: Deleting WAL directory at /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/minicluster-data/ts-2/wal/wals/3e2e29f1d4f342f48100eca5661b3ccf
I20260811 15:03:29.468528 23083 consensus_queue.cc:260] T 08d34fa439744d24850e0fb5eb461d73 P 33f97806ad7344a5b90f7747093f0d39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b67d6353df25414d9414a7f9c0283053" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 45709 } } peers { permanent_uuid: "33f97806ad7344a5b90f7747093f0d39" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35093 } } peers { permanent_uuid: "bbeacbb144744a28882b0f355a510bc1" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37315 } }
I20260811 15:03:29.468727 23084 tablet_bootstrap.cc:492] T 08d34fa439744d24850e0fb5eb461d73 P b67d6353df25414d9414a7f9c0283053: Bootstrap starting.
I20260811 15:03:29.468820 23083 ts_tablet_manager.cc:1428] T 08d34fa439744d24850e0fb5eb461d73 P 33f97806ad7344a5b90f7747093f0d39: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 15:03:29.469676 23084 tablet_bootstrap.cc:654] T 08d34fa439744d24850e0fb5eb461d73 P b67d6353df25414d9414a7f9c0283053: Neither blocks nor log segments found. Creating new log.
I20260811 15:03:29.471364 23084 tablet_bootstrap.cc:492] T 08d34fa439744d24850e0fb5eb461d73 P b67d6353df25414d9414a7f9c0283053: No bootstrap required, opened a new log
I20260811 15:03:29.471467 23084 ts_tablet_manager.cc:1397] T 08d34fa439744d24850e0fb5eb461d73 P b67d6353df25414d9414a7f9c0283053: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 15:03:29.471899 23084 raft_consensus.cc:348] T 08d34fa439744d24850e0fb5eb461d73 P b67d6353df25414d9414a7f9c0283053 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b67d6353df25414d9414a7f9c0283053" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 45709 } } peers { permanent_uuid: "33f97806ad7344a5b90f7747093f0d39" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35093 } } peers { permanent_uuid: "bbeacbb144744a28882b0f355a510bc1" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37315 } }
I20260811 15:03:29.472021 23084 raft_consensus.cc:374] T 08d34fa439744d24850e0fb5eb461d73 P b67d6353df25414d9414a7f9c0283053 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:03:29.472044 23084 raft_consensus.cc:729] T 08d34fa439744d24850e0fb5eb461d73 P b67d6353df25414d9414a7f9c0283053 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b67d6353df25414d9414a7f9c0283053, State: Initialized, Role: FOLLOWER
I20260811 15:03:29.472195 23084 consensus_queue.cc:260] T 08d34fa439744d24850e0fb5eb461d73 P b67d6353df25414d9414a7f9c0283053 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b67d6353df25414d9414a7f9c0283053" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 45709 } } peers { permanent_uuid: "33f97806ad7344a5b90f7747093f0d39" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35093 } } peers { permanent_uuid: "bbeacbb144744a28882b0f355a510bc1" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37315 } }
I20260811 15:03:29.472509 23084 ts_tablet_manager.cc:1428] T 08d34fa439744d24850e0fb5eb461d73 P b67d6353df25414d9414a7f9c0283053: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 15:03:29.472872 23071 ts_tablet_manager.cc:1939] T 3e2e29f1d4f342f48100eca5661b3ccf P bbeacbb144744a28882b0f355a510bc1: Deleting consensus metadata
I20260811 15:03:29.473620 22372 catalog_manager.cc:4841] TS bbeacbb144744a28882b0f355a510bc1 (127.19.236.67:37315): tablet 3e2e29f1d4f342f48100eca5661b3ccf (table test-table [id=e71e145678624dd5956f5994a93657fb]) successfully deleted
I20260811 15:03:29.474324 23085 tablet_bootstrap.cc:492] T 08d34fa439744d24850e0fb5eb461d73 P bbeacbb144744a28882b0f355a510bc1: No bootstrap required, opened a new log
I20260811 15:03:29.474442 23085 ts_tablet_manager.cc:1397] T 08d34fa439744d24850e0fb5eb461d73 P bbeacbb144744a28882b0f355a510bc1: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.002s
I20260811 15:03:29.474911 23085 raft_consensus.cc:348] T 08d34fa439744d24850e0fb5eb461d73 P bbeacbb144744a28882b0f355a510bc1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b67d6353df25414d9414a7f9c0283053" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 45709 } } peers { permanent_uuid: "33f97806ad7344a5b90f7747093f0d39" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35093 } } peers { permanent_uuid: "bbeacbb144744a28882b0f355a510bc1" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37315 } }
I20260811 15:03:29.475047 23085 raft_consensus.cc:374] T 08d34fa439744d24850e0fb5eb461d73 P bbeacbb144744a28882b0f355a510bc1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:03:29.475095 23085 raft_consensus.cc:729] T 08d34fa439744d24850e0fb5eb461d73 P bbeacbb144744a28882b0f355a510bc1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbeacbb144744a28882b0f355a510bc1, State: Initialized, Role: FOLLOWER
I20260811 15:03:29.475239 23085 consensus_queue.cc:260] T 08d34fa439744d24850e0fb5eb461d73 P bbeacbb144744a28882b0f355a510bc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b67d6353df25414d9414a7f9c0283053" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 45709 } } peers { permanent_uuid: "33f97806ad7344a5b90f7747093f0d39" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35093 } } peers { permanent_uuid: "bbeacbb144744a28882b0f355a510bc1" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37315 } }
I20260811 15:03:29.475567 23085 ts_tablet_manager.cc:1428] T 08d34fa439744d24850e0fb5eb461d73 P bbeacbb144744a28882b0f355a510bc1: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260811 15:03:29.865296 23042 raft_consensus.cc:482] T 08d34fa439744d24850e0fb5eb461d73 P b67d6353df25414d9414a7f9c0283053 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 15:03:29.865446 23042 raft_consensus.cc:504] T 08d34fa439744d24850e0fb5eb461d73 P b67d6353df25414d9414a7f9c0283053 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b67d6353df25414d9414a7f9c0283053" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 45709 } } peers { permanent_uuid: "33f97806ad7344a5b90f7747093f0d39" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35093 } } peers { permanent_uuid: "bbeacbb144744a28882b0f355a510bc1" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37315 } }
I20260811 15:03:29.865962 23042 leader_election.cc:288] T 08d34fa439744d24850e0fb5eb461d73 P b67d6353df25414d9414a7f9c0283053 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33f97806ad7344a5b90f7747093f0d39 (127.19.236.66:35093), bbeacbb144744a28882b0f355a510bc1 (127.19.236.67:37315)
I20260811 15:03:29.866509 22732 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08d34fa439744d24850e0fb5eb461d73" candidate_uuid: "b67d6353df25414d9414a7f9c0283053" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33f97806ad7344a5b90f7747093f0d39" is_pre_election: true
I20260811 15:03:29.866539 22892 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08d34fa439744d24850e0fb5eb461d73" candidate_uuid: "b67d6353df25414d9414a7f9c0283053" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbeacbb144744a28882b0f355a510bc1" is_pre_election: true
I20260811 15:03:29.866647 22732 raft_consensus.cc:2454] T 08d34fa439744d24850e0fb5eb461d73 P 33f97806ad7344a5b90f7747093f0d39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b67d6353df25414d9414a7f9c0283053 in term 0.
I20260811 15:03:29.866761 22892 raft_consensus.cc:2454] T 08d34fa439744d24850e0fb5eb461d73 P bbeacbb144744a28882b0f355a510bc1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b67d6353df25414d9414a7f9c0283053 in term 0.
I20260811 15:03:29.867045 22494 leader_election.cc:302] T 08d34fa439744d24850e0fb5eb461d73 P b67d6353df25414d9414a7f9c0283053 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33f97806ad7344a5b90f7747093f0d39, b67d6353df25414d9414a7f9c0283053; no voters:
I20260811 15:03:29.867218 23042 raft_consensus.cc:2781] T 08d34fa439744d24850e0fb5eb461d73 P b67d6353df25414d9414a7f9c0283053 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 15:03:29.867283 23042 raft_consensus.cc:482] T 08d34fa439744d24850e0fb5eb461d73 P b67d6353df25414d9414a7f9c0283053 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 15:03:29.867324 23042 raft_consensus.cc:3037] T 08d34fa439744d24850e0fb5eb461d73 P b67d6353df25414d9414a7f9c0283053 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:03:29.868430 23042 raft_consensus.cc:504] T 08d34fa439744d24850e0fb5eb461d73 P b67d6353df25414d9414a7f9c0283053 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b67d6353df25414d9414a7f9c0283053" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 45709 } } peers { permanent_uuid: "33f97806ad7344a5b90f7747093f0d39" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35093 } } peers { permanent_uuid: "bbeacbb144744a28882b0f355a510bc1" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37315 } }
I20260811 15:03:29.868856 23042 leader_election.cc:288] T 08d34fa439744d24850e0fb5eb461d73 P b67d6353df25414d9414a7f9c0283053 [CANDIDATE]: Term 1 election: Requested vote from peers 33f97806ad7344a5b90f7747093f0d39 (127.19.236.66:35093), bbeacbb144744a28882b0f355a510bc1 (127.19.236.67:37315)
I20260811 15:03:29.869221 22732 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08d34fa439744d24850e0fb5eb461d73" candidate_uuid: "b67d6353df25414d9414a7f9c0283053" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33f97806ad7344a5b90f7747093f0d39"
I20260811 15:03:29.869360 22732 raft_consensus.cc:3037] T 08d34fa439744d24850e0fb5eb461d73 P 33f97806ad7344a5b90f7747093f0d39 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:03:29.869481 22892 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08d34fa439744d24850e0fb5eb461d73" candidate_uuid: "b67d6353df25414d9414a7f9c0283053" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbeacbb144744a28882b0f355a510bc1"
I20260811 15:03:29.869642 22892 raft_consensus.cc:3037] T 08d34fa439744d24850e0fb5eb461d73 P bbeacbb144744a28882b0f355a510bc1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:03:29.870374 22732 raft_consensus.cc:2454] T 08d34fa439744d24850e0fb5eb461d73 P 33f97806ad7344a5b90f7747093f0d39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b67d6353df25414d9414a7f9c0283053 in term 1.
I20260811 15:03:29.870647 22892 raft_consensus.cc:2454] T 08d34fa439744d24850e0fb5eb461d73 P bbeacbb144744a28882b0f355a510bc1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b67d6353df25414d9414a7f9c0283053 in term 1.
I20260811 15:03:29.870739 22494 leader_election.cc:302] T 08d34fa439744d24850e0fb5eb461d73 P b67d6353df25414d9414a7f9c0283053 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33f97806ad7344a5b90f7747093f0d39, b67d6353df25414d9414a7f9c0283053; no voters:
I20260811 15:03:29.870971 23042 raft_consensus.cc:2781] T 08d34fa439744d24850e0fb5eb461d73 P b67d6353df25414d9414a7f9c0283053 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:03:29.871090 23042 raft_consensus.cc:686] T 08d34fa439744d24850e0fb5eb461d73 P b67d6353df25414d9414a7f9c0283053 [term 1 LEADER]: Becoming Leader. State: Replica: b67d6353df25414d9414a7f9c0283053, State: Running, Role: LEADER
I20260811 15:03:29.871248 23042 consensus_queue.cc:237] T 08d34fa439744d24850e0fb5eb461d73 P b67d6353df25414d9414a7f9c0283053 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b67d6353df25414d9414a7f9c0283053" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 45709 } } peers { permanent_uuid: "33f97806ad7344a5b90f7747093f0d39" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35093 } } peers { permanent_uuid: "bbeacbb144744a28882b0f355a510bc1" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37315 } }
I20260811 15:03:29.873298 22386 catalog_manager.cc:5495] T 08d34fa439744d24850e0fb5eb461d73 P b67d6353df25414d9414a7f9c0283053 reported cstate change: term changed from 0 to 1, leader changed from <none> to b67d6353df25414d9414a7f9c0283053 (127.19.236.65). New cstate: current_term: 1 leader_uuid: "b67d6353df25414d9414a7f9c0283053" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b67d6353df25414d9414a7f9c0283053" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 45709 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "33f97806ad7344a5b90f7747093f0d39" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bbeacbb144744a28882b0f355a510bc1" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37315 } health_report { overall_health: UNKNOWN } } }
I20260811 15:03:29.927656 23116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:29.924244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59592 (local address 127.19.236.65:45709)
0811 15:03:29.924497 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:29.924502 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:29.924515 (+ 13us) server_negotiation.cc:407] Connection header received
0811 15:03:29.924668 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:29.924672 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:29.924720 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:29.924814 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 15:03:29.925076 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:29.925613 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:29.926485 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:29.926745 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:29.926855 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:29.927127 (+ 272us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 15:03:29.927211 (+ 84us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 15:03:29.927292 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:29.927385 (+ 93us) server_negotiation.cc:299] Negotiation successful
0811 15:03:29.927443 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":166,"thread_start_us":81,"threads_started":1}
I20260811 15:03:29.934919 22732 raft_consensus.cc:1261] T 08d34fa439744d24850e0fb5eb461d73 P 33f97806ad7344a5b90f7747093f0d39 [term 1 FOLLOWER]: Refusing update from remote peer b67d6353df25414d9414a7f9c0283053: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:03:29.934954 22892 raft_consensus.cc:1261] T 08d34fa439744d24850e0fb5eb461d73 P bbeacbb144744a28882b0f355a510bc1 [term 1 FOLLOWER]: Refusing update from remote peer b67d6353df25414d9414a7f9c0283053: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:03:29.935384 23045 consensus_queue.cc:1035] T 08d34fa439744d24850e0fb5eb461d73 P b67d6353df25414d9414a7f9c0283053 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33f97806ad7344a5b90f7747093f0d39" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:03:29.935590 23042 consensus_queue.cc:1035] T 08d34fa439744d24850e0fb5eb461d73 P b67d6353df25414d9414a7f9c0283053 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbeacbb144744a28882b0f355a510bc1" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 15:03:29.949005 23043 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260811 15:03:31.508679 22385 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51122:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 15:03:31.508843 22385 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51122:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 15:03:31.511366 22385 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ba30c716efa142439fa243bd54345453: Sending DeleteTablet for 3 replicas of tablet 08d34fa439744d24850e0fb5eb461d73
I20260811 15:03:31.511976 22547 tablet_service.cc:1514] Processing DeleteTablet for tablet 08d34fa439744d24850e0fb5eb461d73 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:03:31 UTC) from {username='kudu', principal='kudu/127.19.236.126@KRBTEST.COM'} at 127.0.0.1:59558
I20260811 15:03:31.512045 22861 tablet_service.cc:1514] Processing DeleteTablet for tablet 08d34fa439744d24850e0fb5eb461d73 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:03:31 UTC) from {username='kudu', principal='kudu/127.19.236.126@KRBTEST.COM'} at 127.0.0.1:42474
I20260811 15:03:31.512332 22709 tablet_service.cc:1514] Processing DeleteTablet for tablet 08d34fa439744d24850e0fb5eb461d73 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:03:31 UTC) from {username='kudu', principal='kudu/127.19.236.126@KRBTEST.COM'} at 127.0.0.1:55254
I20260811 15:03:31.512401 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 22475
I20260811 15:03:31.512360 23141 tablet_replica.cc:330] T 08d34fa439744d24850e0fb5eb461d73 P b67d6353df25414d9414a7f9c0283053: stopping tablet replica
I20260811 15:03:31.512445 23142 tablet_replica.cc:330] T 08d34fa439744d24850e0fb5eb461d73 P bbeacbb144744a28882b0f355a510bc1: stopping tablet replica
I20260811 15:03:31.513268 23142 raft_consensus.cc:2229] T 08d34fa439744d24850e0fb5eb461d73 P bbeacbb144744a28882b0f355a510bc1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 15:03:31.513429 23142 raft_consensus.cc:2258] T 08d34fa439744d24850e0fb5eb461d73 P bbeacbb144744a28882b0f355a510bc1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:03:31.515363 23142 ts_tablet_manager.cc:1905] T 08d34fa439744d24850e0fb5eb461d73 P bbeacbb144744a28882b0f355a510bc1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 15:03:31.518071 23142 ts_tablet_manager.cc:1918] T 08d34fa439744d24850e0fb5eb461d73 P bbeacbb144744a28882b0f355a510bc1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 15:03:31.518169 23142 log.cc:1196] T 08d34fa439744d24850e0fb5eb461d73 P bbeacbb144744a28882b0f355a510bc1: Deleting WAL directory at /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/minicluster-data/ts-2/wal/wals/08d34fa439744d24850e0fb5eb461d73
I20260811 15:03:31.518450 23142 ts_tablet_manager.cc:1939] T 08d34fa439744d24850e0fb5eb461d73 P bbeacbb144744a28882b0f355a510bc1: Deleting consensus metadata
I20260811 15:03:31.519186 23143 tablet_replica.cc:330] T 08d34fa439744d24850e0fb5eb461d73 P 33f97806ad7344a5b90f7747093f0d39: stopping tablet replica
I20260811 15:03:31.519187 22372 catalog_manager.cc:4841] TS bbeacbb144744a28882b0f355a510bc1 (127.19.236.67:37315): tablet 08d34fa439744d24850e0fb5eb461d73 (table test-table [id=4b2eee06829c4cc49d9ab70453e36680]) successfully deleted
I20260811 15:03:31.519346 23143 raft_consensus.cc:2229] T 08d34fa439744d24850e0fb5eb461d73 P 33f97806ad7344a5b90f7747093f0d39 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 15:03:31.519498 23143 raft_consensus.cc:2258] T 08d34fa439744d24850e0fb5eb461d73 P 33f97806ad7344a5b90f7747093f0d39 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:03:31.520103 23143 ts_tablet_manager.cc:1905] T 08d34fa439744d24850e0fb5eb461d73 P 33f97806ad7344a5b90f7747093f0d39: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 15:03:31.522277 23143 ts_tablet_manager.cc:1918] T 08d34fa439744d24850e0fb5eb461d73 P 33f97806ad7344a5b90f7747093f0d39: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 15:03:31.522377 23143 log.cc:1196] T 08d34fa439744d24850e0fb5eb461d73 P 33f97806ad7344a5b90f7747093f0d39: Deleting WAL directory at /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786460596631409-20401-0/minicluster-data/ts-1/wal/wals/08d34fa439744d24850e0fb5eb461d73
I20260811 15:03:31.522667 23143 ts_tablet_manager.cc:1939] T 08d34fa439744d24850e0fb5eb461d73 P 33f97806ad7344a5b90f7747093f0d39: Deleting consensus metadata
I20260811 15:03:31.523396 22370 catalog_manager.cc:4841] TS 33f97806ad7344a5b90f7747093f0d39 (127.19.236.66:35093): tablet 08d34fa439744d24850e0fb5eb461d73 (table test-table [id=4b2eee06829c4cc49d9ab70453e36680]) successfully deleted
W20260811 15:03:31.524150 22370 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.19.236.65:45709 (error 108)
I20260811 15:03:31.524384 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 22636
I20260811 15:03:31.526175 23145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:31.525612 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.65:45709 (local address 127.0.0.1:59608)
0811 15:03:31.525939 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:31.526039 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.65:45709: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":102,"threads_started":1}
W20260811 15:03:31.526336 22370 catalog_manager.cc:4584] TS b67d6353df25414d9414a7f9c0283053 (127.19.236.65:45709): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 08d34fa439744d24850e0fb5eb461d73: Network error: Client connection negotiation failed: client connection to 127.19.236.65:45709: connect: Connection refused (error 111)
I20260811 15:03:31.532712 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 22797
I20260811 15:03:31.542574 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 22352
2026-08-11T15:03:31Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (6866 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 15:03:31 dist-test-slave-8n49 krb5kdc[23148](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 15:03:31 dist-test-slave-8n49 krb5kdc[23148](info): set up 2 sockets
Aug 11 15:03:31 dist-test-slave-8n49 krb5kdc[23148](info): commencing operation
krb5kdc: starting...
W20260811 15:03:32.660760 20401 mini_kdc.cc:121] Time spent starting KDC: real 1.092s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/krb5kdc/test-user.keytab.
Aug 11 15:03:32 dist-test-slave-8n49 krb5kdc[23148](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460612, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T15:03:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T15:03:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.236.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.236.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.236.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab.
Entry for principal kudu/127.19.236.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab.
I20260811 15:03:32.788045 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:40251
--webserver_interface=127.19.236.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab
--principal=kudu/127.19.236.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:40969
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.236.126:40251
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:03:32.904846 23161 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:03:32.905171 23161 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:03:32.905252 23161 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:03:32.909444 23161 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:03:32.909536 23161 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:03:32.909575 23161 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:03:32.909636 23161 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:03:32.909672 23161 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:03:32.915337 23161 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:40969
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.236.126:40251
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab
--principal=kudu/127.19.236.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:40251
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.236.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23161
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:03:32.916517 23161 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:03:32.917681 23161 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 15:03:32.926892 23161 server_base.cc:1034] running on GCE node
W20260811 15:03:32.926822 23166 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:32.926877 23167 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:32.926824 23169 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:32.927779 23161 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:03:32.929021 23161 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:03:32.930200 23161 hybrid_clock.cc:648] HybridClock initialized: now 1786460612930167 us; error 46 us; skew 500 ppm
Aug 11 15:03:32 dist-test-slave-8n49 krb5kdc[23148](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460612, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:03:32.933142 23161 init.cc:377] Logged in from keytab as kudu/127.19.236.126@KRBTEST.COM (short username kudu)
I20260811 15:03:32.934039 23161 webserver.cc:460] Webserver started at http://127.19.236.126:44169/ using document root <none> and password file <none>
I20260811 15:03:32.934697 23161 fs_manager.cc:359] Metadata directory not provided
I20260811 15:03:32.934790 23161 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:03:32.935037 23161 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:03:32.937217 23161 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/minicluster-data/master-0/data/instance:
uuid: "e31d75cdddeb477895939d52848c5024"
format_stamp: "Formatted at 2026-08-11 15:03:32 on dist-test-slave-8n49"
server_key: "543c72fb7b47bba70475aef8d534231c"
server_key_iv: "22f5a19a86b0e9f2a08263516960213c"
server_key_version: "encryptionkey@0"
I20260811 15:03:32.937806 23161 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/minicluster-data/master-0/wal/instance:
uuid: "e31d75cdddeb477895939d52848c5024"
format_stamp: "Formatted at 2026-08-11 15:03:32 on dist-test-slave-8n49"
server_key: "543c72fb7b47bba70475aef8d534231c"
server_key_iv: "22f5a19a86b0e9f2a08263516960213c"
server_key_version: "encryptionkey@0"
I20260811 15:03:32.941634 23161 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260811 15:03:32.944061 23176 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:32.945343 23161 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260811 15:03:32.945490 23161 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/minicluster-data/master-0/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/minicluster-data/master-0/wal
uuid: "e31d75cdddeb477895939d52848c5024"
format_stamp: "Formatted at 2026-08-11 15:03:32 on dist-test-slave-8n49"
server_key: "543c72fb7b47bba70475aef8d534231c"
server_key_iv: "22f5a19a86b0e9f2a08263516960213c"
server_key_version: "encryptionkey@0"
I20260811 15:03:32.945611 23161 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:03:32.978297 23161 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:03:32.981591 23161 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:03:32.981825 23161 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:03:32.989509 23161 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.126:40251
I20260811 15:03:32.989534 23239 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.126:40251 every 8 connection(s)
I20260811 15:03:32.990549 23161 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
I20260811 15:03:32.993544 23240 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:03:32.995642 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 23161
I20260811 15:03:32.995734 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/minicluster-data/master-0/wal/instance
I20260811 15:03:32.996013 20401 external_mini_cluster.cc:1428] Setting key 7e1658d1516d918d2e5f84d2ff1e0936
I20260811 15:03:32.999686 23240 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e31d75cdddeb477895939d52848c5024: Bootstrap starting.
I20260811 15:03:33.002058 23240 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e31d75cdddeb477895939d52848c5024: Neither blocks nor log segments found. Creating new log.
I20260811 15:03:33.002959 23240 log.cc:824] T 00000000000000000000000000000000 P e31d75cdddeb477895939d52848c5024: Log is configured to *not* fsync() on all Append() calls
Aug 11 15:03:33 dist-test-slave-8n49 krb5kdc[23148](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460612, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
I20260811 15:03:33.005206 23240 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e31d75cdddeb477895939d52848c5024: No bootstrap required, opened a new log
I20260811 15:03:33.008505 23240 raft_consensus.cc:348] T 00000000000000000000000000000000 P e31d75cdddeb477895939d52848c5024 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e31d75cdddeb477895939d52848c5024" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 40251 } }
I20260811 15:03:33.008849 23240 raft_consensus.cc:374] T 00000000000000000000000000000000 P e31d75cdddeb477895939d52848c5024 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:03:33.008926 23240 raft_consensus.cc:729] T 00000000000000000000000000000000 P e31d75cdddeb477895939d52848c5024 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e31d75cdddeb477895939d52848c5024, State: Initialized, Role: FOLLOWER
I20260811 15:03:33.009436 23240 consensus_queue.cc:260] T 00000000000000000000000000000000 P e31d75cdddeb477895939d52848c5024 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e31d75cdddeb477895939d52848c5024" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 40251 } }
I20260811 15:03:33.009661 23240 raft_consensus.cc:388] T 00000000000000000000000000000000 P e31d75cdddeb477895939d52848c5024 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 15:03:33.009784 23240 raft_consensus.cc:482] T 00000000000000000000000000000000 P e31d75cdddeb477895939d52848c5024 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 15:03:33.009915 23240 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e31d75cdddeb477895939d52848c5024 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:03:33.010969 23240 raft_consensus.cc:504] T 00000000000000000000000000000000 P e31d75cdddeb477895939d52848c5024 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e31d75cdddeb477895939d52848c5024" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 40251 } }
I20260811 15:03:33.011278 23243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:32.997534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52422 (local address 127.19.236.126:40251)
0811 15:03:32.998023 (+ 489us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:32.998038 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:32.998076 (+ 38us) server_negotiation.cc:407] Connection header received
0811 15:03:32.998803 (+ 727us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:32.998822 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:32.999169 (+ 347us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:32.999515 (+ 346us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:33.000366 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:33.001474 (+ 1108us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:33.002383 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:33.002861 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:33.003043 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:33.005655 (+ 2612us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:33.005660 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:33.005674 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:33.005701 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:33.008081 (+ 2380us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:33.008623 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:33.008628 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:33.008634 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:33.008751 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:33.009105 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:33.009111 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:33.009112 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:33.009589 (+ 477us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:33.009809 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:33.010114 (+ 305us) server_negotiation.cc:299] Negotiation successful
0811 15:03:33.010450 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":333,"thread_start_us":132,"threads_started":1}
I20260811 15:03:33.011328 23240 leader_election.cc:302] T 00000000000000000000000000000000 P e31d75cdddeb477895939d52848c5024 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e31d75cdddeb477895939d52848c5024; no voters:
I20260811 15:03:33.011705 23240 leader_election.cc:288] T 00000000000000000000000000000000 P e31d75cdddeb477895939d52848c5024 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 15:03:33.011797 23245 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e31d75cdddeb477895939d52848c5024 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:03:33.012064 23245 raft_consensus.cc:686] T 00000000000000000000000000000000 P e31d75cdddeb477895939d52848c5024 [term 1 LEADER]: Becoming Leader. State: Replica: e31d75cdddeb477895939d52848c5024, State: Running, Role: LEADER
I20260811 15:03:33.013144 23240 sys_catalog.cc:564] T 00000000000000000000000000000000 P e31d75cdddeb477895939d52848c5024 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:03:33.013535 23245 consensus_queue.cc:237] T 00000000000000000000000000000000 P e31d75cdddeb477895939d52848c5024 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e31d75cdddeb477895939d52848c5024" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 40251 } }
I20260811 15:03:33.015569 23246 sys_catalog.cc:455] T 00000000000000000000000000000000 P e31d75cdddeb477895939d52848c5024 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e31d75cdddeb477895939d52848c5024. Latest consensus state: current_term: 1 leader_uuid: "e31d75cdddeb477895939d52848c5024" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e31d75cdddeb477895939d52848c5024" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 40251 } } }
I20260811 15:03:33.015854 23246 sys_catalog.cc:458] T 00000000000000000000000000000000 P e31d75cdddeb477895939d52848c5024 [sys.catalog]: This master's current role is: LEADER
I20260811 15:03:33.015566 23247 sys_catalog.cc:455] T 00000000000000000000000000000000 P e31d75cdddeb477895939d52848c5024 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e31d75cdddeb477895939d52848c5024" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e31d75cdddeb477895939d52848c5024" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 40251 } } }
I20260811 15:03:33.016072 23247 sys_catalog.cc:458] T 00000000000000000000000000000000 P e31d75cdddeb477895939d52848c5024 [sys.catalog]: This master's current role is: LEADER
W20260811 15:03:33.018842 23259 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e31d75cdddeb477895939d52848c5024: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 15:03:33.018911 23259 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 15:03:33.018977 23260 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:03:33.019771 23260 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:03:33.025643 23260 catalog_manager.cc:1347] Generated new cluster ID: f0906a2bf366491c842d5331fe0781d7
I20260811 15:03:33.025738 23260 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:03:33.037688 23260 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 15:03:33.038727 23260 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:03:33.054989 23260 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e31d75cdddeb477895939d52848c5024: Generated new TSK 0
I20260811 15:03:33.055800 23260 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.236.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.236.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.236.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.65.keytab.
Entry for principal kudu/127.19.236.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.65.keytab.
I20260811 15:03:33.088029 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.65:0
--local_ip_for_outbound_sockets=127.19.236.65
--webserver_interface=127.19.236.65
--webserver_port=0
--tserver_master_addrs=127.19.236.126:40251
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.65.keytab
--principal=kudu/127.19.236.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:40969
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:03:33.204861 23267 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:03:33.205118 23267 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:03:33.205193 23267 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:03:33.209223 23267 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:03:33.209291 23267 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:03:33.209393 23267 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.65
I20260811 15:03:33.215152 23267 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:40969
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.65.keytab
--principal=kudu/127.19.236.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.236.65
--webserver_port=0
--tserver_master_addrs=127.19.236.126:40251
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23267
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.65
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:03:33.216269 23267 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:03:33.217348 23267 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:03:33.227409 23275 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:33.227475 23273 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:33.227409 23272 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:33.227692 23267 server_base.cc:1034] running on GCE node
I20260811 15:03:33.228139 23267 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:03:33.228816 23267 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:03:33.229979 23267 hybrid_clock.cc:648] HybridClock initialized: now 1786460613229966 us; error 28 us; skew 500 ppm
Aug 11 15:03:33 dist-test-slave-8n49 krb5kdc[23148](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460613, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:03:33.232815 23267 init.cc:377] Logged in from keytab as kudu/127.19.236.65@KRBTEST.COM (short username kudu)
I20260811 15:03:33.233846 23267 webserver.cc:460] Webserver started at http://127.19.236.65:32833/ using document root <none> and password file <none>
I20260811 15:03:33.234437 23267 fs_manager.cc:359] Metadata directory not provided
I20260811 15:03:33.234501 23267 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:03:33.234668 23267 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:03:33.236761 23267 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-0/data/instance:
uuid: "007d9f364d754c9ba7a469b70fcaf12c"
format_stamp: "Formatted at 2026-08-11 15:03:33 on dist-test-slave-8n49"
server_key: "b4fb3999f3eb43bf6cd9ce985e34307d"
server_key_iv: "05d75d6bab5ed991d0ff58fbdc4b1927"
server_key_version: "encryptionkey@0"
I20260811 15:03:33.237285 23267 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-0/wal/instance:
uuid: "007d9f364d754c9ba7a469b70fcaf12c"
format_stamp: "Formatted at 2026-08-11 15:03:33 on dist-test-slave-8n49"
server_key: "b4fb3999f3eb43bf6cd9ce985e34307d"
server_key_iv: "05d75d6bab5ed991d0ff58fbdc4b1927"
server_key_version: "encryptionkey@0"
I20260811 15:03:33.240983 23267 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 15:03:33.243331 23284 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:33.244542 23267 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 15:03:33.244735 23267 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-0/wal
uuid: "007d9f364d754c9ba7a469b70fcaf12c"
format_stamp: "Formatted at 2026-08-11 15:03:33 on dist-test-slave-8n49"
server_key: "b4fb3999f3eb43bf6cd9ce985e34307d"
server_key_iv: "05d75d6bab5ed991d0ff58fbdc4b1927"
server_key_version: "encryptionkey@0"
I20260811 15:03:33.244848 23267 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:03:33.266229 23267 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:03:33.269299 23267 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:03:33.269501 23267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:03:33.270098 23267 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:03:33.270922 23267 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:03:33.270992 23267 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:33.271062 23267 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:03:33.271116 23267 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:33.279990 23267 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.65:44227
I20260811 15:03:33.280010 23420 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.65:44227 every 8 connection(s)
I20260811 15:03:33.280959 23267 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
I20260811 15:03:33.285164 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 23267
I20260811 15:03:33.285283 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-0/wal/instance
I20260811 15:03:33.285567 20401 external_mini_cluster.cc:1428] Setting key 9ed113b3d9c1699546f3e4b2741e1a57
Aug 11 15:03:33 dist-test-slave-8n49 krb5kdc[23148](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460613, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.65@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
I20260811 15:03:33.296416 23243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:33.282883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.65:46591 (local address 127.19.236.126:40251)
0811 15:03:33.283034 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:33.283039 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:33.283838 (+ 799us) server_negotiation.cc:407] Connection header received
0811 15:03:33.285194 (+ 1356us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:33.285197 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:33.285267 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:33.285381 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:33.286844 (+ 1463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:33.287647 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:33.288882 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:33.289280 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:33.289397 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:33.292451 (+ 3054us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:33.292458 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:33.292464 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:33.292499 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:33.294229 (+ 1730us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:33.294732 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:33.294737 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:33.294738 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:33.294838 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:33.295178 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:33.295182 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:33.295184 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:33.295459 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:33.295577 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:33.296044 (+ 467us) server_negotiation.cc:299] Negotiation successful
0811 15:03:33.296188 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
WARNING: no policy specified for kudu/127.19.236.66@KRBTEST.COM; defaulting to no policy
I20260811 15:03:33.297184 23423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:33.283224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:40251 (local address 127.19.236.65:46591)
0811 15:03:33.283679 (+ 455us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:33.283721 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:33.284969 (+ 1248us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:33.285555 (+ 586us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:33.285562 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:33.286034 (+ 472us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:33.286668 (+ 634us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:33.286687 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:33.287792 (+ 1105us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:33.287795 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:33.288734 (+ 939us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:33.288745 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:33.289579 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:33.289583 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:33.289775 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:33.290478 (+ 703us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:03:33.290498 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:33.292188 (+ 1690us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:33.294353 (+ 2165us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:33.294358 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:33.294370 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:33.294622 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:33.294937 (+ 315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:33.294940 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:33.294941 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:33.295066 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:33.295570 (+ 504us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:33.295575 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:33.295799 (+ 224us) client_negotiation.cc:769] Sending connection context
0811 15:03:33.295956 (+ 157us) client_negotiation.cc:240] Negotiation successful
0811 15:03:33.296211 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":112,"threads_started":1}
I20260811 15:03:33.298547 23421 heartbeater.cc:347] Connected to a master server at 127.19.236.126:40251
I20260811 15:03:33.298772 23421 heartbeater.cc:464] Registering TS with master...
I20260811 15:03:33.299341 23421 heartbeater.cc:511] Master 127.19.236.126:40251 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.236.66@KRBTEST.COM" created.
I20260811 15:03:33.301273 23192 ts_manager.cc:194] Registered new tserver with Master: 007d9f364d754c9ba7a469b70fcaf12c (127.19.236.65:44227)
I20260811 15:03:33.302520 23192 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.236.65@KRBTEST.COM'} at 127.19.236.65:46591
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.236.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.66.keytab.
Entry for principal kudu/127.19.236.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.66.keytab.
I20260811 15:03:33.316231 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.66:0
--local_ip_for_outbound_sockets=127.19.236.66
--webserver_interface=127.19.236.66
--webserver_port=0
--tserver_master_addrs=127.19.236.126:40251
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.66.keytab
--principal=kudu/127.19.236.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:40969
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:03:33.435218 23427 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:03:33.435509 23427 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:03:33.435582 23427 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:03:33.439615 23427 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:03:33.439700 23427 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:03:33.439795 23427 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.66
I20260811 15:03:33.445029 23427 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:40969
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.66.keytab
--principal=kudu/127.19.236.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.236.66
--webserver_port=0
--tserver_master_addrs=127.19.236.126:40251
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23427
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.66
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:03:33.446149 23427 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:03:33.447207 23427 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:03:33.457718 23434 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:33.457679 23433 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:33.457862 23427 server_base.cc:1034] running on GCE node
W20260811 15:03:33.457696 23436 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:33.458386 23427 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:03:33.459084 23427 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:03:33.460278 23427 hybrid_clock.cc:648] HybridClock initialized: now 1786460613460255 us; error 35 us; skew 500 ppm
Aug 11 15:03:33 dist-test-slave-8n49 krb5kdc[23148](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460613, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:03:33.463027 23427 init.cc:377] Logged in from keytab as kudu/127.19.236.66@KRBTEST.COM (short username kudu)
I20260811 15:03:33.463930 23427 webserver.cc:460] Webserver started at http://127.19.236.66:36015/ using document root <none> and password file <none>
I20260811 15:03:33.464512 23427 fs_manager.cc:359] Metadata directory not provided
I20260811 15:03:33.464627 23427 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:03:33.464867 23427 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:03:33.466881 23427 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-1/data/instance:
uuid: "7f427b9d77f441aa91966e62cf16d7cd"
format_stamp: "Formatted at 2026-08-11 15:03:33 on dist-test-slave-8n49"
server_key: "cff3f2483c959ad179737ab664622fb8"
server_key_iv: "bff5b66acb6a88b9895e9479463cba05"
server_key_version: "encryptionkey@0"
I20260811 15:03:33.467459 23427 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-1/wal/instance:
uuid: "7f427b9d77f441aa91966e62cf16d7cd"
format_stamp: "Formatted at 2026-08-11 15:03:33 on dist-test-slave-8n49"
server_key: "cff3f2483c959ad179737ab664622fb8"
server_key_iv: "bff5b66acb6a88b9895e9479463cba05"
server_key_version: "encryptionkey@0"
I20260811 15:03:33.471131 23427 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.006s
I20260811 15:03:33.473575 23443 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:33.474825 23427 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 15:03:33.474974 23427 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-1/wal
uuid: "7f427b9d77f441aa91966e62cf16d7cd"
format_stamp: "Formatted at 2026-08-11 15:03:33 on dist-test-slave-8n49"
server_key: "cff3f2483c959ad179737ab664622fb8"
server_key_iv: "bff5b66acb6a88b9895e9479463cba05"
server_key_version: "encryptionkey@0"
I20260811 15:03:33.475092 23427 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:03:33.492281 23427 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:03:33.495242 23427 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:03:33.495455 23427 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:03:33.496057 23427 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:03:33.496968 23427 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:03:33.497038 23427 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:33.497112 23427 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:03:33.497154 23427 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:33.506153 23427 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.66:35705
I20260811 15:03:33.506181 23573 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.66:35705 every 8 connection(s)
I20260811 15:03:33.507078 23427 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
I20260811 15:03:33.513109 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 23427
I20260811 15:03:33.513223 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-1/wal/instance
I20260811 15:03:33.513490 20401 external_mini_cluster.cc:1428] Setting key e5d9d86216bfb0fb5359509c4e480592
Aug 11 15:03:33 dist-test-slave-8n49 krb5kdc[23148](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460613, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.66@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
I20260811 15:03:33.522895 23243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:33.509004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.66:47689 (local address 127.19.236.126:40251)
0811 15:03:33.509151 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:33.509155 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:33.509941 (+ 786us) server_negotiation.cc:407] Connection header received
0811 15:03:33.511439 (+ 1498us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:33.511443 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:33.511510 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:33.511618 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:33.512838 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:33.513691 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:33.515350 (+ 1659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:33.515602 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:33.515719 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:33.518769 (+ 3050us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:33.518795 (+ 26us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:33.518801 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:33.518836 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:33.520625 (+ 1789us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:33.521149 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:33.521157 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:33.521160 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:33.521263 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:33.521619 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:33.521625 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:33.521629 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:33.521917 (+ 288us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:33.522052 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:33.522545 (+ 493us) server_negotiation.cc:299] Negotiation successful
0811 15:03:33.522700 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 15:03:33.523726 23576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:33.509333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:40251 (local address 127.19.236.66:47689)
0811 15:03:33.509790 (+ 457us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:33.509832 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:33.511227 (+ 1395us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:33.511789 (+ 562us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:33.511796 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:33.512146 (+ 350us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:33.512697 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:33.512713 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:33.513821 (+ 1108us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:33.513824 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:33.515202 (+ 1378us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:33.515235 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:33.515758 (+ 523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:33.515762 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:33.515938 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:33.516620 (+ 682us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:03:33.516647 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:33.518581 (+ 1934us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:33.520748 (+ 2167us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:33.520753 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:33.520768 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:33.521036 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:33.521376 (+ 340us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:33.521378 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:33.521379 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:33.521518 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:33.522041 (+ 523us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:33.522046 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:33.522289 (+ 243us) client_negotiation.cc:769] Sending connection context
0811 15:03:33.522464 (+ 175us) client_negotiation.cc:240] Negotiation successful
0811 15:03:33.522739 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":116,"threads_started":1}
WARNING: no policy specified for kudu/127.19.236.67@KRBTEST.COM; defaulting to no policy
I20260811 15:03:33.525101 23574 heartbeater.cc:347] Connected to a master server at 127.19.236.126:40251
I20260811 15:03:33.525380 23574 heartbeater.cc:464] Registering TS with master...
I20260811 15:03:33.525867 23574 heartbeater.cc:511] Master 127.19.236.126:40251 requested a full tablet report, sending...
I20260811 15:03:33.526973 23192 ts_manager.cc:194] Registered new tserver with Master: 7f427b9d77f441aa91966e62cf16d7cd (127.19.236.66:35705)
I20260811 15:03:33.527681 23192 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.236.66@KRBTEST.COM'} at 127.19.236.66:47689
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.236.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.236.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.67.keytab.
Entry for principal kudu/127.19.236.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.67.keytab.
I20260811 15:03:33.544126 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.67:0
--local_ip_for_outbound_sockets=127.19.236.67
--webserver_interface=127.19.236.67
--webserver_port=0
--tserver_master_addrs=127.19.236.126:40251
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.67.keytab
--principal=kudu/127.19.236.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:40969
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:03:33.659370 23579 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:03:33.659628 23579 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:03:33.659672 23579 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:03:33.663712 23579 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:03:33.663770 23579 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:03:33.663861 23579 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.67
I20260811 15:03:33.669245 23579 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:40969
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.67.keytab
--principal=kudu/127.19.236.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.236.67
--webserver_port=0
--tserver_master_addrs=127.19.236.126:40251
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23579
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.67
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:03:33.670346 23579 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:03:33.671370 23579 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:03:33.681203 23584 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:33.681252 23588 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:33.681212 23585 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:33.681602 23579 server_base.cc:1034] running on GCE node
I20260811 15:03:33.681934 23579 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:03:33.682534 23579 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:03:33.683705 23579 hybrid_clock.cc:648] HybridClock initialized: now 1786460613683675 us; error 43 us; skew 500 ppm
Aug 11 15:03:33 dist-test-slave-8n49 krb5kdc[23148](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460613, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:03:33.686520 23579 init.cc:377] Logged in from keytab as kudu/127.19.236.67@KRBTEST.COM (short username kudu)
I20260811 15:03:33.687354 23579 webserver.cc:460] Webserver started at http://127.19.236.67:42399/ using document root <none> and password file <none>
I20260811 15:03:33.687933 23579 fs_manager.cc:359] Metadata directory not provided
I20260811 15:03:33.688024 23579 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:03:33.688254 23579 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:03:33.690424 23579 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-2/data/instance:
uuid: "3f0be0fc2761470c9a10464cfeb4b08d"
format_stamp: "Formatted at 2026-08-11 15:03:33 on dist-test-slave-8n49"
server_key: "168e45065a3f791195d167bf8acac106"
server_key_iv: "9327c59e07e5da1542c3c5692a458ea1"
server_key_version: "encryptionkey@0"
I20260811 15:03:33.690997 23579 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-2/wal/instance:
uuid: "3f0be0fc2761470c9a10464cfeb4b08d"
format_stamp: "Formatted at 2026-08-11 15:03:33 on dist-test-slave-8n49"
server_key: "168e45065a3f791195d167bf8acac106"
server_key_iv: "9327c59e07e5da1542c3c5692a458ea1"
server_key_version: "encryptionkey@0"
I20260811 15:03:33.694718 23579 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260811 15:03:33.697239 23595 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:33.698560 23579 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 15:03:33.698724 23579 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-2/wal
uuid: "3f0be0fc2761470c9a10464cfeb4b08d"
format_stamp: "Formatted at 2026-08-11 15:03:33 on dist-test-slave-8n49"
server_key: "168e45065a3f791195d167bf8acac106"
server_key_iv: "9327c59e07e5da1542c3c5692a458ea1"
server_key_version: "encryptionkey@0"
I20260811 15:03:33.698843 23579 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:03:33.711776 23579 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:03:33.715293 23579 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:03:33.715492 23579 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:03:33.716146 23579 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:03:33.717053 23579 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:03:33.717123 23579 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:33.717195 23579 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:03:33.717238 23579 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:33.726286 23579 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.67:41635
I20260811 15:03:33.726311 23723 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.67:41635 every 8 connection(s)
I20260811 15:03:33.727236 23579 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
I20260811 15:03:33.731112 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 23579
I20260811 15:03:33.731226 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-2/wal/instance
I20260811 15:03:33.731554 20401 external_mini_cluster.cc:1428] Setting key 3ca46f2c7015533bbffb4d95a0e0eb2c
Aug 11 15:03:33 dist-test-slave-8n49 krb5kdc[23148](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460613, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.67@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
I20260811 15:03:33.741470 23243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:33.729086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.67:45257 (local address 127.19.236.126:40251)
0811 15:03:33.729231 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:33.729235 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:33.730070 (+ 835us) server_negotiation.cc:407] Connection header received
0811 15:03:33.731668 (+ 1598us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:33.731673 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:33.731732 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:33.731802 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:33.733416 (+ 1614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:33.734131 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:33.735363 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:33.735577 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:33.735658 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:33.738038 (+ 2380us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:33.738041 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:33.738043 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:33.738068 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:33.739538 (+ 1470us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:33.740034 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:33.740037 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:33.740038 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:33.740111 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:33.740401 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:33.740403 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:33.740405 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:33.740646 (+ 241us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:33.740757 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:33.741251 (+ 494us) server_negotiation.cc:299] Negotiation successful
0811 15:03:33.741347 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 15:03:33.742262 23726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:33.729461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:40251 (local address 127.19.236.67:45257)
0811 15:03:33.729910 (+ 449us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:33.729951 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:33.731390 (+ 1439us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:33.732012 (+ 622us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:33.732019 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:33.732593 (+ 574us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:33.733246 (+ 653us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:33.733264 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:33.734251 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:33.734254 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:33.735251 (+ 997us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:33.735261 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:33.735704 (+ 443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:33.735706 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:33.735840 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:33.736387 (+ 547us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:03:33.736403 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:33.737877 (+ 1474us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:33.739665 (+ 1788us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:33.739670 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:33.739682 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:33.739929 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:33.740191 (+ 262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:33.740193 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:33.740194 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:33.740321 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:33.740774 (+ 453us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:33.740783 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:33.741036 (+ 253us) client_negotiation.cc:769] Sending connection context
0811 15:03:33.741195 (+ 159us) client_negotiation.cc:240] Negotiation successful
0811 15:03:33.741433 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":261,"thread_start_us":110,"threads_started":1}
I20260811 15:03:33.743525 23724 heartbeater.cc:347] Connected to a master server at 127.19.236.126:40251
I20260811 15:03:33.743784 23724 heartbeater.cc:464] Registering TS with master...
I20260811 15:03:33.744374 23724 heartbeater.cc:511] Master 127.19.236.126:40251 requested a full tablet report, sending...
I20260811 15:03:33.745579 23195 ts_manager.cc:194] Registered new tserver with Master: 3f0be0fc2761470c9a10464cfeb4b08d (127.19.236.67:41635)
I20260811 15:03:33.746174 23195 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.236.67@KRBTEST.COM'} at 127.19.236.67:45257
I20260811 15:03:33.757485 20401 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260811 15:03:33.771140 23243 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:03:33.769742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52432 (local address 127.19.236.126:40251)
0811 15:03:33.769937 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:33.769941 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:33.770023 (+ 82us) server_negotiation.cc:407] Connection header received
0811 15:03:33.770138 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:33.770141 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:33.770185 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:33.770256 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:33.770993 (+ 737us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52432: BlockingRecv error: recv got EOF from 127.0.0.1:52432 (error 108)
Metrics: {"server-negotiator.queue_time_us":83}
I20260811 15:03:33.772785 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 23267
I20260811 15:03:33.782946 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 23427
I20260811 15:03:33.791649 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 23579
I20260811 15:03:33.800290 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 23161
2026-08-11T15:03:33Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (2256 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786460596631409-20401-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 15:03:33 dist-test-slave-8n49 krb5kdc[23736](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 15:03:33 dist-test-slave-8n49 krb5kdc[23736](info): set up 2 sockets
Aug 11 15:03:33 dist-test-slave-8n49 krb5kdc[23736](info): commencing operation
krb5kdc: starting...
W20260811 15:03:34.903297 20401 mini_kdc.cc:121] Time spent starting KDC: real 1.079s user 0.005s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786460596631409-20401-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786460596631409-20401-0/krb5kdc/test-user.keytab.
Aug 11 15:03:34 dist-test-slave-8n49 krb5kdc[23736](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460614, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T15:03:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T15:03:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.236.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.236.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.236.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab.
Entry for principal kudu/127.19.236.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab.
I20260811 15:03:35.032299 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786460596631409-20401-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786460596631409-20401-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786460596631409-20401-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:35093
--webserver_interface=127.19.236.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab
--principal=kudu/127.19.236.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:44253
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.236.126:35093
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:03:35.147349 23750 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:03:35.147626 23750 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:03:35.147668 23750 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:03:35.151702 23750 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:03:35.151764 23750 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:03:35.151783 23750 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:03:35.151800 23750 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:03:35.151849 23750 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:03:35.157449 23750 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:44253
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786460596631409-20401-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786460596631409-20401-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.236.126:35093
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab
--principal=kudu/127.19.236.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:35093
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.236.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23750
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786460596631409-20401-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:03:35.158586 23750 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:03:35.159665 23750 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:03:35.168350 23757 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:35.168339 23758 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:35.168339 23760 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:35.168639 23750 server_base.cc:1034] running on GCE node
I20260811 15:03:35.169275 23750 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:03:35.170419 23750 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:03:35.171633 23750 hybrid_clock.cc:648] HybridClock initialized: now 1786460615171603 us; error 41 us; skew 500 ppm
Aug 11 15:03:35 dist-test-slave-8n49 krb5kdc[23736](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460615, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:03:35.174423 23750 init.cc:377] Logged in from keytab as kudu/127.19.236.126@KRBTEST.COM (short username kudu)
I20260811 15:03:35.175365 23750 webserver.cc:460] Webserver started at http://127.19.236.126:33691/ using document root <none> and password file <none>
I20260811 15:03:35.175945 23750 fs_manager.cc:359] Metadata directory not provided
I20260811 15:03:35.176038 23750 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:03:35.176293 23750 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:03:35.178433 23750 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786460596631409-20401-0/minicluster-data/master-0/data/instance:
uuid: "2b6bc1ac0c274809b8922bc83b42a7ae"
format_stamp: "Formatted at 2026-08-11 15:03:35 on dist-test-slave-8n49"
server_key: "b004ebbe523ccc2c08e7260bb47a6775"
server_key_iv: "2e264240ec162784702d744da9f99c77"
server_key_version: "encryptionkey@0"
I20260811 15:03:35.179085 23750 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786460596631409-20401-0/minicluster-data/master-0/wal/instance:
uuid: "2b6bc1ac0c274809b8922bc83b42a7ae"
format_stamp: "Formatted at 2026-08-11 15:03:35 on dist-test-slave-8n49"
server_key: "b004ebbe523ccc2c08e7260bb47a6775"
server_key_iv: "2e264240ec162784702d744da9f99c77"
server_key_version: "encryptionkey@0"
I20260811 15:03:35.182860 23750 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260811 15:03:35.185261 23768 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:35.186399 23750 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 15:03:35.186553 23750 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786460596631409-20401-0/minicluster-data/master-0/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786460596631409-20401-0/minicluster-data/master-0/wal
uuid: "2b6bc1ac0c274809b8922bc83b42a7ae"
format_stamp: "Formatted at 2026-08-11 15:03:35 on dist-test-slave-8n49"
server_key: "b004ebbe523ccc2c08e7260bb47a6775"
server_key_iv: "2e264240ec162784702d744da9f99c77"
server_key_version: "encryptionkey@0"
I20260811 15:03:35.186669 23750 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786460596631409-20401-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786460596631409-20401-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786460596631409-20401-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:03:35.211151 23750 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:03:35.214254 23750 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:03:35.214478 23750 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:03:35.222193 23750 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.126:35093
I20260811 15:03:35.222500 23827 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.126:35093 every 8 connection(s)
I20260811 15:03:35.223220 23750 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
I20260811 15:03:35.226143 23828 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:03:35.229542 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 23750
I20260811 15:03:35.229650 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786460596631409-20401-0/minicluster-data/master-0/wal/instance
I20260811 15:03:35.229939 20401 external_mini_cluster.cc:1428] Setting key 9a2ec1947816e60622cd0c219e504d5f
I20260811 15:03:35.232383 23828 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2b6bc1ac0c274809b8922bc83b42a7ae: Bootstrap starting.
I20260811 15:03:35.235256 23828 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2b6bc1ac0c274809b8922bc83b42a7ae: Neither blocks nor log segments found. Creating new log.
I20260811 15:03:35.236145 23828 log.cc:824] T 00000000000000000000000000000000 P 2b6bc1ac0c274809b8922bc83b42a7ae: Log is configured to *not* fsync() on all Append() calls
I20260811 15:03:35.238400 23828 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2b6bc1ac0c274809b8922bc83b42a7ae: No bootstrap required, opened a new log
Aug 11 15:03:35 dist-test-slave-8n49 krb5kdc[23736](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460614, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
I20260811 15:03:35.242563 23828 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2b6bc1ac0c274809b8922bc83b42a7ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b6bc1ac0c274809b8922bc83b42a7ae" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 35093 } }
I20260811 15:03:35.242879 23828 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2b6bc1ac0c274809b8922bc83b42a7ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:03:35.242942 23828 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2b6bc1ac0c274809b8922bc83b42a7ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b6bc1ac0c274809b8922bc83b42a7ae, State: Initialized, Role: FOLLOWER
I20260811 15:03:35.243444 23828 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2b6bc1ac0c274809b8922bc83b42a7ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b6bc1ac0c274809b8922bc83b42a7ae" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 35093 } }
I20260811 15:03:35.243620 23828 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2b6bc1ac0c274809b8922bc83b42a7ae [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 15:03:35.243695 23828 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2b6bc1ac0c274809b8922bc83b42a7ae [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 15:03:35.243816 23828 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2b6bc1ac0c274809b8922bc83b42a7ae [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:03:35.245153 23828 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2b6bc1ac0c274809b8922bc83b42a7ae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b6bc1ac0c274809b8922bc83b42a7ae" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 35093 } }
I20260811 15:03:35.245534 23828 leader_election.cc:302] T 00000000000000000000000000000000 P 2b6bc1ac0c274809b8922bc83b42a7ae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2b6bc1ac0c274809b8922bc83b42a7ae; no voters:
I20260811 15:03:35.245910 23828 leader_election.cc:288] T 00000000000000000000000000000000 P 2b6bc1ac0c274809b8922bc83b42a7ae [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 15:03:35.246034 23833 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2b6bc1ac0c274809b8922bc83b42a7ae [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:03:35.246297 23833 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2b6bc1ac0c274809b8922bc83b42a7ae [term 1 LEADER]: Becoming Leader. State: Replica: 2b6bc1ac0c274809b8922bc83b42a7ae, State: Running, Role: LEADER
I20260811 15:03:35.246503 23831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:35.231361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49758 (local address 127.19.236.126:35093)
0811 15:03:35.231797 (+ 436us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:35.231815 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:35.231860 (+ 45us) server_negotiation.cc:407] Connection header received
0811 15:03:35.232745 (+ 885us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:35.232772 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:35.233189 (+ 417us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:35.233567 (+ 378us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:35.234268 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:35.235756 (+ 1488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:35.236781 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:35.237472 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:35.237631 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:35.240110 (+ 2479us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:35.240119 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:35.240137 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:35.240170 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:35.242952 (+ 2782us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:35.243501 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:35.243507 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:35.243513 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:35.243674 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:35.244024 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:35.244030 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:35.244035 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:35.244615 (+ 580us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:35.244822 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:35.245060 (+ 238us) server_negotiation.cc:299] Negotiation successful
0811 15:03:35.245394 (+ 334us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":281,"thread_start_us":103,"threads_started":1}
I20260811 15:03:35.246659 23833 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2b6bc1ac0c274809b8922bc83b42a7ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b6bc1ac0c274809b8922bc83b42a7ae" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 35093 } }
I20260811 15:03:35.247263 23828 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2b6bc1ac0c274809b8922bc83b42a7ae [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:03:35.248711 23834 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2b6bc1ac0c274809b8922bc83b42a7ae [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2b6bc1ac0c274809b8922bc83b42a7ae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b6bc1ac0c274809b8922bc83b42a7ae" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 35093 } } }
I20260811 15:03:35.248673 23835 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2b6bc1ac0c274809b8922bc83b42a7ae [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2b6bc1ac0c274809b8922bc83b42a7ae. Latest consensus state: current_term: 1 leader_uuid: "2b6bc1ac0c274809b8922bc83b42a7ae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b6bc1ac0c274809b8922bc83b42a7ae" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 35093 } } }
I20260811 15:03:35.248819 23835 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2b6bc1ac0c274809b8922bc83b42a7ae [sys.catalog]: This master's current role is: LEADER
I20260811 15:03:35.248819 23834 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2b6bc1ac0c274809b8922bc83b42a7ae [sys.catalog]: This master's current role is: LEADER
I20260811 15:03:35.249367 23844 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:03:35.250144 20401 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 15:03:35.252280 23844 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:03:35.259050 23844 catalog_manager.cc:1347] Generated new cluster ID: aab337aab92f46c2b9064d3207c80db1
I20260811 15:03:35.259245 23844 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:03:35.281172 23831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:35.274989 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49772 (local address 127.19.236.126:35093)
0811 15:03:35.275124 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:35.275129 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:35.275444 (+ 315us) server_negotiation.cc:407] Connection header received
0811 15:03:35.275601 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:35.275605 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:35.275661 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:35.275753 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:35.276397 (+ 644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:35.277237 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:35.278463 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:35.278838 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:35.278949 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:35.279969 (+ 1020us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:35.279973 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:35.279976 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:03:35.280622 (+ 646us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:35.280661 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:03:35.280686 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:35.280807 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:35.280935 (+ 128us) server_negotiation.cc:299] Negotiation successful
0811 15:03:35.281005 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":52}
I20260811 15:03:35.281293 23844 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 15:03:35.282413 23844 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:03:35.288021 23844 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2b6bc1ac0c274809b8922bc83b42a7ae: Generated new TSK 0
I20260811 15:03:35.288770 23844 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 15:03:35.295492 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 23750
2026-08-11T15:03:35Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1494 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 15:03:35 dist-test-slave-8n49 krb5kdc[23866](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 15:03:35 dist-test-slave-8n49 krb5kdc[23866](info): set up 2 sockets
Aug 11 15:03:35 dist-test-slave-8n49 krb5kdc[23866](info): commencing operation
krb5kdc: starting...
W20260811 15:03:36.403787 20401 mini_kdc.cc:121] Time spent starting KDC: real 1.085s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/krb5kdc/test-user.keytab.
Aug 11 15:03:36 dist-test-slave-8n49 krb5kdc[23866](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460616, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T15:03:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T15:03:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.236.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.236.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.236.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab.
Entry for principal kudu/127.19.236.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab.
I20260811 15:03:36.555181 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:38887
--webserver_interface=127.19.236.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab
--principal=kudu/127.19.236.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:44699
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.236.126:38887
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:03:36.670441 23882 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:03:36.670732 23882 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:03:36.670773 23882 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:03:36.674994 23882 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:03:36.675067 23882 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:03:36.675087 23882 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:03:36.675103 23882 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:03:36.675118 23882 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:03:36.680537 23882 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:44699
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.236.126:38887
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab
--principal=kudu/127.19.236.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:38887
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.236.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23882
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:03:36.681741 23882 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:03:36.682816 23882 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:03:36.691766 23889 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:36.691766 23888 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:36.691988 23882 server_base.cc:1034] running on GCE node
W20260811 15:03:36.691885 23892 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:36.692780 23882 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:03:36.693987 23882 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:03:36.695225 23882 hybrid_clock.cc:648] HybridClock initialized: now 1786460616695204 us; error 28 us; skew 500 ppm
Aug 11 15:03:36 dist-test-slave-8n49 krb5kdc[23866](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460616, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:03:36.702145 23882 init.cc:377] Logged in from keytab as kudu/127.19.236.126@KRBTEST.COM (short username kudu)
I20260811 15:03:36.703255 23882 webserver.cc:460] Webserver started at http://127.19.236.126:39645/ using document root <none> and password file <none>
I20260811 15:03:36.703828 23882 fs_manager.cc:359] Metadata directory not provided
I20260811 15:03:36.703893 23882 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:03:36.704077 23882 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:03:36.706290 23882 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/minicluster-data/master-0/data/instance:
uuid: "2d3076fe70f548d997f42d04261aaf66"
format_stamp: "Formatted at 2026-08-11 15:03:36 on dist-test-slave-8n49"
server_key: "043a88bc0f5f4be1b7a93b5dc6a02f0c"
server_key_iv: "c4509b605946e1fca7fab59a9585bbcf"
server_key_version: "encryptionkey@0"
I20260811 15:03:36.706841 23882 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/minicluster-data/master-0/wal/instance:
uuid: "2d3076fe70f548d997f42d04261aaf66"
format_stamp: "Formatted at 2026-08-11 15:03:36 on dist-test-slave-8n49"
server_key: "043a88bc0f5f4be1b7a93b5dc6a02f0c"
server_key_iv: "c4509b605946e1fca7fab59a9585bbcf"
server_key_version: "encryptionkey@0"
I20260811 15:03:36.711244 23882 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260811 15:03:36.713975 23899 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:36.715282 23882 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 15:03:36.715444 23882 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/minicluster-data/master-0/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/minicluster-data/master-0/wal
uuid: "2d3076fe70f548d997f42d04261aaf66"
format_stamp: "Formatted at 2026-08-11 15:03:36 on dist-test-slave-8n49"
server_key: "043a88bc0f5f4be1b7a93b5dc6a02f0c"
server_key_iv: "c4509b605946e1fca7fab59a9585bbcf"
server_key_version: "encryptionkey@0"
I20260811 15:03:36.715577 23882 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:03:36.735371 23882 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:03:36.738473 23882 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:03:36.738803 23882 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:03:36.746393 23882 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.126:38887
I20260811 15:03:36.746716 23956 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.126:38887 every 8 connection(s)
I20260811 15:03:36.747432 23882 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
I20260811 15:03:36.750363 23957 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:03:36.752823 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 23882
I20260811 15:03:36.752920 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/minicluster-data/master-0/wal/instance
I20260811 15:03:36.753211 20401 external_mini_cluster.cc:1428] Setting key 2e10a296257561cb9d831177ec8a0526
I20260811 15:03:36.756459 23957 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2d3076fe70f548d997f42d04261aaf66: Bootstrap starting.
I20260811 15:03:36.758695 23957 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2d3076fe70f548d997f42d04261aaf66: Neither blocks nor log segments found. Creating new log.
I20260811 15:03:36.759464 23957 log.cc:824] T 00000000000000000000000000000000 P 2d3076fe70f548d997f42d04261aaf66: Log is configured to *not* fsync() on all Append() calls
I20260811 15:03:36.761464 23957 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2d3076fe70f548d997f42d04261aaf66: No bootstrap required, opened a new log
Aug 11 15:03:36 dist-test-slave-8n49 krb5kdc[23866](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460616, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
I20260811 15:03:36.764915 23957 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2d3076fe70f548d997f42d04261aaf66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d3076fe70f548d997f42d04261aaf66" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 38887 } }
I20260811 15:03:36.765151 23957 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2d3076fe70f548d997f42d04261aaf66 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:03:36.765234 23957 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2d3076fe70f548d997f42d04261aaf66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d3076fe70f548d997f42d04261aaf66, State: Initialized, Role: FOLLOWER
I20260811 15:03:36.765683 23957 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2d3076fe70f548d997f42d04261aaf66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d3076fe70f548d997f42d04261aaf66" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 38887 } }
I20260811 15:03:36.765805 23957 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2d3076fe70f548d997f42d04261aaf66 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 15:03:36.765941 23957 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2d3076fe70f548d997f42d04261aaf66 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 15:03:36.766074 23957 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2d3076fe70f548d997f42d04261aaf66 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:03:36.766960 23957 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2d3076fe70f548d997f42d04261aaf66 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d3076fe70f548d997f42d04261aaf66" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 38887 } }
I20260811 15:03:36.767297 23957 leader_election.cc:302] T 00000000000000000000000000000000 P 2d3076fe70f548d997f42d04261aaf66 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2d3076fe70f548d997f42d04261aaf66; no voters:
I20260811 15:03:36.767658 23957 leader_election.cc:288] T 00000000000000000000000000000000 P 2d3076fe70f548d997f42d04261aaf66 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 15:03:36.767731 23964 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2d3076fe70f548d997f42d04261aaf66 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:03:36.767995 23964 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2d3076fe70f548d997f42d04261aaf66 [term 1 LEADER]: Becoming Leader. State: Replica: 2d3076fe70f548d997f42d04261aaf66, State: Running, Role: LEADER
I20260811 15:03:36.768299 23964 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2d3076fe70f548d997f42d04261aaf66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d3076fe70f548d997f42d04261aaf66" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 38887 } }
I20260811 15:03:36.769090 23957 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2d3076fe70f548d997f42d04261aaf66 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:03:36.769090 23962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:36.754585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60774 (local address 127.19.236.126:38887)
0811 15:03:36.755035 (+ 450us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:36.755052 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:36.755087 (+ 35us) server_negotiation.cc:407] Connection header received
0811 15:03:36.755837 (+ 750us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:36.755855 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:36.756180 (+ 325us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:36.756538 (+ 358us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:36.757400 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:36.758396 (+ 996us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:36.759487 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:36.760146 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:36.760332 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:36.763224 (+ 2892us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:36.763230 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:36.763244 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:36.763271 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:36.765791 (+ 2520us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:36.766329 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:36.766335 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:36.766343 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:36.766463 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:36.766755 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:36.766759 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:36.766760 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:36.767240 (+ 480us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:36.767440 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:36.767786 (+ 346us) server_negotiation.cc:299] Negotiation successful
0811 15:03:36.768134 (+ 348us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":303,"thread_start_us":144,"threads_started":1}
I20260811 15:03:36.769649 23966 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2d3076fe70f548d997f42d04261aaf66 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2d3076fe70f548d997f42d04261aaf66. Latest consensus state: current_term: 1 leader_uuid: "2d3076fe70f548d997f42d04261aaf66" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d3076fe70f548d997f42d04261aaf66" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 38887 } } }
I20260811 15:03:36.769800 23966 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2d3076fe70f548d997f42d04261aaf66 [sys.catalog]: This master's current role is: LEADER
I20260811 15:03:36.770219 23968 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:03:36.772485 23965 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2d3076fe70f548d997f42d04261aaf66 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2d3076fe70f548d997f42d04261aaf66" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d3076fe70f548d997f42d04261aaf66" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 38887 } } }
I20260811 15:03:36.772680 23965 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2d3076fe70f548d997f42d04261aaf66 [sys.catalog]: This master's current role is: LEADER
I20260811 15:03:36.773484 23968 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:03:36.779803 23968 catalog_manager.cc:1347] Generated new cluster ID: 3047dd2e3fce4f2caa7b20f3e8ec19ed
I20260811 15:03:36.779888 23968 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:03:36.797436 23968 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 15:03:36.798475 23968 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:03:36.808432 23968 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2d3076fe70f548d997f42d04261aaf66: Generated new TSK 0
I20260811 15:03:36.809309 23968 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.236.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.236.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.236.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.65.keytab.
Entry for principal kudu/127.19.236.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.65.keytab.
I20260811 15:03:36.846164 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.65:0
--local_ip_for_outbound_sockets=127.19.236.65
--webserver_interface=127.19.236.65
--webserver_port=0
--tserver_master_addrs=127.19.236.126:38887
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.65.keytab
--principal=kudu/127.19.236.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:44699
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:03:36.963222 23988 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:03:36.963500 23988 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:03:36.963552 23988 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:03:36.967684 23988 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:03:36.967742 23988 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:03:36.967799 23988 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.65
I20260811 15:03:36.973479 23988 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:44699
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.65.keytab
--principal=kudu/127.19.236.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.236.65
--webserver_port=0
--tserver_master_addrs=127.19.236.126:38887
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23988
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.65
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:03:36.974584 23988 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:03:36.975596 23988 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:03:36.985306 23994 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:36.985334 23993 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:36.985306 23996 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:36.985769 23988 server_base.cc:1034] running on GCE node
I20260811 15:03:36.986239 23988 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:03:36.986935 23988 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:03:36.988135 23988 hybrid_clock.cc:648] HybridClock initialized: now 1786460616988107 us; error 44 us; skew 500 ppm
Aug 11 15:03:36 dist-test-slave-8n49 krb5kdc[23866](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460616, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:03:36.991266 23988 init.cc:377] Logged in from keytab as kudu/127.19.236.65@KRBTEST.COM (short username kudu)
I20260811 15:03:36.992113 23988 webserver.cc:460] Webserver started at http://127.19.236.65:41853/ using document root <none> and password file <none>
I20260811 15:03:36.992770 23988 fs_manager.cc:359] Metadata directory not provided
I20260811 15:03:36.992846 23988 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:03:36.993036 23988 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:03:36.995070 23988 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-0/data/instance:
uuid: "e39906e13f30440194405f676070c72c"
format_stamp: "Formatted at 2026-08-11 15:03:36 on dist-test-slave-8n49"
server_key: "00843734ab85a119be9b575caba9ccc0"
server_key_iv: "951fab6aa5dc3c5534427c0857a60d21"
server_key_version: "encryptionkey@0"
I20260811 15:03:36.995590 23988 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-0/wal/instance:
uuid: "e39906e13f30440194405f676070c72c"
format_stamp: "Formatted at 2026-08-11 15:03:36 on dist-test-slave-8n49"
server_key: "00843734ab85a119be9b575caba9ccc0"
server_key_iv: "951fab6aa5dc3c5534427c0857a60d21"
server_key_version: "encryptionkey@0"
I20260811 15:03:36.999451 23988 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.006s
I20260811 15:03:37.002110 24003 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:37.003473 23988 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 15:03:37.003625 23988 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-0/wal
uuid: "e39906e13f30440194405f676070c72c"
format_stamp: "Formatted at 2026-08-11 15:03:36 on dist-test-slave-8n49"
server_key: "00843734ab85a119be9b575caba9ccc0"
server_key_iv: "951fab6aa5dc3c5534427c0857a60d21"
server_key_version: "encryptionkey@0"
I20260811 15:03:37.003744 23988 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:03:37.061790 23988 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:03:37.065142 23988 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:03:37.065387 23988 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:03:37.066015 23988 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:03:37.066870 23988 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:03:37.066952 23988 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:37.067026 23988 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:03:37.067077 23988 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:37.076992 23988 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.65:41071
I20260811 15:03:37.077021 24138 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.65:41071 every 8 connection(s)
I20260811 15:03:37.077894 23988 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
I20260811 15:03:37.084622 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 23988
I20260811 15:03:37.084772 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-0/wal/instance
I20260811 15:03:37.085089 20401 external_mini_cluster.cc:1428] Setting key 2aae1d1e81af8b3394b17d768183e6ea
Aug 11 15:03:37 dist-test-slave-8n49 krb5kdc[23866](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460616, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.65@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
I20260811 15:03:37.093277 23962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:37.079848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.65:40581 (local address 127.19.236.126:38887)
0811 15:03:37.080034 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:37.080038 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:37.080925 (+ 887us) server_negotiation.cc:407] Connection header received
0811 15:03:37.082354 (+ 1429us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:37.082357 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:37.082414 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:37.082527 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:37.083710 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:37.084269 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:37.085877 (+ 1608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:37.086107 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:37.086194 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:37.089261 (+ 3067us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:37.089264 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:37.089267 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:37.089292 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:37.090888 (+ 1596us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:37.091508 (+ 620us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:37.091511 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:37.091512 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:37.091594 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:37.091989 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:37.091992 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:37.091994 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:37.092208 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:37.092322 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:37.092949 (+ 627us) server_negotiation.cc:299] Negotiation successful
0811 15:03:37.093090 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260811 15:03:37.094195 24141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:37.080229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:38887 (local address 127.19.236.65:40581)
0811 15:03:37.080768 (+ 539us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:37.080814 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:37.082139 (+ 1325us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:37.082707 (+ 568us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:37.082713 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:37.083070 (+ 357us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:37.083550 (+ 480us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:37.083564 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:37.084408 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:37.084414 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:37.085571 (+ 1157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:37.085582 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:37.086265 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:37.086269 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:37.086526 (+ 257us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:37.087233 (+ 707us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:03:37.087250 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:37.089069 (+ 1819us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:37.091032 (+ 1963us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:37.091039 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:37.091057 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:37.091386 (+ 329us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:37.091695 (+ 309us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:37.091699 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:37.091701 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:37.091867 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:37.092323 (+ 456us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:37.092331 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:37.092681 (+ 350us) client_negotiation.cc:769] Sending connection context
0811 15:03:37.092882 (+ 201us) client_negotiation.cc:240] Negotiation successful
0811 15:03:37.093237 (+ 355us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":277,"thread_start_us":127,"threads_started":1}
WARNING: no policy specified for kudu/127.19.236.66@KRBTEST.COM; defaulting to no policy
I20260811 15:03:37.095580 24139 heartbeater.cc:347] Connected to a master server at 127.19.236.126:38887
I20260811 15:03:37.095842 24139 heartbeater.cc:464] Registering TS with master...
I20260811 15:03:37.096437 24139 heartbeater.cc:511] Master 127.19.236.126:38887 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.236.66@KRBTEST.COM" created.
I20260811 15:03:37.098313 23917 ts_manager.cc:194] Registered new tserver with Master: e39906e13f30440194405f676070c72c (127.19.236.65:41071)
I20260811 15:03:37.100049 23917 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.236.65@KRBTEST.COM'} at 127.19.236.65:40581
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.236.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.66.keytab.
Entry for principal kudu/127.19.236.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.66.keytab.
I20260811 15:03:37.115321 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.66:0
--local_ip_for_outbound_sockets=127.19.236.66
--webserver_interface=127.19.236.66
--webserver_port=0
--tserver_master_addrs=127.19.236.126:38887
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.66.keytab
--principal=kudu/127.19.236.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:44699
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:03:37.231097 24146 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:03:37.231422 24146 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:03:37.231499 24146 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:03:37.235643 24146 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:03:37.235737 24146 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:03:37.235827 24146 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.66
I20260811 15:03:37.241302 24146 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:44699
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.66.keytab
--principal=kudu/127.19.236.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.236.66
--webserver_port=0
--tserver_master_addrs=127.19.236.126:38887
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24146
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.66
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:03:37.242488 24146 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:03:37.243563 24146 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:03:37.253716 24151 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:37.253710 24152 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:37.253741 24154 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:37.254072 24146 server_base.cc:1034] running on GCE node
I20260811 15:03:37.254493 24146 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:03:37.255107 24146 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:03:37.256285 24146 hybrid_clock.cc:648] HybridClock initialized: now 1786460617256264 us; error 33 us; skew 500 ppm
Aug 11 15:03:37 dist-test-slave-8n49 krb5kdc[23866](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460617, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:03:37.259162 24146 init.cc:377] Logged in from keytab as kudu/127.19.236.66@KRBTEST.COM (short username kudu)
I20260811 15:03:37.260149 24146 webserver.cc:460] Webserver started at http://127.19.236.66:46123/ using document root <none> and password file <none>
I20260811 15:03:37.260826 24146 fs_manager.cc:359] Metadata directory not provided
I20260811 15:03:37.260892 24146 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:03:37.261126 24146 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:03:37.263319 24146 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-1/data/instance:
uuid: "3b4f9765bb994078bc5e7930990d4a81"
format_stamp: "Formatted at 2026-08-11 15:03:37 on dist-test-slave-8n49"
server_key: "139e662512fe72f6a9f8accd3ca58816"
server_key_iv: "57893ae38d86550f782acdb3036429ff"
server_key_version: "encryptionkey@0"
I20260811 15:03:37.263922 24146 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-1/wal/instance:
uuid: "3b4f9765bb994078bc5e7930990d4a81"
format_stamp: "Formatted at 2026-08-11 15:03:37 on dist-test-slave-8n49"
server_key: "139e662512fe72f6a9f8accd3ca58816"
server_key_iv: "57893ae38d86550f782acdb3036429ff"
server_key_version: "encryptionkey@0"
I20260811 15:03:37.267984 24146 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.004s
I20260811 15:03:37.270779 24162 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:37.272125 24146 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 15:03:37.272284 24146 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-1/wal
uuid: "3b4f9765bb994078bc5e7930990d4a81"
format_stamp: "Formatted at 2026-08-11 15:03:37 on dist-test-slave-8n49"
server_key: "139e662512fe72f6a9f8accd3ca58816"
server_key_iv: "57893ae38d86550f782acdb3036429ff"
server_key_version: "encryptionkey@0"
I20260811 15:03:37.272418 24146 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:03:37.297078 24146 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:03:37.300503 24146 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:03:37.300813 24146 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:03:37.301556 24146 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:03:37.302543 24146 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:03:37.302597 24146 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:37.302673 24146 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:03:37.302711 24146 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:37.313248 24146 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.66:43559
I20260811 15:03:37.313274 24288 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.66:43559 every 8 connection(s)
I20260811 15:03:37.314270 24146 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
I20260811 15:03:37.323065 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 24146
I20260811 15:03:37.323200 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-1/wal/instance
I20260811 15:03:37.323498 20401 external_mini_cluster.cc:1428] Setting key 39b44c0f38d458dc83d286e7168fa23c
Aug 11 15:03:37 dist-test-slave-8n49 krb5kdc[23866](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460617, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.66@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
I20260811 15:03:37.329708 23962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:37.316205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.66:37007 (local address 127.19.236.126:38887)
0811 15:03:37.316363 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:37.316368 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:37.317254 (+ 886us) server_negotiation.cc:407] Connection header received
0811 15:03:37.318852 (+ 1598us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:37.318856 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:37.318906 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:37.318981 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:37.320329 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:37.320965 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:37.322159 (+ 1194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:37.322374 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:37.322456 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:37.325568 (+ 3112us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:37.325571 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:37.325573 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:37.325599 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:37.327242 (+ 1643us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:37.327797 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:37.327803 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:37.327808 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:37.327916 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:37.328260 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:37.328265 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:37.328268 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:37.328573 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:37.328690 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:37.329280 (+ 590us) server_negotiation.cc:299] Negotiation successful
0811 15:03:37.329443 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260811 15:03:37.330459 24292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:37.316624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:38887 (local address 127.19.236.66:37007)
0811 15:03:37.317095 (+ 471us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:37.317141 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:37.318598 (+ 1457us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:37.319121 (+ 523us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:37.319127 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:37.319636 (+ 509us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:37.320189 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:37.320205 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:37.321080 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:37.321082 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:37.322048 (+ 966us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:37.322057 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:37.322530 (+ 473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:37.322533 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:37.322686 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:37.323382 (+ 696us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:03:37.323401 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:37.325368 (+ 1967us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:37.327400 (+ 2032us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:37.327407 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:37.327422 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:37.327690 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:37.328018 (+ 328us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:37.328021 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:37.328022 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:37.328164 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:37.328715 (+ 551us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:37.328722 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:37.329018 (+ 296us) client_negotiation.cc:769] Sending connection context
0811 15:03:37.329186 (+ 168us) client_negotiation.cc:240] Negotiation successful
0811 15:03:37.329470 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":268,"thread_start_us":117,"threads_started":1}
I20260811 15:03:37.331736 24289 heartbeater.cc:347] Connected to a master server at 127.19.236.126:38887
I20260811 15:03:37.331979 24289 heartbeater.cc:464] Registering TS with master...
I20260811 15:03:37.332507 24289 heartbeater.cc:511] Master 127.19.236.126:38887 requested a full tablet report, sending...
I20260811 15:03:37.333642 23917 ts_manager.cc:194] Registered new tserver with Master: 3b4f9765bb994078bc5e7930990d4a81 (127.19.236.66:43559)
I20260811 15:03:37.334231 23917 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.236.66@KRBTEST.COM'} at 127.19.236.66:37007
WARNING: no policy specified for kudu/127.19.236.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.236.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.236.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.67.keytab.
Entry for principal kudu/127.19.236.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.67.keytab.
I20260811 15:03:37.353195 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.67:0
--local_ip_for_outbound_sockets=127.19.236.67
--webserver_interface=127.19.236.67
--webserver_port=0
--tserver_master_addrs=127.19.236.126:38887
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.67.keytab
--principal=kudu/127.19.236.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:44699
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:03:37.477615 24295 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:03:37.477918 24295 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:03:37.477991 24295 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:03:37.482189 24295 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:03:37.482282 24295 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:03:37.482376 24295 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.67
I20260811 15:03:37.487790 24295 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:44699
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.67.keytab
--principal=kudu/127.19.236.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.236.67
--webserver_port=0
--tserver_master_addrs=127.19.236.126:38887
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24295
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.67
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:03:37.489135 24295 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:03:37.490307 24295 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:03:37.500924 24303 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:37.500886 24306 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:37.500901 24302 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:37.501422 24295 server_base.cc:1034] running on GCE node
I20260811 15:03:37.501915 24295 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:03:37.502580 24295 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:03:37.503780 24295 hybrid_clock.cc:648] HybridClock initialized: now 1786460617503768 us; error 33 us; skew 500 ppm
Aug 11 15:03:37 dist-test-slave-8n49 krb5kdc[23866](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460617, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:03:37.506587 24295 init.cc:377] Logged in from keytab as kudu/127.19.236.67@KRBTEST.COM (short username kudu)
I20260811 15:03:37.507558 24295 webserver.cc:460] Webserver started at http://127.19.236.67:35313/ using document root <none> and password file <none>
I20260811 15:03:37.508226 24295 fs_manager.cc:359] Metadata directory not provided
I20260811 15:03:37.508325 24295 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:03:37.508642 24295 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:03:37.510828 24295 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-2/data/instance:
uuid: "3cceafaa720d457e877bc5258682161f"
format_stamp: "Formatted at 2026-08-11 15:03:37 on dist-test-slave-8n49"
server_key: "5aaa9ea725e2ebd8c934f72d4c0ff10a"
server_key_iv: "0d81e3b2ff376ac9b241fa348b9bad5e"
server_key_version: "encryptionkey@0"
I20260811 15:03:37.511421 24295 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-2/wal/instance:
uuid: "3cceafaa720d457e877bc5258682161f"
format_stamp: "Formatted at 2026-08-11 15:03:37 on dist-test-slave-8n49"
server_key: "5aaa9ea725e2ebd8c934f72d4c0ff10a"
server_key_iv: "0d81e3b2ff376ac9b241fa348b9bad5e"
server_key_version: "encryptionkey@0"
I20260811 15:03:37.515307 24295 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.003s
I20260811 15:03:37.517973 24314 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:37.519243 24295 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 15:03:37.519382 24295 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-2/wal
uuid: "3cceafaa720d457e877bc5258682161f"
format_stamp: "Formatted at 2026-08-11 15:03:37 on dist-test-slave-8n49"
server_key: "5aaa9ea725e2ebd8c934f72d4c0ff10a"
server_key_iv: "0d81e3b2ff376ac9b241fa348b9bad5e"
server_key_version: "encryptionkey@0"
I20260811 15:03:37.519501 24295 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:03:37.540093 24295 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:03:37.543176 24295 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:03:37.543409 24295 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:03:37.544049 24295 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:03:37.544950 24295 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:03:37.545025 24295 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:37.545099 24295 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:03:37.545149 24295 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:37.554464 24295 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.67:38159
I20260811 15:03:37.554507 24441 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.67:38159 every 8 connection(s)
I20260811 15:03:37.555410 24295 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
I20260811 15:03:37.560750 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 24295
I20260811 15:03:37.560889 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786460596631409-20401-0/minicluster-data/ts-2/wal/instance
I20260811 15:03:37.561260 20401 external_mini_cluster.cc:1428] Setting key 7080b48d0fc8c1f2e31edd076625db20
Aug 11 15:03:37 dist-test-slave-8n49 krb5kdc[23866](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460617, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.67@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
I20260811 15:03:37.570080 23962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:37.557438 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.67:47675 (local address 127.19.236.126:38887)
0811 15:03:37.557591 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:37.557595 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:37.558448 (+ 853us) server_negotiation.cc:407] Connection header received
0811 15:03:37.560029 (+ 1581us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:37.560032 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:37.560096 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:37.560178 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:37.561817 (+ 1639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:37.562426 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:37.563777 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:37.564000 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:37.564082 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:37.566636 (+ 2554us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:37.566639 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:37.566641 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:37.566665 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:37.567985 (+ 1320us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:37.568483 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:37.568486 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:37.568487 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:37.568630 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:37.568940 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:37.568942 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:37.568943 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:37.569129 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:37.569208 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:37.569840 (+ 632us) server_negotiation.cc:299] Negotiation successful
0811 15:03:37.569953 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 15:03:37.571084 24445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:37.557794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:38887 (local address 127.19.236.67:47675)
0811 15:03:37.558257 (+ 463us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:37.558299 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:37.559780 (+ 1481us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:37.560360 (+ 580us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:37.560366 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:37.560936 (+ 570us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:37.561659 (+ 723us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:37.561678 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:37.562588 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:37.562592 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:37.563667 (+ 1075us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:37.563678 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:37.564144 (+ 466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:37.564147 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:37.564291 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:37.564895 (+ 604us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:03:37.564914 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:37.566451 (+ 1537us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:37.568109 (+ 1658us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:37.568114 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:37.568127 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:37.568394 (+ 267us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:37.568714 (+ 320us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:37.568716 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:37.568717 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:37.568853 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:37.569250 (+ 397us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:37.569255 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:37.569572 (+ 317us) client_negotiation.cc:769] Sending connection context
0811 15:03:37.569796 (+ 224us) client_negotiation.cc:240] Negotiation successful
0811 15:03:37.570079 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":268,"thread_start_us":114,"threads_started":1}
I20260811 15:03:37.572355 24442 heartbeater.cc:347] Connected to a master server at 127.19.236.126:38887
I20260811 15:03:37.572671 24442 heartbeater.cc:464] Registering TS with master...
I20260811 15:03:37.573191 24442 heartbeater.cc:511] Master 127.19.236.126:38887 requested a full tablet report, sending...
I20260811 15:03:37.574442 23917 ts_manager.cc:194] Registered new tserver with Master: 3cceafaa720d457e877bc5258682161f (127.19.236.67:38159)
I20260811 15:03:37.575191 23917 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.236.67@KRBTEST.COM'} at 127.19.236.67:47675
I20260811 15:03:37.575591 20401 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 15:03:37 dist-test-slave-8n49 krb5kdc[23866](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460617, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 11 15:03:37 dist-test-slave-8n49 krb5kdc[23866](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460617, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
I20260811 15:03:37.602667 23962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:37.594037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60784 (local address 127.19.236.126:38887)
0811 15:03:37.594241 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:37.594246 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:37.594386 (+ 140us) server_negotiation.cc:407] Connection header received
0811 15:03:37.594567 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:37.594573 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:37.594625 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:37.594713 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:37.595460 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:37.595999 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:37.596925 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:37.597157 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:37.597275 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:37.599871 (+ 2596us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:37.599874 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:37.599877 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:37.599902 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:37.601194 (+ 1292us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:37.601581 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:37.601583 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:37.601584 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:37.601656 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:37.601884 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:37.601887 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:37.601888 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:37.602106 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:37.602206 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:37.602431 (+ 225us) server_negotiation.cc:299] Negotiation successful
0811 15:03:37.602527 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
W20260811 15:03:37.603133 23917 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:60784
I20260811 15:03:37.604493 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 23988
I20260811 15:03:37.613488 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 24146
I20260811 15:03:37.623353 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 24295
I20260811 15:03:37.630635 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 23882
2026-08-11T15:03:37Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (2335 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 15:03:37 dist-test-slave-8n49 krb5kdc[24456](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 15:03:37 dist-test-slave-8n49 krb5kdc[24456](info): set up 2 sockets
Aug 11 15:03:37 dist-test-slave-8n49 krb5kdc[24456](info): commencing operation
krb5kdc: starting...
W20260811 15:03:38.736461 20401 mini_kdc.cc:121] Time spent starting KDC: real 1.082s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/krb5kdc/test-user.keytab.
Aug 11 15:03:38 dist-test-slave-8n49 krb5kdc[24456](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460618, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T15:03:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T15:03:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.236.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.236.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.236.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab.
Entry for principal kudu/127.19.236.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab.
I20260811 15:03:38.865126 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:35483
--webserver_interface=127.19.236.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab
--principal=kudu/127.19.236.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:40483
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.236.126:35483
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:03:38.986271 24472 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:03:38.986584 24472 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:03:38.986677 24472 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:03:38.990758 24472 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:03:38.990846 24472 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:03:38.990885 24472 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:03:38.990943 24472 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:03:38.990983 24472 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:03:38.996475 24472 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:40483
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.236.126:35483
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab
--principal=kudu/127.19.236.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:35483
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.236.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24472
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:03:38.997655 24472 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:03:38.998731 24472 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:03:39.007725 24480 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:39.007747 24478 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:39.007814 24472 server_base.cc:1034] running on GCE node
W20260811 15:03:39.007748 24477 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:39.008608 24472 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:03:39.009742 24472 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:03:39.010950 24472 hybrid_clock.cc:648] HybridClock initialized: now 1786460619010919 us; error 50 us; skew 500 ppm
Aug 11 15:03:39 dist-test-slave-8n49 krb5kdc[24456](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460619, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:03:39.013806 24472 init.cc:377] Logged in from keytab as kudu/127.19.236.126@KRBTEST.COM (short username kudu)
I20260811 15:03:39.014703 24472 webserver.cc:460] Webserver started at http://127.19.236.126:34373/ using document root <none> and password file <none>
I20260811 15:03:39.015280 24472 fs_manager.cc:359] Metadata directory not provided
I20260811 15:03:39.015374 24472 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:03:39.015625 24472 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:03:39.017764 24472 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/minicluster-data/master-0/data/instance:
uuid: "3abf65df0fc54230a7ec3f099208b163"
format_stamp: "Formatted at 2026-08-11 15:03:39 on dist-test-slave-8n49"
server_key: "b88d73a0ff95e22cb4e38e2d6f7e5a85"
server_key_iv: "77d5fb607f599b5fc1d0f38c7c68de0a"
server_key_version: "encryptionkey@0"
I20260811 15:03:39.018340 24472 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/minicluster-data/master-0/wal/instance:
uuid: "3abf65df0fc54230a7ec3f099208b163"
format_stamp: "Formatted at 2026-08-11 15:03:39 on dist-test-slave-8n49"
server_key: "b88d73a0ff95e22cb4e38e2d6f7e5a85"
server_key_iv: "77d5fb607f599b5fc1d0f38c7c68de0a"
server_key_version: "encryptionkey@0"
I20260811 15:03:39.022065 24472 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260811 15:03:39.024628 24487 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:39.025985 24472 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 15:03:39.026131 24472 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/minicluster-data/master-0/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/minicluster-data/master-0/wal
uuid: "3abf65df0fc54230a7ec3f099208b163"
format_stamp: "Formatted at 2026-08-11 15:03:39 on dist-test-slave-8n49"
server_key: "b88d73a0ff95e22cb4e38e2d6f7e5a85"
server_key_iv: "77d5fb607f599b5fc1d0f38c7c68de0a"
server_key_version: "encryptionkey@0"
I20260811 15:03:39.026248 24472 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:03:39.061853 24472 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:03:39.065289 24472 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:03:39.065532 24472 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:03:39.073019 24472 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.126:35483
I20260811 15:03:39.073032 24544 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.126:35483 every 8 connection(s)
I20260811 15:03:39.074064 24472 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
I20260811 15:03:39.077057 24545 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:03:39.082818 24545 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3abf65df0fc54230a7ec3f099208b163: Bootstrap starting.
I20260811 15:03:39.083285 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 24472
I20260811 15:03:39.083451 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/minicluster-data/master-0/wal/instance
I20260811 15:03:39.083724 20401 external_mini_cluster.cc:1428] Setting key 92a7598ad5bfc8069ec9a407455470af
I20260811 15:03:39.085656 24545 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3abf65df0fc54230a7ec3f099208b163: Neither blocks nor log segments found. Creating new log.
I20260811 15:03:39.086774 24545 log.cc:824] T 00000000000000000000000000000000 P 3abf65df0fc54230a7ec3f099208b163: Log is configured to *not* fsync() on all Append() calls
I20260811 15:03:39.088817 24545 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3abf65df0fc54230a7ec3f099208b163: No bootstrap required, opened a new log
I20260811 15:03:39.092447 24545 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3abf65df0fc54230a7ec3f099208b163 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3abf65df0fc54230a7ec3f099208b163" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 35483 } }
I20260811 15:03:39.092782 24545 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3abf65df0fc54230a7ec3f099208b163 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:03:39.092868 24545 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3abf65df0fc54230a7ec3f099208b163 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3abf65df0fc54230a7ec3f099208b163, State: Initialized, Role: FOLLOWER
Aug 11 15:03:39 dist-test-slave-8n49 krb5kdc[24456](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460618, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
I20260811 15:03:39.093386 24545 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3abf65df0fc54230a7ec3f099208b163 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3abf65df0fc54230a7ec3f099208b163" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 35483 } }
I20260811 15:03:39.093552 24545 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3abf65df0fc54230a7ec3f099208b163 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 15:03:39.093650 24545 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3abf65df0fc54230a7ec3f099208b163 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 15:03:39.093763 24545 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3abf65df0fc54230a7ec3f099208b163 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:03:39.095122 24545 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3abf65df0fc54230a7ec3f099208b163 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3abf65df0fc54230a7ec3f099208b163" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 35483 } }
I20260811 15:03:39.095504 24545 leader_election.cc:302] T 00000000000000000000000000000000 P 3abf65df0fc54230a7ec3f099208b163 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3abf65df0fc54230a7ec3f099208b163; no voters:
I20260811 15:03:39.095880 24545 leader_election.cc:288] T 00000000000000000000000000000000 P 3abf65df0fc54230a7ec3f099208b163 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 15:03:39.096014 24553 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3abf65df0fc54230a7ec3f099208b163 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:03:39.096246 24553 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3abf65df0fc54230a7ec3f099208b163 [term 1 LEADER]: Becoming Leader. State: Replica: 3abf65df0fc54230a7ec3f099208b163, State: Running, Role: LEADER
I20260811 15:03:39.096674 24553 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3abf65df0fc54230a7ec3f099208b163 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3abf65df0fc54230a7ec3f099208b163" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 35483 } }
I20260811 15:03:39.097244 24545 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3abf65df0fc54230a7ec3f099208b163 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:03:39.097992 24553 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3abf65df0fc54230a7ec3f099208b163 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3abf65df0fc54230a7ec3f099208b163. Latest consensus state: current_term: 1 leader_uuid: "3abf65df0fc54230a7ec3f099208b163" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3abf65df0fc54230a7ec3f099208b163" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 35483 } } }
I20260811 15:03:39.098187 24553 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3abf65df0fc54230a7ec3f099208b163 [sys.catalog]: This master's current role is: LEADER
I20260811 15:03:39.098485 24554 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3abf65df0fc54230a7ec3f099208b163 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3abf65df0fc54230a7ec3f099208b163" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3abf65df0fc54230a7ec3f099208b163" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 35483 } } }
I20260811 15:03:39.098603 24554 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3abf65df0fc54230a7ec3f099208b163 [sys.catalog]: This master's current role is: LEADER
I20260811 15:03:39.098708 24562 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:03:39.099663 24551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:39.085233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45238 (local address 127.19.236.126:35483)
0811 15:03:39.085685 (+ 452us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:39.085701 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:39.085740 (+ 39us) server_negotiation.cc:407] Connection header received
0811 15:03:39.086572 (+ 832us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:39.086616 (+ 44us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:39.087021 (+ 405us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:39.087373 (+ 352us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:39.088238 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:39.089345 (+ 1107us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:39.090239 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:39.090728 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:39.090902 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:39.093681 (+ 2779us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:39.093689 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:39.093710 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:39.093743 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:39.095757 (+ 2014us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:39.096320 (+ 563us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:39.096329 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:39.096336 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:39.096498 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:39.096862 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:39.096865 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:39.096867 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:39.097371 (+ 504us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:39.097565 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:39.098063 (+ 498us) server_negotiation.cc:299] Negotiation successful
0811 15:03:39.098403 (+ 340us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":291,"thread_start_us":152,"threads_started":1}
I20260811 15:03:39.103410 24562 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:03:39.108763 24562 catalog_manager.cc:1347] Generated new cluster ID: adbe571a52c145af80820f4f1af94cb0
I20260811 15:03:39.108841 24562 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:03:39.116806 24562 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 15:03:39.117734 24562 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:03:39.122188 24562 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3abf65df0fc54230a7ec3f099208b163: Generated new TSK 0
I20260811 15:03:39.122994 24562 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.236.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.236.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.236.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.65.keytab.
Entry for principal kudu/127.19.236.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.65.keytab.
I20260811 15:03:39.160265 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.65:0
--local_ip_for_outbound_sockets=127.19.236.65
--webserver_interface=127.19.236.65
--webserver_port=0
--tserver_master_addrs=127.19.236.126:35483
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.65.keytab
--principal=kudu/127.19.236.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:40483
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:03:39.275103 24575 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:03:39.275381 24575 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:03:39.275498 24575 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:03:39.279747 24575 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:03:39.279808 24575 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:03:39.279866 24575 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.65
I20260811 15:03:39.285234 24575 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:40483
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.65.keytab
--principal=kudu/127.19.236.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.236.65
--webserver_port=0
--tserver_master_addrs=127.19.236.126:35483
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24575
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.65
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:03:39.286427 24575 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:03:39.287496 24575 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:03:39.297340 24580 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:39.297407 24575 server_base.cc:1034] running on GCE node
W20260811 15:03:39.297364 24583 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:39.297340 24581 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:39.297999 24575 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:03:39.298851 24575 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:03:39.300017 24575 hybrid_clock.cc:648] HybridClock initialized: now 1786460619300003 us; error 24 us; skew 500 ppm
Aug 11 15:03:39 dist-test-slave-8n49 krb5kdc[24456](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460619, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:03:39.302845 24575 init.cc:377] Logged in from keytab as kudu/127.19.236.65@KRBTEST.COM (short username kudu)
I20260811 15:03:39.303725 24575 webserver.cc:460] Webserver started at http://127.19.236.65:37239/ using document root <none> and password file <none>
I20260811 15:03:39.304307 24575 fs_manager.cc:359] Metadata directory not provided
I20260811 15:03:39.304369 24575 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:03:39.304644 24575 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:03:39.306783 24575 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/minicluster-data/ts-0/data/instance:
uuid: "aab00de512174c42bb29229024cc320d"
format_stamp: "Formatted at 2026-08-11 15:03:39 on dist-test-slave-8n49"
server_key: "f77808ecb812e4ed79e620f3784e8fc6"
server_key_iv: "12cd9c4e448bae5215f6814e852490b2"
server_key_version: "encryptionkey@0"
I20260811 15:03:39.307370 24575 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/minicluster-data/ts-0/wal/instance:
uuid: "aab00de512174c42bb29229024cc320d"
format_stamp: "Formatted at 2026-08-11 15:03:39 on dist-test-slave-8n49"
server_key: "f77808ecb812e4ed79e620f3784e8fc6"
server_key_iv: "12cd9c4e448bae5215f6814e852490b2"
server_key_version: "encryptionkey@0"
I20260811 15:03:39.311379 24575 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.001s
I20260811 15:03:39.314009 24592 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:39.315390 24575 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 15:03:39.315529 24575 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/minicluster-data/ts-0/wal
uuid: "aab00de512174c42bb29229024cc320d"
format_stamp: "Formatted at 2026-08-11 15:03:39 on dist-test-slave-8n49"
server_key: "f77808ecb812e4ed79e620f3784e8fc6"
server_key_iv: "12cd9c4e448bae5215f6814e852490b2"
server_key_version: "encryptionkey@0"
I20260811 15:03:39.315644 24575 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:03:39.340467 24575 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:03:39.343860 24575 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:03:39.344084 24575 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:03:39.344786 24575 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:03:39.345698 24575 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:03:39.345752 24575 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:39.345822 24575 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:03:39.345853 24575 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:39.355103 24575 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.65:45649
I20260811 15:03:39.355129 24724 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.65:45649 every 8 connection(s)
I20260811 15:03:39.356091 24575 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
I20260811 15:03:39.357553 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 24575
I20260811 15:03:39.357677 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/minicluster-data/ts-0/wal/instance
I20260811 15:03:39.358044 20401 external_mini_cluster.cc:1428] Setting key dd5222c69238cec753cc0ad95264a5ec
Aug 11 15:03:39 dist-test-slave-8n49 krb5kdc[24456](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460619, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.65@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.19.236.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.236.66@KRBTEST.COM" created.
I20260811 15:03:39.373142 24551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:39.358146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.65:35075 (local address 127.19.236.126:35483)
0811 15:03:39.358286 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:39.358290 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:39.359266 (+ 976us) server_negotiation.cc:407] Connection header received
0811 15:03:39.361367 (+ 2101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:39.361370 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:39.361417 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:39.361490 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:39.362872 (+ 1382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:39.363727 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:39.365057 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:39.365491 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:39.365629 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:39.368180 (+ 2551us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:39.368187 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:39.368190 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:39.368224 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:39.370247 (+ 2023us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:39.370800 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:39.370803 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:39.370805 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:39.370895 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:39.371337 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:39.371345 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:39.371348 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:39.371638 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:39.371760 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:39.372636 (+ 876us) server_negotiation.cc:299] Negotiation successful
0811 15:03:39.372857 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 15:03:39.374172 24727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:39.358614 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:35483 (local address 127.19.236.65:35075)
0811 15:03:39.359117 (+ 503us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:39.359160 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:39.361112 (+ 1952us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:39.361720 (+ 608us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:39.361732 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:39.362210 (+ 478us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:39.362707 (+ 497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:39.362720 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:39.363859 (+ 1139us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:39.363862 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:39.364920 (+ 1058us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:39.364929 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:39.365672 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:39.365675 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:39.365836 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:39.366488 (+ 652us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:03:39.366506 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:39.367984 (+ 1478us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:39.370385 (+ 2401us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:39.370391 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:39.370408 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:39.370685 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:39.371000 (+ 315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:39.371003 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:39.371005 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:39.371156 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:39.371789 (+ 633us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:39.371799 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:39.372194 (+ 395us) client_negotiation.cc:769] Sending connection context
0811 15:03:39.372463 (+ 269us) client_negotiation.cc:240] Negotiation successful
0811 15:03:39.372913 (+ 450us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":307,"thread_start_us":142,"threads_started":1}
I20260811 15:03:39.377709 24725 heartbeater.cc:347] Connected to a master server at 127.19.236.126:35483
I20260811 15:03:39.377977 24725 heartbeater.cc:464] Registering TS with master...
I20260811 15:03:39.378587 24725 heartbeater.cc:511] Master 127.19.236.126:35483 requested a full tablet report, sending...
I20260811 15:03:39.380316 24508 ts_manager.cc:194] Registered new tserver with Master: aab00de512174c42bb29229024cc320d (127.19.236.65:45649)
I20260811 15:03:39.381942 24508 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.236.65@KRBTEST.COM'} at 127.19.236.65:35075
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.236.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.66.keytab.
Entry for principal kudu/127.19.236.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.66.keytab.
I20260811 15:03:39.398856 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.66:0
--local_ip_for_outbound_sockets=127.19.236.66
--webserver_interface=127.19.236.66
--webserver_port=0
--tserver_master_addrs=127.19.236.126:35483
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.66.keytab
--principal=kudu/127.19.236.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:40483
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:03:39.521584 24731 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:03:39.521868 24731 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:03:39.521912 24731 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:03:39.526224 24731 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:03:39.526304 24731 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:03:39.526368 24731 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.66
I20260811 15:03:39.531957 24731 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:40483
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.66.keytab
--principal=kudu/127.19.236.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.236.66
--webserver_port=0
--tserver_master_addrs=127.19.236.126:35483
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24731
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.66
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:03:39.533210 24731 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:03:39.534264 24731 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:03:39.544184 24737 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:39.544184 24740 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:39.544327 24731 server_base.cc:1034] running on GCE node
W20260811 15:03:39.544507 24738 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:39.544981 24731 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:03:39.545627 24731 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:03:39.546784 24731 hybrid_clock.cc:648] HybridClock initialized: now 1786460619546766 us; error 31 us; skew 500 ppm
Aug 11 15:03:39 dist-test-slave-8n49 krb5kdc[24456](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460619, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:03:39.549644 24731 init.cc:377] Logged in from keytab as kudu/127.19.236.66@KRBTEST.COM (short username kudu)
I20260811 15:03:39.550566 24731 webserver.cc:460] Webserver started at http://127.19.236.66:43711/ using document root <none> and password file <none>
I20260811 15:03:39.551159 24731 fs_manager.cc:359] Metadata directory not provided
I20260811 15:03:39.551251 24731 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:03:39.551497 24731 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:03:39.553654 24731 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/minicluster-data/ts-1/data/instance:
uuid: "ad672cdf150c49038e3424eba017edfa"
format_stamp: "Formatted at 2026-08-11 15:03:39 on dist-test-slave-8n49"
server_key: "89c13c728ea32490b90f1b0211eed1e9"
server_key_iv: "c495a02103e062aa9b58c2d70c09ee30"
server_key_version: "encryptionkey@0"
I20260811 15:03:39.554229 24731 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/minicluster-data/ts-1/wal/instance:
uuid: "ad672cdf150c49038e3424eba017edfa"
format_stamp: "Formatted at 2026-08-11 15:03:39 on dist-test-slave-8n49"
server_key: "89c13c728ea32490b90f1b0211eed1e9"
server_key_iv: "c495a02103e062aa9b58c2d70c09ee30"
server_key_version: "encryptionkey@0"
I20260811 15:03:39.558128 24731 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 15:03:39.560814 24749 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:39.562640 24731 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 15:03:39.562834 24731 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/minicluster-data/ts-1/wal
uuid: "ad672cdf150c49038e3424eba017edfa"
format_stamp: "Formatted at 2026-08-11 15:03:39 on dist-test-slave-8n49"
server_key: "89c13c728ea32490b90f1b0211eed1e9"
server_key_iv: "c495a02103e062aa9b58c2d70c09ee30"
server_key_version: "encryptionkey@0"
I20260811 15:03:39.562978 24731 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:03:39.578384 24731 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:03:39.581772 24731 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:03:39.582010 24731 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:03:39.582669 24731 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:03:39.583540 24731 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:03:39.583613 24731 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:39.583688 24731 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:03:39.583737 24731 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:39.593819 24731 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.66:39915
I20260811 15:03:39.593842 24887 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.66:39915 every 8 connection(s)
I20260811 15:03:39.594851 24731 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
I20260811 15:03:39.596771 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 24731
I20260811 15:03:39.596930 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/minicluster-data/ts-1/wal/instance
I20260811 15:03:39.597483 20401 external_mini_cluster.cc:1428] Setting key a3eb1658a4890eba932531283bc4fbc3
Aug 11 15:03:39 dist-test-slave-8n49 krb5kdc[24456](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460619, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.66@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.19.236.67@KRBTEST.COM; defaulting to no policy
I20260811 15:03:39.610365 24551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:39.598073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.66:48873 (local address 127.19.236.126:35483)
0811 15:03:39.598231 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:39.598236 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:39.598253 (+ 17us) server_negotiation.cc:407] Connection header received
0811 15:03:39.600057 (+ 1804us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:39.600063 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:39.600129 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:39.600223 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:39.601517 (+ 1294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:39.602051 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:39.603217 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:39.603452 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:39.603562 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:39.606259 (+ 2697us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:39.606264 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:39.606267 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:39.606300 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:39.608079 (+ 1779us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:39.608721 (+ 642us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:39.608725 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:39.608727 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:39.608825 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:39.609199 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:39.609202 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:39.609203 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:39.609398 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:39.609544 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:39.610124 (+ 580us) server_negotiation.cc:299] Negotiation successful
0811 15:03:39.610235 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260811 15:03:39.611301 24890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:39.597372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:35483 (local address 127.19.236.66:48873)
0811 15:03:39.598097 (+ 725us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:39.598155 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:39.599822 (+ 1667us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:39.600398 (+ 576us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:39.600404 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:39.600845 (+ 441us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:39.601346 (+ 501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:39.601359 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:39.602188 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:39.602197 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:39.603076 (+ 879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:39.603085 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:39.603620 (+ 535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:39.603624 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:39.603803 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:39.604539 (+ 736us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:03:39.604586 (+ 47us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:39.606057 (+ 1471us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:39.608236 (+ 2179us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:39.608241 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:39.608255 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:39.608543 (+ 288us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:39.608938 (+ 395us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:39.608941 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:39.608942 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:39.609093 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:39.609581 (+ 488us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:39.609591 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:39.609869 (+ 278us) client_negotiation.cc:769] Sending connection context
0811 15:03:39.610037 (+ 168us) client_negotiation.cc:240] Negotiation successful
0811 15:03:39.610308 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":487,"thread_start_us":193,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.236.67@KRBTEST.COM" created.
I20260811 15:03:39.612782 24888 heartbeater.cc:347] Connected to a master server at 127.19.236.126:35483
I20260811 15:03:39.613066 24888 heartbeater.cc:464] Registering TS with master...
I20260811 15:03:39.613673 24888 heartbeater.cc:511] Master 127.19.236.126:35483 requested a full tablet report, sending...
I20260811 15:03:39.614888 24508 ts_manager.cc:194] Registered new tserver with Master: ad672cdf150c49038e3424eba017edfa (127.19.236.66:39915)
I20260811 15:03:39.615794 24508 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.236.66@KRBTEST.COM'} at 127.19.236.66:48873
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.236.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.67.keytab.
Entry for principal kudu/127.19.236.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.67.keytab.
I20260811 15:03:39.628173 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.67:0
--local_ip_for_outbound_sockets=127.19.236.67
--webserver_interface=127.19.236.67
--webserver_port=0
--tserver_master_addrs=127.19.236.126:35483
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.67.keytab
--principal=kudu/127.19.236.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:40483
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:03:39.747247 24893 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:03:39.747591 24893 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:03:39.747671 24893 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:03:39.751892 24893 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:03:39.751994 24893 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:03:39.752092 24893 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.67
I20260811 15:03:39.757731 24893 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:40483
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.67.keytab
--principal=kudu/127.19.236.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.236.67
--webserver_port=0
--tserver_master_addrs=127.19.236.126:35483
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24893
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.67
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:03:39.758893 24893 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:03:39.759970 24893 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:03:39.770525 24903 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:39.770500 24899 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:39.770506 24893 server_base.cc:1034] running on GCE node
W20260811 15:03:39.770820 24900 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:39.771258 24893 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:03:39.771942 24893 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:03:39.773159 24893 hybrid_clock.cc:648] HybridClock initialized: now 1786460619773132 us; error 39 us; skew 500 ppm
Aug 11 15:03:39 dist-test-slave-8n49 krb5kdc[24456](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460619, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:03:39.776180 24893 init.cc:377] Logged in from keytab as kudu/127.19.236.67@KRBTEST.COM (short username kudu)
I20260811 15:03:39.777287 24893 webserver.cc:460] Webserver started at http://127.19.236.67:39835/ using document root <none> and password file <none>
I20260811 15:03:39.777968 24893 fs_manager.cc:359] Metadata directory not provided
I20260811 15:03:39.778074 24893 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:03:39.778342 24893 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:03:39.780758 24893 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/minicluster-data/ts-2/data/instance:
uuid: "896d157a9b614b589d6776ed64815de0"
format_stamp: "Formatted at 2026-08-11 15:03:39 on dist-test-slave-8n49"
server_key: "a6d9b0ea110ddb9a2ead64f3fd697c30"
server_key_iv: "ac19369db7b611b152e90339744ae404"
server_key_version: "encryptionkey@0"
I20260811 15:03:39.781407 24893 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/minicluster-data/ts-2/wal/instance:
uuid: "896d157a9b614b589d6776ed64815de0"
format_stamp: "Formatted at 2026-08-11 15:03:39 on dist-test-slave-8n49"
server_key: "a6d9b0ea110ddb9a2ead64f3fd697c30"
server_key_iv: "ac19369db7b611b152e90339744ae404"
server_key_version: "encryptionkey@0"
I20260811 15:03:39.785682 24893 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 15:03:39.788407 24911 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:39.789785 24893 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 15:03:39.789961 24893 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/minicluster-data/ts-2/wal
uuid: "896d157a9b614b589d6776ed64815de0"
format_stamp: "Formatted at 2026-08-11 15:03:39 on dist-test-slave-8n49"
server_key: "a6d9b0ea110ddb9a2ead64f3fd697c30"
server_key_iv: "ac19369db7b611b152e90339744ae404"
server_key_version: "encryptionkey@0"
I20260811 15:03:39.790093 24893 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:03:39.824393 24893 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:03:39.828167 24893 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:03:39.828414 24893 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:03:39.829134 24893 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:03:39.830291 24893 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:03:39.830364 24893 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:39.830433 24893 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:03:39.830466 24893 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:39.839313 24893 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.67:34859
I20260811 15:03:39.839332 25037 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.67:34859 every 8 connection(s)
I20260811 15:03:39.840247 24893 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
I20260811 15:03:39.846465 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 24893
I20260811 15:03:39.846617 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786460596631409-20401-0/minicluster-data/ts-2/wal/instance
I20260811 15:03:39.846916 20401 external_mini_cluster.cc:1428] Setting key 8cf39ac03b27f1b004874ed9d743561a
Aug 11 15:03:39 dist-test-slave-8n49 krb5kdc[24456](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460619, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.67@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
I20260811 15:03:39.855120 24551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:39.842433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.67:41377 (local address 127.19.236.126:35483)
0811 15:03:39.842598 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:39.842602 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:39.843435 (+ 833us) server_negotiation.cc:407] Connection header received
0811 15:03:39.844986 (+ 1551us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:39.844990 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:39.845051 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:39.845133 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:39.846438 (+ 1305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:39.847160 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:39.848669 (+ 1509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:39.848902 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:39.849023 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:39.851608 (+ 2585us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:39.851612 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:39.851614 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:39.851640 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:39.853144 (+ 1504us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:39.853687 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:39.853689 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:39.853691 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:39.853766 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:39.854086 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:39.854088 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:39.854090 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:39.854268 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:39.854343 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:39.854888 (+ 545us) server_negotiation.cc:299] Negotiation successful
0811 15:03:39.854995 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260811 15:03:39.856024 25041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:39.842774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:35483 (local address 127.19.236.67:41377)
0811 15:03:39.843275 (+ 501us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:39.843319 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:39.844765 (+ 1446us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:39.845304 (+ 539us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:39.845311 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:39.845764 (+ 453us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:39.846281 (+ 517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:39.846295 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:39.847293 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:39.847302 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:39.848494 (+ 1192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:39.848504 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:39.849074 (+ 570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:39.849078 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:39.849262 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:39.849819 (+ 557us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:03:39.849847 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:39.851425 (+ 1578us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:39.853278 (+ 1853us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:39.853283 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:39.853298 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:39.853585 (+ 287us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:39.853852 (+ 267us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:39.853855 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:39.853856 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:39.854000 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:39.854390 (+ 390us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:39.854395 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:39.854663 (+ 268us) client_negotiation.cc:769] Sending connection context
0811 15:03:39.854839 (+ 176us) client_negotiation.cc:240] Negotiation successful
0811 15:03:39.855115 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":306,"thread_start_us":131,"threads_started":1}
I20260811 15:03:39.857442 25039 heartbeater.cc:347] Connected to a master server at 127.19.236.126:35483
I20260811 15:03:39.857722 25039 heartbeater.cc:464] Registering TS with master...
I20260811 15:03:39.858264 25039 heartbeater.cc:511] Master 127.19.236.126:35483 requested a full tablet report, sending...
I20260811 15:03:39.859479 24508 ts_manager.cc:194] Registered new tserver with Master: 896d157a9b614b589d6776ed64815de0 (127.19.236.67:34859)
I20260811 15:03:39.860248 24508 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.236.67@KRBTEST.COM'} at 127.19.236.67:41377
I20260811 15:03:39.861171 20401 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 15:03:39 dist-test-slave-8n49 krb5kdc[24456](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460619, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 15:03:39 dist-test-slave-8n49 krb5kdc[24456](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460619, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.236.65@KRBTEST.COM
I20260811 15:03:39.888484 25047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:39.879099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59056 (local address 127.19.236.65:45649)
0811 15:03:39.879431 (+ 332us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:39.879438 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:39.879467 (+ 29us) server_negotiation.cc:407] Connection header received
0811 15:03:39.879518 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:39.879523 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:39.879725 (+ 202us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:39.879852 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:39.880516 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:39.881384 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:39.882175 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:39.882533 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:39.882622 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:39.885023 (+ 2401us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:39.885032 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:39.885046 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:39.885070 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:39.886609 (+ 1539us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:39.887073 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:39.887078 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:39.887079 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:39.887156 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:39.887466 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:39.887468 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:39.887469 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:39.887708 (+ 239us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:39.887861 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:39.888111 (+ 250us) server_negotiation.cc:299] Negotiation successful
0811 15:03:39.888271 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":218,"thread_start_us":106,"threads_started":1}
Aug 11 15:03:39 dist-test-slave-8n49 krb5kdc[24456](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460619, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
I20260811 15:03:39.900732 24551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:39.891657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45248 (local address 127.19.236.126:35483)
0811 15:03:39.891846 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:39.891850 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:39.891865 (+ 15us) server_negotiation.cc:407] Connection header received
0811 15:03:39.891905 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:39.891907 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:39.891946 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:39.892022 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:39.892770 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:39.893380 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:39.894232 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:39.894536 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:39.894627 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:39.897288 (+ 2661us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:39.897291 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:39.897293 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:39.897319 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:39.898952 (+ 1633us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:39.899380 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:39.899384 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:39.899386 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:39.899475 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:39.899786 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:39.899789 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:39.899790 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:39.900044 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:39.900149 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:39.900371 (+ 222us) server_negotiation.cc:299] Negotiation successful
0811 15:03:39.900479 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
W20260811 15:03:39.901185 24508 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45248
I20260811 15:03:39.901846 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 24575
I20260811 15:03:39.915138 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 24731
I20260811 15:03:39.923062 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 24893
I20260811 15:03:39.933192 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 24472
2026-08-11T15:03:39Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (2302 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 15:03:39 dist-test-slave-8n49 krb5kdc[25053](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 15:03:39 dist-test-slave-8n49 krb5kdc[25053](info): set up 2 sockets
Aug 11 15:03:39 dist-test-slave-8n49 krb5kdc[25053](info): commencing operation
krb5kdc: starting...
W20260811 15:03:41.071887 20401 mini_kdc.cc:121] Time spent starting KDC: real 1.115s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/krb5kdc/test-user.keytab.
Aug 11 15:03:41 dist-test-slave-8n49 krb5kdc[25053](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460621, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T15:03:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T15:03:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.236.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.236.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.236.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab.
Entry for principal kudu/127.19.236.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab.
I20260811 15:03:41.200939 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:40201
--webserver_interface=127.19.236.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab
--principal=kudu/127.19.236.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:39901
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.236.126:40201
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:03:41.314164 25068 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:03:41.314481 25068 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:03:41.314560 25068 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:03:41.318639 25068 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:03:41.318723 25068 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:03:41.318761 25068 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:03:41.318822 25068 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:03:41.318863 25068 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:03:41.324074 25068 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:39901
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.236.126:40201
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab
--principal=kudu/127.19.236.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:40201
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.236.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25068
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:03:41.325266 25068 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:03:41.326325 25068 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:03:41.334982 25074 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:41.335105 25068 server_base.cc:1034] running on GCE node
W20260811 15:03:41.335214 25077 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:41.335006 25075 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:41.335839 25068 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:03:41.337116 25068 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:03:41.338337 25068 hybrid_clock.cc:648] HybridClock initialized: now 1786460621338308 us; error 39 us; skew 500 ppm
Aug 11 15:03:41 dist-test-slave-8n49 krb5kdc[25053](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460621, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:03:41.341401 25068 init.cc:377] Logged in from keytab as kudu/127.19.236.126@KRBTEST.COM (short username kudu)
I20260811 15:03:41.342213 25068 fs_manager.cc:359] Metadata directory not provided
I20260811 15:03:41.342314 25068 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:03:41.342569 25068 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:03:41.344784 25068 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/minicluster-data/master-0/data/instance:
uuid: "b5bac956451c4039bd5937d557f2c684"
format_stamp: "Formatted at 2026-08-11 15:03:41 on dist-test-slave-8n49"
server_key: "7327fb305f809ac9662eab31c0ec6902"
server_key_iv: "9a7a6571687f32d4e5a4fc7de56a51a9"
server_key_version: "encryptionkey@0"
I20260811 15:03:41.345382 25068 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/minicluster-data/master-0/wal/instance:
uuid: "b5bac956451c4039bd5937d557f2c684"
format_stamp: "Formatted at 2026-08-11 15:03:41 on dist-test-slave-8n49"
server_key: "7327fb305f809ac9662eab31c0ec6902"
server_key_iv: "9a7a6571687f32d4e5a4fc7de56a51a9"
server_key_version: "encryptionkey@0"
I20260811 15:03:41.349323 25068 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260811 15:03:41.351722 25084 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:41.353029 25068 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 15:03:41.353174 25068 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/minicluster-data/master-0/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/minicluster-data/master-0/wal
uuid: "b5bac956451c4039bd5937d557f2c684"
format_stamp: "Formatted at 2026-08-11 15:03:41 on dist-test-slave-8n49"
server_key: "7327fb305f809ac9662eab31c0ec6902"
server_key_iv: "9a7a6571687f32d4e5a4fc7de56a51a9"
server_key_version: "encryptionkey@0"
I20260811 15:03:41.353292 25068 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:03:41.369673 25068 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:03:41.373492 25068 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:03:41.373724 25068 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:03:41.381793 25068 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.126:40201
I20260811 15:03:41.382083 25142 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.126:40201 every 8 connection(s)
I20260811 15:03:41.382506 25068 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
I20260811 15:03:41.385416 25143 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:03:41.387898 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 25068
I20260811 15:03:41.388057 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/minicluster-data/master-0/wal/instance
I20260811 15:03:41.388330 20401 external_mini_cluster.cc:1428] Setting key 590dd11a75aab0e34c04811beac64328
I20260811 15:03:41.391422 25143 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b5bac956451c4039bd5937d557f2c684: Bootstrap starting.
I20260811 15:03:41.393791 25143 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b5bac956451c4039bd5937d557f2c684: Neither blocks nor log segments found. Creating new log.
I20260811 15:03:41.394548 25143 log.cc:824] T 00000000000000000000000000000000 P b5bac956451c4039bd5937d557f2c684: Log is configured to *not* fsync() on all Append() calls
I20260811 15:03:41.396430 25143 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b5bac956451c4039bd5937d557f2c684: No bootstrap required, opened a new log
Aug 11 15:03:41 dist-test-slave-8n49 krb5kdc[25053](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460621, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
I20260811 15:03:41.399454 25143 raft_consensus.cc:348] T 00000000000000000000000000000000 P b5bac956451c4039bd5937d557f2c684 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5bac956451c4039bd5937d557f2c684" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 40201 } }
I20260811 15:03:41.399703 25143 raft_consensus.cc:374] T 00000000000000000000000000000000 P b5bac956451c4039bd5937d557f2c684 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:03:41.399785 25143 raft_consensus.cc:729] T 00000000000000000000000000000000 P b5bac956451c4039bd5937d557f2c684 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5bac956451c4039bd5937d557f2c684, State: Initialized, Role: FOLLOWER
I20260811 15:03:41.400275 25143 consensus_queue.cc:260] T 00000000000000000000000000000000 P b5bac956451c4039bd5937d557f2c684 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5bac956451c4039bd5937d557f2c684" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 40201 } }
I20260811 15:03:41.400430 25143 raft_consensus.cc:388] T 00000000000000000000000000000000 P b5bac956451c4039bd5937d557f2c684 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 15:03:41.400522 25143 raft_consensus.cc:482] T 00000000000000000000000000000000 P b5bac956451c4039bd5937d557f2c684 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 15:03:41.400650 25143 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b5bac956451c4039bd5937d557f2c684 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:03:41.401563 25143 raft_consensus.cc:504] T 00000000000000000000000000000000 P b5bac956451c4039bd5937d557f2c684 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5bac956451c4039bd5937d557f2c684" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 40201 } }
I20260811 15:03:41.401959 25143 leader_election.cc:302] T 00000000000000000000000000000000 P b5bac956451c4039bd5937d557f2c684 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b5bac956451c4039bd5937d557f2c684; no voters:
I20260811 15:03:41.402335 25143 leader_election.cc:288] T 00000000000000000000000000000000 P b5bac956451c4039bd5937d557f2c684 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 15:03:41.402526 25149 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b5bac956451c4039bd5937d557f2c684 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:03:41.402832 25149 raft_consensus.cc:686] T 00000000000000000000000000000000 P b5bac956451c4039bd5937d557f2c684 [term 1 LEADER]: Becoming Leader. State: Replica: b5bac956451c4039bd5937d557f2c684, State: Running, Role: LEADER
I20260811 15:03:41.403163 25149 consensus_queue.cc:237] T 00000000000000000000000000000000 P b5bac956451c4039bd5937d557f2c684 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5bac956451c4039bd5937d557f2c684" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 40201 } }
I20260811 15:03:41.403589 25147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:41.389839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48292 (local address 127.19.236.126:40201)
0811 15:03:41.390305 (+ 466us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:41.390320 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:41.390357 (+ 37us) server_negotiation.cc:407] Connection header received
0811 15:03:41.390963 (+ 606us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:41.390980 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:41.391303 (+ 323us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:41.391650 (+ 347us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:41.392545 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:41.393590 (+ 1045us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:41.394549 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:41.395060 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:41.395233 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:41.397773 (+ 2540us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:41.397778 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:41.397791 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:41.397818 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:41.400221 (+ 2403us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:41.400804 (+ 583us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:41.400809 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:41.400814 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:41.400925 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:41.401232 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:41.401235 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:41.401237 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:41.401680 (+ 443us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:41.401880 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:41.402233 (+ 353us) server_negotiation.cc:299] Negotiation successful
0811 15:03:41.402601 (+ 368us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":300,"thread_start_us":144,"threads_started":1}
I20260811 15:03:41.403636 25143 sys_catalog.cc:564] T 00000000000000000000000000000000 P b5bac956451c4039bd5937d557f2c684 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:03:41.404378 25149 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5bac956451c4039bd5937d557f2c684 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b5bac956451c4039bd5937d557f2c684. Latest consensus state: current_term: 1 leader_uuid: "b5bac956451c4039bd5937d557f2c684" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5bac956451c4039bd5937d557f2c684" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 40201 } } }
I20260811 15:03:41.404512 25149 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5bac956451c4039bd5937d557f2c684 [sys.catalog]: This master's current role is: LEADER
I20260811 15:03:41.404876 25150 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5bac956451c4039bd5937d557f2c684 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b5bac956451c4039bd5937d557f2c684" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5bac956451c4039bd5937d557f2c684" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 40201 } } }
I20260811 15:03:41.404965 25150 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5bac956451c4039bd5937d557f2c684 [sys.catalog]: This master's current role is: LEADER
I20260811 15:03:41.405795 25156 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:03:41.409054 25156 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:03:41.415587 25156 catalog_manager.cc:1347] Generated new cluster ID: d442e42be929402cb990010818be8f95
I20260811 15:03:41.415688 25156 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:03:41.422981 25156 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 15:03:41.424216 25156 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:03:41.442185 25156 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b5bac956451c4039bd5937d557f2c684: Generated new TSK 0
I20260811 15:03:41.443153 25156 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.236.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.236.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.236.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.65.keytab.
Entry for principal kudu/127.19.236.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.65.keytab.
I20260811 15:03:41.477918 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.65:0
--local_ip_for_outbound_sockets=127.19.236.65
--webserver_interface=127.19.236.65
--webserver_port=0
--tserver_master_addrs=127.19.236.126:40201
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.65.keytab
--principal=kudu/127.19.236.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:39901
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:03:41.595153 25171 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:03:41.595433 25171 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:03:41.595480 25171 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:03:41.599640 25171 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:03:41.599707 25171 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:03:41.599807 25171 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.65
I20260811 15:03:41.605640 25171 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:39901
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.65.keytab
--principal=kudu/127.19.236.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.236.65
--webserver_port=0
--tserver_master_addrs=127.19.236.126:40201
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25171
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.65
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:03:41.606902 25171 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:03:41.608002 25171 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:03:41.617875 25178 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:41.617842 25180 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:41.617865 25177 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:41.618285 25171 server_base.cc:1034] running on GCE node
I20260811 15:03:41.618710 25171 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:03:41.619362 25171 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:03:41.620537 25171 hybrid_clock.cc:648] HybridClock initialized: now 1786460621620520 us; error 29 us; skew 500 ppm
Aug 11 15:03:41 dist-test-slave-8n49 krb5kdc[25053](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460621, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:03:41.623488 25171 init.cc:377] Logged in from keytab as kudu/127.19.236.65@KRBTEST.COM (short username kudu)
I20260811 15:03:41.624302 25171 fs_manager.cc:359] Metadata directory not provided
I20260811 15:03:41.624402 25171 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:03:41.624711 25171 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:03:41.627151 25171 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/minicluster-data/ts-0/data/instance:
uuid: "76727b1c53bb49b38f8f7300cabb45d0"
format_stamp: "Formatted at 2026-08-11 15:03:41 on dist-test-slave-8n49"
server_key: "d21f13b5ae9e105808f9272d7aaedd6f"
server_key_iv: "e2561caf0505f71d46175b83373c0bbf"
server_key_version: "encryptionkey@0"
I20260811 15:03:41.627769 25171 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/minicluster-data/ts-0/wal/instance:
uuid: "76727b1c53bb49b38f8f7300cabb45d0"
format_stamp: "Formatted at 2026-08-11 15:03:41 on dist-test-slave-8n49"
server_key: "d21f13b5ae9e105808f9272d7aaedd6f"
server_key_iv: "e2561caf0505f71d46175b83373c0bbf"
server_key_version: "encryptionkey@0"
I20260811 15:03:41.631902 25171 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260811 15:03:41.634876 25187 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:41.636341 25171 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 15:03:41.636508 25171 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/minicluster-data/ts-0/wal
uuid: "76727b1c53bb49b38f8f7300cabb45d0"
format_stamp: "Formatted at 2026-08-11 15:03:41 on dist-test-slave-8n49"
server_key: "d21f13b5ae9e105808f9272d7aaedd6f"
server_key_iv: "e2561caf0505f71d46175b83373c0bbf"
server_key_version: "encryptionkey@0"
I20260811 15:03:41.636695 25171 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:03:41.649984 25171 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:03:41.653625 25171 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:03:41.653836 25171 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:03:41.654454 25171 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:03:41.655488 25171 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:03:41.655577 25171 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:41.655653 25171 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:03:41.655704 25171 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:41.665377 25171 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.65:42435
I20260811 15:03:41.665468 25313 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.65:42435 every 8 connection(s)
I20260811 15:03:41.666026 25171 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
I20260811 15:03:41.675931 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 25171
I20260811 15:03:41.676077 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/minicluster-data/ts-0/wal/instance
I20260811 15:03:41.676425 20401 external_mini_cluster.cc:1428] Setting key f835399f84b43a7222d30d075084f745
Aug 11 15:03:41 dist-test-slave-8n49 krb5kdc[25053](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460621, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.65@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
I20260811 15:03:41.682648 25147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:41.668790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.65:55119 (local address 127.19.236.126:40201)
0811 15:03:41.668956 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:41.668961 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:41.670187 (+ 1226us) server_negotiation.cc:407] Connection header received
0811 15:03:41.671096 (+ 909us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:41.671099 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:41.671150 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:41.671243 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:41.673052 (+ 1809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:41.673777 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:41.675140 (+ 1363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:41.675428 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:41.675535 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:41.678997 (+ 3462us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:41.679001 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:41.679004 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:41.679036 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:41.680511 (+ 1475us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:41.681088 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:41.681092 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:41.681093 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:41.681178 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:41.681532 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:41.681535 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:41.681537 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:41.681728 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:41.681839 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:41.682356 (+ 517us) server_negotiation.cc:299] Negotiation successful
0811 15:03:41.682485 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 15:03:41.683490 25316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:41.669178 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:40201 (local address 127.19.236.65:55119)
0811 15:03:41.670039 (+ 861us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:41.670080 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:41.670877 (+ 797us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:41.671565 (+ 688us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:41.671581 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:41.672103 (+ 522us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:41.672771 (+ 668us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:41.672789 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:41.673972 (+ 1183us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:41.673976 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:41.674969 (+ 993us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:41.674982 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:41.675741 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:41.675747 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:41.675991 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:41.676930 (+ 939us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:03:41.676947 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:41.678822 (+ 1875us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:41.680697 (+ 1875us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:41.680703 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:41.680717 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:41.680977 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:41.681274 (+ 297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:41.681278 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:41.681280 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:41.681428 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:41.681838 (+ 410us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:41.681846 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:41.682109 (+ 263us) client_negotiation.cc:769] Sending connection context
0811 15:03:41.682296 (+ 187us) client_negotiation.cc:240] Negotiation successful
0811 15:03:41.682643 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":305,"thread_start_us":126,"threads_started":1}
I20260811 15:03:41.684830 25314 heartbeater.cc:347] Connected to a master server at 127.19.236.126:40201
I20260811 15:03:41.685094 25314 heartbeater.cc:464] Registering TS with master...
I20260811 15:03:41.685561 25314 heartbeater.cc:511] Master 127.19.236.126:40201 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.19.236.66@KRBTEST.COM; defaulting to no policy
I20260811 15:03:41.687201 25103 ts_manager.cc:194] Registered new tserver with Master: 76727b1c53bb49b38f8f7300cabb45d0 (127.19.236.65:42435)
I20260811 15:03:41.688359 25103 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.236.65@KRBTEST.COM'} at 127.19.236.65:55119
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.236.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.236.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.66.keytab.
Entry for principal kudu/127.19.236.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.66.keytab.
I20260811 15:03:41.705592 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.66:0
--local_ip_for_outbound_sockets=127.19.236.66
--webserver_interface=127.19.236.66
--webserver_port=0
--tserver_master_addrs=127.19.236.126:40201
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.66.keytab
--principal=kudu/127.19.236.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:39901
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:03:41.821369 25319 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:03:41.821624 25319 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:03:41.821667 25319 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:03:41.825660 25319 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:03:41.825722 25319 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:03:41.825783 25319 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.66
I20260811 15:03:41.831043 25319 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:39901
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.66.keytab
--principal=kudu/127.19.236.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.236.66
--webserver_port=0
--tserver_master_addrs=127.19.236.126:40201
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25319
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.66
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:03:41.832111 25319 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:03:41.833140 25319 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:03:41.842877 25325 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:41.842888 25326 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:41.843117 25319 server_base.cc:1034] running on GCE node
W20260811 15:03:41.843209 25329 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:41.843693 25319 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:03:41.844388 25319 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:03:41.845598 25319 hybrid_clock.cc:648] HybridClock initialized: now 1786460621845565 us; error 43 us; skew 500 ppm
Aug 11 15:03:41 dist-test-slave-8n49 krb5kdc[25053](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460621, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:03:41.854182 25319 init.cc:377] Logged in from keytab as kudu/127.19.236.66@KRBTEST.COM (short username kudu)
I20260811 15:03:41.855016 25319 fs_manager.cc:359] Metadata directory not provided
I20260811 15:03:41.855113 25319 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:03:41.855342 25319 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:03:41.857607 25319 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/minicluster-data/ts-1/data/instance:
uuid: "84736736e2c941ba8bb04ff5d7daad80"
format_stamp: "Formatted at 2026-08-11 15:03:41 on dist-test-slave-8n49"
server_key: "6f8d1b9b0746189b9958ea3f62c20d8f"
server_key_iv: "816b7c2cfb1da341605ec2f4378c6509"
server_key_version: "encryptionkey@0"
I20260811 15:03:41.858208 25319 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/minicluster-data/ts-1/wal/instance:
uuid: "84736736e2c941ba8bb04ff5d7daad80"
format_stamp: "Formatted at 2026-08-11 15:03:41 on dist-test-slave-8n49"
server_key: "6f8d1b9b0746189b9958ea3f62c20d8f"
server_key_iv: "816b7c2cfb1da341605ec2f4378c6509"
server_key_version: "encryptionkey@0"
I20260811 15:03:41.862120 25319 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 15:03:41.864813 25335 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:41.866003 25319 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 15:03:41.866142 25319 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/minicluster-data/ts-1/wal
uuid: "84736736e2c941ba8bb04ff5d7daad80"
format_stamp: "Formatted at 2026-08-11 15:03:41 on dist-test-slave-8n49"
server_key: "6f8d1b9b0746189b9958ea3f62c20d8f"
server_key_iv: "816b7c2cfb1da341605ec2f4378c6509"
server_key_version: "encryptionkey@0"
I20260811 15:03:41.866253 25319 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:03:41.884351 25319 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:03:41.887629 25319 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:03:41.887830 25319 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:03:41.888410 25319 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:03:41.889648 25319 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:03:41.889724 25319 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:41.889792 25319 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:03:41.889842 25319 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:41.899331 25319 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.66:39373
I20260811 15:03:41.899353 25461 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.66:39373 every 8 connection(s)
I20260811 15:03:41.899921 25319 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
I20260811 15:03:41.903380 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 25319
I20260811 15:03:41.903498 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/minicluster-data/ts-1/wal/instance
I20260811 15:03:41.903816 20401 external_mini_cluster.cc:1428] Setting key 45a731b12d6c32b1b372c01548e827a5
Aug 11 15:03:41 dist-test-slave-8n49 krb5kdc[25053](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460621, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.66@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.19.236.67@KRBTEST.COM; defaulting to no policy
I20260811 15:03:41.915203 25147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:41.901743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.66:53671 (local address 127.19.236.126:40201)
0811 15:03:41.901884 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:41.901893 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:41.903305 (+ 1412us) server_negotiation.cc:407] Connection header received
0811 15:03:41.904498 (+ 1193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:41.904502 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:41.904580 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:41.904667 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:41.906244 (+ 1577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:41.906776 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:41.908173 (+ 1397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:41.908574 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:41.908701 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:41.911509 (+ 2808us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:41.911512 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:41.911514 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:41.911539 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:41.913062 (+ 1523us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:41.913595 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:41.913598 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:41.913600 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:41.913686 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:41.914046 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:41.914050 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:41.914052 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:41.914239 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:41.914344 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:41.914895 (+ 551us) server_negotiation.cc:299] Negotiation successful
0811 15:03:41.915025 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 15:03:41.916146 25464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:41.902112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:40201 (local address 127.19.236.66:53671)
0811 15:03:41.903086 (+ 974us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:41.903165 (+ 79us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:41.904237 (+ 1072us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:41.904857 (+ 620us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:41.904866 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:41.905318 (+ 452us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:41.906080 (+ 762us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:41.906105 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:41.906903 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:41.906909 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:41.908043 (+ 1134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:41.908053 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:41.908723 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:41.908725 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:41.908964 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:41.909652 (+ 688us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:03:41.909678 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:41.911325 (+ 1647us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:41.913191 (+ 1866us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:41.913198 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:41.913213 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:41.913484 (+ 271us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:41.913788 (+ 304us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:41.913791 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:41.913793 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:41.913945 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:41.914358 (+ 413us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:41.914366 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:41.914628 (+ 262us) client_negotiation.cc:769] Sending connection context
0811 15:03:41.914847 (+ 219us) client_negotiation.cc:240] Negotiation successful
0811 15:03:41.915176 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":106,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.236.67@KRBTEST.COM" created.
I20260811 15:03:41.917382 25462 heartbeater.cc:347] Connected to a master server at 127.19.236.126:40201
I20260811 15:03:41.917608 25462 heartbeater.cc:464] Registering TS with master...
I20260811 15:03:41.918025 25462 heartbeater.cc:511] Master 127.19.236.126:40201 requested a full tablet report, sending...
I20260811 15:03:41.919123 25103 ts_manager.cc:194] Registered new tserver with Master: 84736736e2c941ba8bb04ff5d7daad80 (127.19.236.66:39373)
I20260811 15:03:41.919972 25103 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.236.66@KRBTEST.COM'} at 127.19.236.66:53671
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.236.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.67.keytab.
Entry for principal kudu/127.19.236.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.67.keytab.
I20260811 15:03:41.933063 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.67:0
--local_ip_for_outbound_sockets=127.19.236.67
--webserver_interface=127.19.236.67
--webserver_port=0
--tserver_master_addrs=127.19.236.126:40201
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.67.keytab
--principal=kudu/127.19.236.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:39901
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:03:42.047091 25467 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:03:42.047431 25467 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:03:42.047536 25467 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:03:42.051915 25467 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:03:42.052004 25467 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:03:42.052095 25467 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.67
I20260811 15:03:42.057652 25467 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:39901
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.67.keytab
--principal=kudu/127.19.236.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.236.67
--webserver_port=0
--tserver_master_addrs=127.19.236.126:40201
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25467
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.67
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:03:42.058791 25467 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:03:42.059893 25467 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:03:42.069554 25474 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:42.069540 25476 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:42.069579 25473 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:42.069854 25467 server_base.cc:1034] running on GCE node
I20260811 15:03:42.070330 25467 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:03:42.071003 25467 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:03:42.072204 25467 hybrid_clock.cc:648] HybridClock initialized: now 1786460622072185 us; error 36 us; skew 500 ppm
Aug 11 15:03:42 dist-test-slave-8n49 krb5kdc[25053](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460622, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:03:42.075122 25467 init.cc:377] Logged in from keytab as kudu/127.19.236.67@KRBTEST.COM (short username kudu)
I20260811 15:03:42.075879 25467 fs_manager.cc:359] Metadata directory not provided
I20260811 15:03:42.075986 25467 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:03:42.076234 25467 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:03:42.078405 25467 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/minicluster-data/ts-2/data/instance:
uuid: "1edd51fdf2b64069b7ae8c00293f7be2"
format_stamp: "Formatted at 2026-08-11 15:03:42 on dist-test-slave-8n49"
server_key: "202930816a3921d08155200e5bf31ec0"
server_key_iv: "c998fe28599e6369b79cf543c450f28b"
server_key_version: "encryptionkey@0"
I20260811 15:03:42.079006 25467 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/minicluster-data/ts-2/wal/instance:
uuid: "1edd51fdf2b64069b7ae8c00293f7be2"
format_stamp: "Formatted at 2026-08-11 15:03:42 on dist-test-slave-8n49"
server_key: "202930816a3921d08155200e5bf31ec0"
server_key_iv: "c998fe28599e6369b79cf543c450f28b"
server_key_version: "encryptionkey@0"
I20260811 15:03:42.082826 25467 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 15:03:42.085383 25482 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:42.086652 25467 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 15:03:42.086788 25467 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/minicluster-data/ts-2/wal
uuid: "1edd51fdf2b64069b7ae8c00293f7be2"
format_stamp: "Formatted at 2026-08-11 15:03:42 on dist-test-slave-8n49"
server_key: "202930816a3921d08155200e5bf31ec0"
server_key_iv: "c998fe28599e6369b79cf543c450f28b"
server_key_version: "encryptionkey@0"
I20260811 15:03:42.086921 25467 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:03:42.109798 25467 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:03:42.112926 25467 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:03:42.113128 25467 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:03:42.113714 25467 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:03:42.114549 25467 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:03:42.114619 25467 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:42.114691 25467 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:03:42.114741 25467 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:42.124277 25467 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.67:38581
I20260811 15:03:42.124294 25613 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.67:38581 every 8 connection(s)
I20260811 15:03:42.125021 25467 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
I20260811 15:03:42.130160 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 25467
I20260811 15:03:42.130331 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/minicluster-data/ts-2/wal/instance
I20260811 15:03:42.130731 20401 external_mini_cluster.cc:1428] Setting key 0a031aab40130bfaab7f0a2471d934ea
Aug 11 15:03:42 dist-test-slave-8n49 krb5kdc[25053](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460622, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.67@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
I20260811 15:03:42.139376 25147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:42.126875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.67:60593 (local address 127.19.236.126:40201)
0811 15:03:42.127069 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:42.127074 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:42.128308 (+ 1234us) server_negotiation.cc:407] Connection header received
0811 15:03:42.129265 (+ 957us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:42.129268 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:42.129316 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:42.129394 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:42.130640 (+ 1246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:42.131433 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:42.133107 (+ 1674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:42.133377 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:42.133470 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:42.135975 (+ 2505us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:42.135979 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:42.135981 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:42.136006 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:42.137570 (+ 1564us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:42.138045 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:42.138048 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:42.138049 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:42.138123 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:42.138437 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:42.138440 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:42.138441 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:42.138615 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:42.138692 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:42.139151 (+ 459us) server_negotiation.cc:299] Negotiation successful
0811 15:03:42.139252 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260811 15:03:42.140236 25617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:42.127289 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:40201 (local address 127.19.236.67:60593)
0811 15:03:42.128152 (+ 863us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:42.128195 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:42.129029 (+ 834us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:42.129557 (+ 528us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:42.129564 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:42.129903 (+ 339us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:42.130467 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:42.130484 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:42.131577 (+ 1093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:42.131581 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:42.132949 (+ 1368us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:42.132962 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:42.133516 (+ 554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:42.133520 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:42.133661 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:42.134245 (+ 584us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:03:42.134269 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:42.135770 (+ 1501us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:42.137684 (+ 1914us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:42.137689 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:42.137701 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:42.137945 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:42.138213 (+ 268us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:42.138215 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:42.138216 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:42.138354 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:42.138705 (+ 351us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:42.138710 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:42.138934 (+ 224us) client_negotiation.cc:769] Sending connection context
0811 15:03:42.139096 (+ 162us) client_negotiation.cc:240] Negotiation successful
0811 15:03:42.139342 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":310,"thread_start_us":115,"threads_started":1}
I20260811 15:03:42.141571 25614 heartbeater.cc:347] Connected to a master server at 127.19.236.126:40201
I20260811 15:03:42.141814 25614 heartbeater.cc:464] Registering TS with master...
I20260811 15:03:42.142271 25614 heartbeater.cc:511] Master 127.19.236.126:40201 requested a full tablet report, sending...
I20260811 15:03:42.143378 25103 ts_manager.cc:194] Registered new tserver with Master: 1edd51fdf2b64069b7ae8c00293f7be2 (127.19.236.67:38581)
I20260811 15:03:42.144302 25103 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.236.67@KRBTEST.COM'} at 127.19.236.67:60593
I20260811 15:03:42.145042 20401 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 15:03:42.154759 25147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:42.147198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48298 (local address 127.19.236.126:40201)
0811 15:03:42.147332 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:42.147336 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:42.147577 (+ 241us) server_negotiation.cc:407] Connection header received
0811 15:03:42.147674 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:42.147676 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:42.147715 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:42.147787 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:42.148492 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:42.149077 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:42.149984 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:42.150203 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:42.150300 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:42.151718 (+ 1418us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:42.151722 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:42.151724 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:42.151745 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:42.153238 (+ 1493us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:42.153690 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:42.153693 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:42.153694 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:42.153777 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:42.154025 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:42.154027 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:42.154028 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:42.154232 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:42.154335 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:42.154539 (+ 204us) server_negotiation.cc:299] Negotiation successful
0811 15:03:42.154646 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 15:03:42.157929 25102 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48298:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 15:03:42.161015 25102 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 15:03:42.174760 25627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:42.169224 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38970 (local address 127.19.236.65:42435)
0811 15:03:42.169546 (+ 322us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:42.169553 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:42.169738 (+ 185us) server_negotiation.cc:407] Connection header received
0811 15:03:42.170003 (+ 265us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:42.170011 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:42.170214 (+ 203us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:42.170375 (+ 161us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:03:42.170950 (+ 575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:42.171912 (+ 962us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:42.173428 (+ 1516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:42.173996 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:42.174127 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:42.174281 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:42.174502 (+ 221us) server_negotiation.cc:299] Negotiation successful
0811 15:03:42.174605 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":216,"thread_start_us":114,"threads_started":1}
I20260811 15:03:42.174755 25626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:42.169096 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.65:42435 (local address 127.0.0.1:38970)
0811 15:03:42.169575 (+ 479us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:42.169625 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:42.169773 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:42.170530 (+ 757us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:42.170536 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:42.170561 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:03:42.170781 (+ 220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:42.170789 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:42.172042 (+ 1253us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:42.172047 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:42.173296 (+ 1249us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:42.173307 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:42.174130 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:42.174134 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:42.174291 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:42.174339 (+ 48us) client_negotiation.cc:769] Sending connection context
0811 15:03:42.174469 (+ 130us) client_negotiation.cc:240] Negotiation successful
0811 15:03:42.174593 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172,"mutex_wait_us":1,"thread_start_us":78,"threads_started":1}
I20260811 15:03:42.175413 25628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:42.169867 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.67:38581 (local address 127.0.0.1:51116)
0811 15:03:42.170520 (+ 653us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:42.170535 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:42.170623 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:42.171353 (+ 730us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:42.171356 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:42.171375 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:03:42.171492 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:42.171499 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:42.172863 (+ 1364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:42.172866 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:42.174024 (+ 1158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:42.174034 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:42.175127 (+ 1093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:42.175130 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:42.175208 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:42.175225 (+ 17us) client_negotiation.cc:769] Sending connection context
0811 15:03:42.175273 (+ 48us) client_negotiation.cc:240] Negotiation successful
0811 15:03:42.175319 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":589,"mutex_wait_us":1,"thread_start_us":107,"threads_started":1}
I20260811 15:03:42.175544 25631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:42.170100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51116 (local address 127.19.236.67:38581)
0811 15:03:42.170937 (+ 837us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:42.170949 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:42.170969 (+ 20us) server_negotiation.cc:407] Connection header received
0811 15:03:42.171031 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:42.171035 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:42.171202 (+ 167us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:42.171356 (+ 154us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:03:42.171606 (+ 250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:42.172714 (+ 1108us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:42.174164 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:42.175031 (+ 867us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:42.175142 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:42.175270 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:42.175316 (+ 46us) server_negotiation.cc:299] Negotiation successful
0811 15:03:42.175392 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":745,"thread_start_us":172,"threads_started":1}
I20260811 15:03:42.177824 25632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:42.170188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.66:39373 (local address 127.0.0.1:33160)
0811 15:03:42.170629 (+ 441us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:42.170642 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:42.170712 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:42.171612 (+ 900us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:42.171614 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:42.171629 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:03:42.171704 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:42.171708 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:42.173447 (+ 1739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:42.173450 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:42.174616 (+ 1166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:42.174627 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:42.177435 (+ 2808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:42.177439 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:42.177535 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:42.177559 (+ 24us) client_negotiation.cc:769] Sending connection context
0811 15:03:42.177640 (+ 81us) client_negotiation.cc:240] Negotiation successful
0811 15:03:42.177705 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":387,"mutex_wait_us":59,"thread_start_us":100,"threads_started":1}
I20260811 15:03:42.177927 25634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:42.170582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33160 (local address 127.19.236.66:39373)
0811 15:03:42.170900 (+ 318us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:42.170914 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:42.170936 (+ 22us) server_negotiation.cc:407] Connection header received
0811 15:03:42.171013 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:42.171018 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:42.171203 (+ 185us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:42.171356 (+ 153us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:03:42.171812 (+ 456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:42.173306 (+ 1494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:42.174761 (+ 1455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:42.177297 (+ 2536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:42.177415 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:42.177554 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:42.177684 (+ 130us) server_negotiation.cc:299] Negotiation successful
0811 15:03:42.177776 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":219,"thread_start_us":124,"threads_started":1}
I20260811 15:03:42.177914 25240 tablet_service.cc:1467] Processing CreateTablet for tablet 269308705d764fc48846ee9288e6e684 (DEFAULT_TABLE table=test-table [id=8939664bcaf04e10b2e6d2a723b55fb8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:03:42.178442 25541 tablet_service.cc:1467] Processing CreateTablet for tablet 269308705d764fc48846ee9288e6e684 (DEFAULT_TABLE table=test-table [id=8939664bcaf04e10b2e6d2a723b55fb8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:03:42.179018 25240 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 269308705d764fc48846ee9288e6e684. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:03:42.179281 25541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 269308705d764fc48846ee9288e6e684. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:03:42.180462 25390 tablet_service.cc:1467] Processing CreateTablet for tablet 269308705d764fc48846ee9288e6e684 (DEFAULT_TABLE table=test-table [id=8939664bcaf04e10b2e6d2a723b55fb8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:03:42.181432 25390 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 269308705d764fc48846ee9288e6e684. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:03:42.185457 25635 tablet_bootstrap.cc:492] T 269308705d764fc48846ee9288e6e684 P 1edd51fdf2b64069b7ae8c00293f7be2: Bootstrap starting.
I20260811 15:03:42.187829 25635 tablet_bootstrap.cc:654] T 269308705d764fc48846ee9288e6e684 P 1edd51fdf2b64069b7ae8c00293f7be2: Neither blocks nor log segments found. Creating new log.
I20260811 15:03:42.187816 25638 tablet_bootstrap.cc:492] T 269308705d764fc48846ee9288e6e684 P 84736736e2c941ba8bb04ff5d7daad80: Bootstrap starting.
I20260811 15:03:42.188843 25636 tablet_bootstrap.cc:492] T 269308705d764fc48846ee9288e6e684 P 76727b1c53bb49b38f8f7300cabb45d0: Bootstrap starting.
I20260811 15:03:42.189103 25635 log.cc:824] T 269308705d764fc48846ee9288e6e684 P 1edd51fdf2b64069b7ae8c00293f7be2: Log is configured to *not* fsync() on all Append() calls
I20260811 15:03:42.189939 25638 tablet_bootstrap.cc:654] T 269308705d764fc48846ee9288e6e684 P 84736736e2c941ba8bb04ff5d7daad80: Neither blocks nor log segments found. Creating new log.
I20260811 15:03:42.190940 25636 tablet_bootstrap.cc:654] T 269308705d764fc48846ee9288e6e684 P 76727b1c53bb49b38f8f7300cabb45d0: Neither blocks nor log segments found. Creating new log.
I20260811 15:03:42.191210 25638 log.cc:824] T 269308705d764fc48846ee9288e6e684 P 84736736e2c941ba8bb04ff5d7daad80: Log is configured to *not* fsync() on all Append() calls
I20260811 15:03:42.191702 25636 log.cc:824] T 269308705d764fc48846ee9288e6e684 P 76727b1c53bb49b38f8f7300cabb45d0: Log is configured to *not* fsync() on all Append() calls
I20260811 15:03:42.191758 25635 tablet_bootstrap.cc:492] T 269308705d764fc48846ee9288e6e684 P 1edd51fdf2b64069b7ae8c00293f7be2: No bootstrap required, opened a new log
I20260811 15:03:42.191947 25635 ts_tablet_manager.cc:1397] T 269308705d764fc48846ee9288e6e684 P 1edd51fdf2b64069b7ae8c00293f7be2: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260811 15:03:42.193172 25638 tablet_bootstrap.cc:492] T 269308705d764fc48846ee9288e6e684 P 84736736e2c941ba8bb04ff5d7daad80: No bootstrap required, opened a new log
I20260811 15:03:42.193357 25638 ts_tablet_manager.cc:1397] T 269308705d764fc48846ee9288e6e684 P 84736736e2c941ba8bb04ff5d7daad80: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.004s
I20260811 15:03:42.193638 25636 tablet_bootstrap.cc:492] T 269308705d764fc48846ee9288e6e684 P 76727b1c53bb49b38f8f7300cabb45d0: No bootstrap required, opened a new log
I20260811 15:03:42.193804 25636 ts_tablet_manager.cc:1397] T 269308705d764fc48846ee9288e6e684 P 76727b1c53bb49b38f8f7300cabb45d0: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260811 15:03:42.195204 25635 raft_consensus.cc:348] T 269308705d764fc48846ee9288e6e684 P 1edd51fdf2b64069b7ae8c00293f7be2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76727b1c53bb49b38f8f7300cabb45d0" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 42435 } } peers { permanent_uuid: "1edd51fdf2b64069b7ae8c00293f7be2" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 38581 } } peers { permanent_uuid: "84736736e2c941ba8bb04ff5d7daad80" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 39373 } }
I20260811 15:03:42.195449 25635 raft_consensus.cc:374] T 269308705d764fc48846ee9288e6e684 P 1edd51fdf2b64069b7ae8c00293f7be2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:03:42.195513 25635 raft_consensus.cc:729] T 269308705d764fc48846ee9288e6e684 P 1edd51fdf2b64069b7ae8c00293f7be2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1edd51fdf2b64069b7ae8c00293f7be2, State: Initialized, Role: FOLLOWER
I20260811 15:03:42.195953 25635 consensus_queue.cc:260] T 269308705d764fc48846ee9288e6e684 P 1edd51fdf2b64069b7ae8c00293f7be2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76727b1c53bb49b38f8f7300cabb45d0" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 42435 } } peers { permanent_uuid: "1edd51fdf2b64069b7ae8c00293f7be2" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 38581 } } peers { permanent_uuid: "84736736e2c941ba8bb04ff5d7daad80" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 39373 } }
I20260811 15:03:42.196640 25614 heartbeater.cc:503] Master 127.19.236.126:40201 was elected leader, sending a full tablet report...
I20260811 15:03:42.196988 25635 ts_tablet_manager.cc:1428] T 269308705d764fc48846ee9288e6e684 P 1edd51fdf2b64069b7ae8c00293f7be2: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260811 15:03:42.197594 25638 raft_consensus.cc:348] T 269308705d764fc48846ee9288e6e684 P 84736736e2c941ba8bb04ff5d7daad80 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76727b1c53bb49b38f8f7300cabb45d0" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 42435 } } peers { permanent_uuid: "1edd51fdf2b64069b7ae8c00293f7be2" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 38581 } } peers { permanent_uuid: "84736736e2c941ba8bb04ff5d7daad80" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 39373 } }
I20260811 15:03:42.197873 25638 raft_consensus.cc:374] T 269308705d764fc48846ee9288e6e684 P 84736736e2c941ba8bb04ff5d7daad80 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:03:42.197916 25638 raft_consensus.cc:729] T 269308705d764fc48846ee9288e6e684 P 84736736e2c941ba8bb04ff5d7daad80 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84736736e2c941ba8bb04ff5d7daad80, State: Initialized, Role: FOLLOWER
I20260811 15:03:42.198268 25638 consensus_queue.cc:260] T 269308705d764fc48846ee9288e6e684 P 84736736e2c941ba8bb04ff5d7daad80 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76727b1c53bb49b38f8f7300cabb45d0" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 42435 } } peers { permanent_uuid: "1edd51fdf2b64069b7ae8c00293f7be2" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 38581 } } peers { permanent_uuid: "84736736e2c941ba8bb04ff5d7daad80" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 39373 } }
I20260811 15:03:42.198822 25462 heartbeater.cc:503] Master 127.19.236.126:40201 was elected leader, sending a full tablet report...
I20260811 15:03:42.199141 25638 ts_tablet_manager.cc:1428] T 269308705d764fc48846ee9288e6e684 P 84736736e2c941ba8bb04ff5d7daad80: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260811 15:03:42.199105 25636 raft_consensus.cc:348] T 269308705d764fc48846ee9288e6e684 P 76727b1c53bb49b38f8f7300cabb45d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76727b1c53bb49b38f8f7300cabb45d0" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 42435 } } peers { permanent_uuid: "1edd51fdf2b64069b7ae8c00293f7be2" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 38581 } } peers { permanent_uuid: "84736736e2c941ba8bb04ff5d7daad80" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 39373 } }
I20260811 15:03:42.199360 25636 raft_consensus.cc:374] T 269308705d764fc48846ee9288e6e684 P 76727b1c53bb49b38f8f7300cabb45d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:03:42.199407 25636 raft_consensus.cc:729] T 269308705d764fc48846ee9288e6e684 P 76727b1c53bb49b38f8f7300cabb45d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76727b1c53bb49b38f8f7300cabb45d0, State: Initialized, Role: FOLLOWER
I20260811 15:03:42.199856 25636 consensus_queue.cc:260] T 269308705d764fc48846ee9288e6e684 P 76727b1c53bb49b38f8f7300cabb45d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76727b1c53bb49b38f8f7300cabb45d0" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 42435 } } peers { permanent_uuid: "1edd51fdf2b64069b7ae8c00293f7be2" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 38581 } } peers { permanent_uuid: "84736736e2c941ba8bb04ff5d7daad80" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 39373 } }
I20260811 15:03:42.200489 25314 heartbeater.cc:503] Master 127.19.236.126:40201 was elected leader, sending a full tablet report...
I20260811 15:03:42.200837 25636 ts_tablet_manager.cc:1428] T 269308705d764fc48846ee9288e6e684 P 76727b1c53bb49b38f8f7300cabb45d0: Time spent starting tablet: real 0.007s user 0.000s sys 0.006s
I20260811 15:03:42.217226 25644 raft_consensus.cc:482] T 269308705d764fc48846ee9288e6e684 P 84736736e2c941ba8bb04ff5d7daad80 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 15:03:42.217424 25644 raft_consensus.cc:504] T 269308705d764fc48846ee9288e6e684 P 84736736e2c941ba8bb04ff5d7daad80 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76727b1c53bb49b38f8f7300cabb45d0" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 42435 } } peers { permanent_uuid: "1edd51fdf2b64069b7ae8c00293f7be2" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 38581 } } peers { permanent_uuid: "84736736e2c941ba8bb04ff5d7daad80" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 39373 } }
I20260811 15:03:42.218462 25644 leader_election.cc:288] T 269308705d764fc48846ee9288e6e684 P 84736736e2c941ba8bb04ff5d7daad80 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 76727b1c53bb49b38f8f7300cabb45d0 (127.19.236.65:42435), 1edd51fdf2b64069b7ae8c00293f7be2 (127.19.236.67:38581)
I20260811 15:03:42.222100 25464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:42.218752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.65:42435 (local address 127.19.236.66:51901)
0811 15:03:42.218874 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:42.218892 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:42.218988 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:42.219259 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:42.219262 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:42.219280 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:03:42.219414 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:42.219420 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:42.220168 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:42.220173 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:42.221037 (+ 864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:42.221046 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:42.221665 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:42.221668 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:42.221777 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:42.221796 (+ 19us) client_negotiation.cc:769] Sending connection context
0811 15:03:42.221895 (+ 99us) client_negotiation.cc:240] Negotiation successful
0811 15:03:42.221965 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36,"mutex_wait_us":2}
I20260811 15:03:42.222100 25627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:42.218854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.66:51901 (local address 127.19.236.65:42435)
0811 15:03:42.219013 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:42.219018 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:42.219036 (+ 18us) server_negotiation.cc:407] Connection header received
0811 15:03:42.219096 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:42.219099 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:42.219146 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:42.219232 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:03:42.219531 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:42.220052 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:42.221161 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:42.221548 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:42.221675 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:42.221729 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:42.221921 (+ 192us) server_negotiation.cc:299] Negotiation successful
0811 15:03:42.221988 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260811 15:03:42.222647 25647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:42.219028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.67:38581 (local address 127.19.236.66:35579)
0811 15:03:42.219465 (+ 437us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:42.219476 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:42.219594 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:42.219831 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:42.219833 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:42.219848 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:03:42.219971 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:42.219976 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:42.220750 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:42.220753 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:42.221560 (+ 807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:42.221568 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:42.222223 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:42.222226 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:42.222319 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:42.222344 (+ 25us) client_negotiation.cc:769] Sending connection context
0811 15:03:42.222455 (+ 111us) client_negotiation.cc:240] Negotiation successful
0811 15:03:42.222521 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":386,"mutex_wait_us":18,"thread_start_us":149,"threads_started":1}
I20260811 15:03:42.222771 25631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:42.219142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.66:35579 (local address 127.19.236.67:38581)
0811 15:03:42.219312 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:42.219318 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:42.219560 (+ 242us) server_negotiation.cc:407] Connection header received
0811 15:03:42.219687 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:42.219694 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:42.219733 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:42.219815 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:03:42.220092 (+ 277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:42.220639 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:42.221683 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:42.222088 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:42.222223 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:42.222270 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:42.222576 (+ 306us) server_negotiation.cc:299] Negotiation successful
0811 15:03:42.222656 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260811 15:03:42.222754 25263 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "269308705d764fc48846ee9288e6e684" candidate_uuid: "84736736e2c941ba8bb04ff5d7daad80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76727b1c53bb49b38f8f7300cabb45d0" is_pre_election: true
I20260811 15:03:42.223084 25263 raft_consensus.cc:2454] T 269308705d764fc48846ee9288e6e684 P 76727b1c53bb49b38f8f7300cabb45d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 84736736e2c941ba8bb04ff5d7daad80 in term 0.
I20260811 15:03:42.223382 25565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "269308705d764fc48846ee9288e6e684" candidate_uuid: "84736736e2c941ba8bb04ff5d7daad80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1edd51fdf2b64069b7ae8c00293f7be2" is_pre_election: true
I20260811 15:03:42.223605 25340 leader_election.cc:302] T 269308705d764fc48846ee9288e6e684 P 84736736e2c941ba8bb04ff5d7daad80 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 76727b1c53bb49b38f8f7300cabb45d0, 84736736e2c941ba8bb04ff5d7daad80; no voters:
I20260811 15:03:42.223693 25565 raft_consensus.cc:2454] T 269308705d764fc48846ee9288e6e684 P 1edd51fdf2b64069b7ae8c00293f7be2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 84736736e2c941ba8bb04ff5d7daad80 in term 0.
I20260811 15:03:42.223925 25644 raft_consensus.cc:2781] T 269308705d764fc48846ee9288e6e684 P 84736736e2c941ba8bb04ff5d7daad80 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 15:03:42.224041 25644 raft_consensus.cc:482] T 269308705d764fc48846ee9288e6e684 P 84736736e2c941ba8bb04ff5d7daad80 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 15:03:42.224092 25644 raft_consensus.cc:3037] T 269308705d764fc48846ee9288e6e684 P 84736736e2c941ba8bb04ff5d7daad80 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:03:42.225232 25644 raft_consensus.cc:504] T 269308705d764fc48846ee9288e6e684 P 84736736e2c941ba8bb04ff5d7daad80 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76727b1c53bb49b38f8f7300cabb45d0" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 42435 } } peers { permanent_uuid: "1edd51fdf2b64069b7ae8c00293f7be2" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 38581 } } peers { permanent_uuid: "84736736e2c941ba8bb04ff5d7daad80" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 39373 } }
I20260811 15:03:42.225557 25644 leader_election.cc:288] T 269308705d764fc48846ee9288e6e684 P 84736736e2c941ba8bb04ff5d7daad80 [CANDIDATE]: Term 1 election: Requested vote from peers 76727b1c53bb49b38f8f7300cabb45d0 (127.19.236.65:42435), 1edd51fdf2b64069b7ae8c00293f7be2 (127.19.236.67:38581)
I20260811 15:03:42.225965 25263 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "269308705d764fc48846ee9288e6e684" candidate_uuid: "84736736e2c941ba8bb04ff5d7daad80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76727b1c53bb49b38f8f7300cabb45d0"
I20260811 15:03:42.225965 25565 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "269308705d764fc48846ee9288e6e684" candidate_uuid: "84736736e2c941ba8bb04ff5d7daad80" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1edd51fdf2b64069b7ae8c00293f7be2"
I20260811 15:03:42.226087 25565 raft_consensus.cc:3037] T 269308705d764fc48846ee9288e6e684 P 1edd51fdf2b64069b7ae8c00293f7be2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:03:42.226086 25263 raft_consensus.cc:3037] T 269308705d764fc48846ee9288e6e684 P 76727b1c53bb49b38f8f7300cabb45d0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:03:42.227388 25263 raft_consensus.cc:2454] T 269308705d764fc48846ee9288e6e684 P 76727b1c53bb49b38f8f7300cabb45d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84736736e2c941ba8bb04ff5d7daad80 in term 1.
I20260811 15:03:42.227388 25565 raft_consensus.cc:2454] T 269308705d764fc48846ee9288e6e684 P 1edd51fdf2b64069b7ae8c00293f7be2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 84736736e2c941ba8bb04ff5d7daad80 in term 1.
I20260811 15:03:42.227715 25340 leader_election.cc:302] T 269308705d764fc48846ee9288e6e684 P 84736736e2c941ba8bb04ff5d7daad80 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 76727b1c53bb49b38f8f7300cabb45d0, 84736736e2c941ba8bb04ff5d7daad80; no voters:
I20260811 15:03:42.227873 25644 raft_consensus.cc:2781] T 269308705d764fc48846ee9288e6e684 P 84736736e2c941ba8bb04ff5d7daad80 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:03:42.228128 25644 raft_consensus.cc:686] T 269308705d764fc48846ee9288e6e684 P 84736736e2c941ba8bb04ff5d7daad80 [term 1 LEADER]: Becoming Leader. State: Replica: 84736736e2c941ba8bb04ff5d7daad80, State: Running, Role: LEADER
I20260811 15:03:42.228446 25644 consensus_queue.cc:237] T 269308705d764fc48846ee9288e6e684 P 84736736e2c941ba8bb04ff5d7daad80 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76727b1c53bb49b38f8f7300cabb45d0" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 42435 } } peers { permanent_uuid: "1edd51fdf2b64069b7ae8c00293f7be2" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 38581 } } peers { permanent_uuid: "84736736e2c941ba8bb04ff5d7daad80" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 39373 } }
I20260811 15:03:42.231915 25103 catalog_manager.cc:5495] T 269308705d764fc48846ee9288e6e684 P 84736736e2c941ba8bb04ff5d7daad80 reported cstate change: term changed from 0 to 1, leader changed from <none> to 84736736e2c941ba8bb04ff5d7daad80 (127.19.236.66). New cstate: current_term: 1 leader_uuid: "84736736e2c941ba8bb04ff5d7daad80" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76727b1c53bb49b38f8f7300cabb45d0" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 42435 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1edd51fdf2b64069b7ae8c00293f7be2" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 38581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "84736736e2c941ba8bb04ff5d7daad80" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 39373 } health_report { overall_health: HEALTHY } } }
I20260811 15:03:42.252646 25634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:42.249348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33170 (local address 127.19.236.66:39373)
0811 15:03:42.249477 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:42.249480 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:42.249494 (+ 14us) server_negotiation.cc:407] Connection header received
0811 15:03:42.249610 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:42.249613 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:42.249664 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:42.249754 (+ 90us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 15:03:42.249974 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:42.250484 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:42.251294 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:42.251490 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:42.251573 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:42.251817 (+ 244us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 15:03:42.252200 (+ 383us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 15:03:42.252289 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:42.252344 (+ 55us) server_negotiation.cc:299] Negotiation successful
0811 15:03:42.252435 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 15:03:42.258659 25263 raft_consensus.cc:1261] T 269308705d764fc48846ee9288e6e684 P 76727b1c53bb49b38f8f7300cabb45d0 [term 1 FOLLOWER]: Refusing update from remote peer 84736736e2c941ba8bb04ff5d7daad80: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:03:42.258659 25565 raft_consensus.cc:1261] T 269308705d764fc48846ee9288e6e684 P 1edd51fdf2b64069b7ae8c00293f7be2 [term 1 FOLLOWER]: Refusing update from remote peer 84736736e2c941ba8bb04ff5d7daad80: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:03:42.259368 25648 consensus_queue.cc:1035] T 269308705d764fc48846ee9288e6e684 P 84736736e2c941ba8bb04ff5d7daad80 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1edd51fdf2b64069b7ae8c00293f7be2" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 38581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:03:42.259568 25644 consensus_queue.cc:1035] T 269308705d764fc48846ee9288e6e684 P 84736736e2c941ba8bb04ff5d7daad80 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76727b1c53bb49b38f8f7300cabb45d0" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 42435 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:03:42.267310 25653 mvcc.cc:205] Tried to move back new op lower bound from 7317342708763836416 to 7317342708650512384. Current Snapshot: MvccSnapshot[applied={T|T < 7317342708763836416}]
I20260811 15:03:42.275005 25103 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48298:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 15:03:42.275190 25103 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48298:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 15:03:42.277850 25103 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b5bac956451c4039bd5937d557f2c684: Sending DeleteTablet for 3 replicas of tablet 269308705d764fc48846ee9288e6e684
I20260811 15:03:42.278604 25240 tablet_service.cc:1514] Processing DeleteTablet for tablet 269308705d764fc48846ee9288e6e684 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:03:42 UTC) from {username='kudu', principal='kudu/127.19.236.126@KRBTEST.COM'} at 127.0.0.1:38970
I20260811 15:03:42.278764 25390 tablet_service.cc:1514] Processing DeleteTablet for tablet 269308705d764fc48846ee9288e6e684 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:03:42 UTC) from {username='kudu', principal='kudu/127.19.236.126@KRBTEST.COM'} at 127.0.0.1:33160
I20260811 15:03:42.279124 25664 tablet_replica.cc:330] T 269308705d764fc48846ee9288e6e684 P 76727b1c53bb49b38f8f7300cabb45d0: stopping tablet replica
I20260811 15:03:42.279165 25541 tablet_service.cc:1514] Processing DeleteTablet for tablet 269308705d764fc48846ee9288e6e684 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:03:42 UTC) from {username='kudu', principal='kudu/127.19.236.126@KRBTEST.COM'} at 127.0.0.1:51116
I20260811 15:03:42.279467 25664 raft_consensus.cc:2229] T 269308705d764fc48846ee9288e6e684 P 76727b1c53bb49b38f8f7300cabb45d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 15:03:42.279673 25667 tablet_replica.cc:330] T 269308705d764fc48846ee9288e6e684 P 1edd51fdf2b64069b7ae8c00293f7be2: stopping tablet replica
I20260811 15:03:42.279806 25664 raft_consensus.cc:2258] T 269308705d764fc48846ee9288e6e684 P 76727b1c53bb49b38f8f7300cabb45d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:03:42.279991 25666 tablet_replica.cc:330] T 269308705d764fc48846ee9288e6e684 P 84736736e2c941ba8bb04ff5d7daad80: stopping tablet replica
I20260811 15:03:42.280355 25666 raft_consensus.cc:2229] T 269308705d764fc48846ee9288e6e684 P 84736736e2c941ba8bb04ff5d7daad80 [term 1 LEADER]: Raft consensus shutting down.
I20260811 15:03:42.280471 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 25171
I20260811 15:03:42.280706 25666 raft_consensus.cc:2258] T 269308705d764fc48846ee9288e6e684 P 84736736e2c941ba8bb04ff5d7daad80 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:03:42.282557 25666 ts_tablet_manager.cc:1905] T 269308705d764fc48846ee9288e6e684 P 84736736e2c941ba8bb04ff5d7daad80: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 15:03:42.284796 25666 ts_tablet_manager.cc:1918] T 269308705d764fc48846ee9288e6e684 P 84736736e2c941ba8bb04ff5d7daad80: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 15:03:42.284806 25667 raft_consensus.cc:2229] T 269308705d764fc48846ee9288e6e684 P 1edd51fdf2b64069b7ae8c00293f7be2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 15:03:42.284905 25666 log.cc:1196] T 269308705d764fc48846ee9288e6e684 P 84736736e2c941ba8bb04ff5d7daad80: Deleting WAL directory at /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/minicluster-data/ts-1/wal/wals/269308705d764fc48846ee9288e6e684
I20260811 15:03:42.285120 25667 raft_consensus.cc:2258] T 269308705d764fc48846ee9288e6e684 P 1edd51fdf2b64069b7ae8c00293f7be2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:03:42.285265 25666 ts_tablet_manager.cc:1939] T 269308705d764fc48846ee9288e6e684 P 84736736e2c941ba8bb04ff5d7daad80: Deleting consensus metadata
I20260811 15:03:42.286425 25088 catalog_manager.cc:4841] TS 84736736e2c941ba8bb04ff5d7daad80 (127.19.236.66:39373): tablet 269308705d764fc48846ee9288e6e684 (table test-table [id=8939664bcaf04e10b2e6d2a723b55fb8]) successfully deleted
I20260811 15:03:42.286590 25667 ts_tablet_manager.cc:1905] T 269308705d764fc48846ee9288e6e684 P 1edd51fdf2b64069b7ae8c00293f7be2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 15:03:42.288637 25667 ts_tablet_manager.cc:1918] T 269308705d764fc48846ee9288e6e684 P 1edd51fdf2b64069b7ae8c00293f7be2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 15:03:42.288743 25667 log.cc:1196] T 269308705d764fc48846ee9288e6e684 P 1edd51fdf2b64069b7ae8c00293f7be2: Deleting WAL directory at /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786460596631409-20401-0/minicluster-data/ts-2/wal/wals/269308705d764fc48846ee9288e6e684
I20260811 15:03:42.289021 25667 ts_tablet_manager.cc:1939] T 269308705d764fc48846ee9288e6e684 P 1edd51fdf2b64069b7ae8c00293f7be2: Deleting consensus metadata
I20260811 15:03:42.290063 25088 catalog_manager.cc:4841] TS 1edd51fdf2b64069b7ae8c00293f7be2 (127.19.236.67:38581): tablet 269308705d764fc48846ee9288e6e684 (table test-table [id=8939664bcaf04e10b2e6d2a723b55fb8]) successfully deleted
W20260811 15:03:42.291831 25088 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.19.236.65:42435 (error 108)
I20260811 15:03:42.291932 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 25319
I20260811 15:03:42.301277 25632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:42.300926 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.65:42435 (local address 127.0.0.1:38986)
0811 15:03:42.301106 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:42.301185 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.65:42435: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
W20260811 15:03:42.301515 25088 catalog_manager.cc:4584] TS 76727b1c53bb49b38f8f7300cabb45d0 (127.19.236.65:42435): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 269308705d764fc48846ee9288e6e684: Network error: Client connection negotiation failed: client connection to 127.19.236.65:42435: connect: Connection refused (error 111)
I20260811 15:03:42.306919 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 25467
I20260811 15:03:42.314996 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 25068
2026-08-11T15:03:42Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2382 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-11T15:03:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T15:03:42Z Disabled control of system clock
I20260811 15:03:42.348738 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460596631409-20401-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460596631409-20401-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460596631409-20401-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:36183
--webserver_interface=127.19.236.126
--webserver_port=0
--builtin_ntp_servers=127.19.236.84:39695
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.236.126:36183
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260811 15:03:42.463246 25673 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:03:42.463634 25673 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:03:42.463717 25673 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:03:42.467849 25673 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:03:42.467909 25673 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:03:42.467931 25673 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:03:42.467949 25673 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:03:42.468004 25673 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:03:42.472908 25673 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:39695
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460596631409-20401-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460596631409-20401-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.236.126:36183
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:36183
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.236.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25673
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460596631409-20401-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:03:42.474347 25673 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:03:42.475839 25673 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:03:42.484819 25682 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:42.484828 25681 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:42.485057 25673 server_base.cc:1034] running on GCE node
W20260811 15:03:42.484828 25685 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:42.485829 25673 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:03:42.486992 25673 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:03:42.488183 25673 hybrid_clock.cc:648] HybridClock initialized: now 1786460622488160 us; error 47 us; skew 500 ppm
I20260811 15:03:42.490146 25673 webserver.cc:460] Webserver started at http://127.19.236.126:41937/ using document root <none> and password file <none>
I20260811 15:03:42.490752 25673 fs_manager.cc:359] Metadata directory not provided
I20260811 15:03:42.490847 25673 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:03:42.491096 25673 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:03:42.493288 25673 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460596631409-20401-0/minicluster-data/master-0/data/instance:
uuid: "b09e2e047c67486d94b60dcba9b79aa5"
format_stamp: "Formatted at 2026-08-11 15:03:42 on dist-test-slave-8n49"
server_key: "fe9dcae1ace00ca7bcff6fc8bcb74955"
server_key_iv: "395f229570fd649999ebfdbf79ab7e5e"
server_key_version: "encryptionkey@0"
I20260811 15:03:42.493876 25673 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460596631409-20401-0/minicluster-data/master-0/wal/instance:
uuid: "b09e2e047c67486d94b60dcba9b79aa5"
format_stamp: "Formatted at 2026-08-11 15:03:42 on dist-test-slave-8n49"
server_key: "fe9dcae1ace00ca7bcff6fc8bcb74955"
server_key_iv: "395f229570fd649999ebfdbf79ab7e5e"
server_key_version: "encryptionkey@0"
I20260811 15:03:42.497668 25673 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.001s
I20260811 15:03:42.500195 25695 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:42.501473 25673 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 15:03:42.501617 25673 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460596631409-20401-0/minicluster-data/master-0/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460596631409-20401-0/minicluster-data/master-0/wal
uuid: "b09e2e047c67486d94b60dcba9b79aa5"
format_stamp: "Formatted at 2026-08-11 15:03:42 on dist-test-slave-8n49"
server_key: "fe9dcae1ace00ca7bcff6fc8bcb74955"
server_key_iv: "395f229570fd649999ebfdbf79ab7e5e"
server_key_version: "encryptionkey@0"
I20260811 15:03:42.501739 25673 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460596631409-20401-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460596631409-20401-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460596631409-20401-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:03:42.506407 25673 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:03:42.507033 25673 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:03:42.507228 25673 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:03:42.514513 25673 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.126:36183
I20260811 15:03:42.514532 25753 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.126:36183 every 8 connection(s)
I20260811 15:03:42.515450 25673 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
I20260811 15:03:42.518648 25754 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:03:42.524164 25754 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b09e2e047c67486d94b60dcba9b79aa5: Bootstrap starting.
I20260811 15:03:42.524777 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 25673
I20260811 15:03:42.524919 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460596631409-20401-0/minicluster-data/master-0/wal/instance
I20260811 15:03:42.525194 20401 external_mini_cluster.cc:1428] Setting key d4b7e0cb86ca268d96d545e2969d637f
I20260811 15:03:42.527091 25754 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b09e2e047c67486d94b60dcba9b79aa5: Neither blocks nor log segments found. Creating new log.
I20260811 15:03:42.527837 25754 log.cc:824] T 00000000000000000000000000000000 P b09e2e047c67486d94b60dcba9b79aa5: Log is configured to *not* fsync() on all Append() calls
I20260811 15:03:42.529943 25754 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b09e2e047c67486d94b60dcba9b79aa5: No bootstrap required, opened a new log
I20260811 15:03:42.530926 25757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:42.526517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46552 (local address 127.19.236.126:36183)
0811 15:03:42.527219 (+ 702us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:42.527241 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:42.527285 (+ 44us) server_negotiation.cc:407] Connection header received
0811 15:03:42.527933 (+ 648us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:42.527976 (+ 43us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:42.528414 (+ 438us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:42.528801 (+ 387us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:42.529616 (+ 815us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:42.529621 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:42.529633 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:03:42.529644 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:42.529698 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:03:42.529715 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:42.529835 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:42.529970 (+ 135us) server_negotiation.cc:299] Negotiation successful
0811 15:03:42.530233 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":304,"thread_start_us":134,"threads_started":1}
I20260811 15:03:42.533990 25754 raft_consensus.cc:348] T 00000000000000000000000000000000 P b09e2e047c67486d94b60dcba9b79aa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b09e2e047c67486d94b60dcba9b79aa5" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 36183 } }
I20260811 15:03:42.534235 25754 raft_consensus.cc:374] T 00000000000000000000000000000000 P b09e2e047c67486d94b60dcba9b79aa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:03:42.534317 25754 raft_consensus.cc:729] T 00000000000000000000000000000000 P b09e2e047c67486d94b60dcba9b79aa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b09e2e047c67486d94b60dcba9b79aa5, State: Initialized, Role: FOLLOWER
I20260811 15:03:42.534775 25754 consensus_queue.cc:260] T 00000000000000000000000000000000 P b09e2e047c67486d94b60dcba9b79aa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b09e2e047c67486d94b60dcba9b79aa5" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 36183 } }
I20260811 15:03:42.534926 25754 raft_consensus.cc:388] T 00000000000000000000000000000000 P b09e2e047c67486d94b60dcba9b79aa5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 15:03:42.535012 25754 raft_consensus.cc:482] T 00000000000000000000000000000000 P b09e2e047c67486d94b60dcba9b79aa5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 15:03:42.535112 25754 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b09e2e047c67486d94b60dcba9b79aa5 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:03:42.536128 25754 raft_consensus.cc:504] T 00000000000000000000000000000000 P b09e2e047c67486d94b60dcba9b79aa5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b09e2e047c67486d94b60dcba9b79aa5" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 36183 } }
I20260811 15:03:42.536489 25754 leader_election.cc:302] T 00000000000000000000000000000000 P b09e2e047c67486d94b60dcba9b79aa5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b09e2e047c67486d94b60dcba9b79aa5; no voters:
I20260811 15:03:42.536835 25754 leader_election.cc:288] T 00000000000000000000000000000000 P b09e2e047c67486d94b60dcba9b79aa5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 15:03:42.536970 25760 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b09e2e047c67486d94b60dcba9b79aa5 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:03:42.537215 25760 raft_consensus.cc:686] T 00000000000000000000000000000000 P b09e2e047c67486d94b60dcba9b79aa5 [term 1 LEADER]: Becoming Leader. State: Replica: b09e2e047c67486d94b60dcba9b79aa5, State: Running, Role: LEADER
I20260811 15:03:42.537544 25760 consensus_queue.cc:237] T 00000000000000000000000000000000 P b09e2e047c67486d94b60dcba9b79aa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b09e2e047c67486d94b60dcba9b79aa5" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 36183 } }
I20260811 15:03:42.538157 25754 sys_catalog.cc:564] T 00000000000000000000000000000000 P b09e2e047c67486d94b60dcba9b79aa5 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:03:42.539387 25761 sys_catalog.cc:455] T 00000000000000000000000000000000 P b09e2e047c67486d94b60dcba9b79aa5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b09e2e047c67486d94b60dcba9b79aa5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b09e2e047c67486d94b60dcba9b79aa5" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 36183 } } }
I20260811 15:03:42.539547 25761 sys_catalog.cc:458] T 00000000000000000000000000000000 P b09e2e047c67486d94b60dcba9b79aa5 [sys.catalog]: This master's current role is: LEADER
I20260811 15:03:42.539387 25763 sys_catalog.cc:455] T 00000000000000000000000000000000 P b09e2e047c67486d94b60dcba9b79aa5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b09e2e047c67486d94b60dcba9b79aa5. Latest consensus state: current_term: 1 leader_uuid: "b09e2e047c67486d94b60dcba9b79aa5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b09e2e047c67486d94b60dcba9b79aa5" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 36183 } } }
I20260811 15:03:42.539650 25763 sys_catalog.cc:458] T 00000000000000000000000000000000 P b09e2e047c67486d94b60dcba9b79aa5 [sys.catalog]: This master's current role is: LEADER
I20260811 15:03:42.540781 25770 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:03:42.543910 25770 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:03:42.549825 25770 catalog_manager.cc:1347] Generated new cluster ID: 7eb0a6a85f19479cb00a7a9125102fb0
I20260811 15:03:42.549892 25770 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:03:42.564196 25770 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 15:03:42.564584 25770 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:03:42.572393 25770 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b09e2e047c67486d94b60dcba9b79aa5: Generated new TSK 0
I20260811 15:03:42.573143 25770 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 15:03:42.578541 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460596631409-20401-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460596631409-20401-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460596631409-20401-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.65:0
--local_ip_for_outbound_sockets=127.19.236.65
--webserver_interface=127.19.236.65
--webserver_port=0
--tserver_master_addrs=127.19.236.126:36183
--builtin_ntp_servers=127.19.236.84:39695
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260811 15:03:42.692452 25782 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:03:42.692792 25782 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:03:42.692834 25782 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:03:42.696913 25782 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:03:42.696964 25782 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:03:42.697021 25782 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.65
I20260811 15:03:42.701817 25782 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:39695
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460596631409-20401-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460596631409-20401-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.236.65
--webserver_port=0
--tserver_master_addrs=127.19.236.126:36183
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25782
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.65
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460596631409-20401-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:03:42.702976 25782 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:03:42.704422 25782 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:03:42.714593 25789 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:42.714637 25788 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:42.714627 25792 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:42.714800 25782 server_base.cc:1034] running on GCE node
I20260811 15:03:42.715291 25782 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:03:42.715993 25782 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:03:42.717152 25782 hybrid_clock.cc:648] HybridClock initialized: now 1786460622717138 us; error 25 us; skew 500 ppm
I20260811 15:03:42.719092 25782 webserver.cc:460] Webserver started at http://127.19.236.65:36335/ using document root <none> and password file <none>
I20260811 15:03:42.719703 25782 fs_manager.cc:359] Metadata directory not provided
I20260811 15:03:42.719767 25782 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:03:42.719987 25782 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:03:42.722146 25782 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460596631409-20401-0/minicluster-data/ts-0/data/instance:
uuid: "b51bb773c53345328807cd6f384b261a"
format_stamp: "Formatted at 2026-08-11 15:03:42 on dist-test-slave-8n49"
server_key: "82ff0d08719bcb6d30814e6d1ddd7540"
server_key_iv: "656a9ecd548052bf68b56cfb4fd3ee18"
server_key_version: "encryptionkey@0"
I20260811 15:03:42.722724 25782 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460596631409-20401-0/minicluster-data/ts-0/wal/instance:
uuid: "b51bb773c53345328807cd6f384b261a"
format_stamp: "Formatted at 2026-08-11 15:03:42 on dist-test-slave-8n49"
server_key: "82ff0d08719bcb6d30814e6d1ddd7540"
server_key_iv: "656a9ecd548052bf68b56cfb4fd3ee18"
server_key_version: "encryptionkey@0"
I20260811 15:03:42.726624 25782 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 15:03:42.729306 25798 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:42.730525 25782 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 15:03:42.730664 25782 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460596631409-20401-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460596631409-20401-0/minicluster-data/ts-0/wal
uuid: "b51bb773c53345328807cd6f384b261a"
format_stamp: "Formatted at 2026-08-11 15:03:42 on dist-test-slave-8n49"
server_key: "82ff0d08719bcb6d30814e6d1ddd7540"
server_key_iv: "656a9ecd548052bf68b56cfb4fd3ee18"
server_key_version: "encryptionkey@0"
I20260811 15:03:42.730786 25782 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460596631409-20401-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460596631409-20401-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460596631409-20401-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:03:42.735574 25782 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:03:42.736295 25782 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:03:42.736493 25782 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:03:42.737069 25782 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:03:42.738061 25782 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:03:42.738132 25782 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:42.738204 25782 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:03:42.738258 25782 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:42.747301 25782 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.65:33993
I20260811 15:03:42.747327 25928 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.65:33993 every 8 connection(s)
I20260811 15:03:42.748222 25782 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
I20260811 15:03:42.754603 25757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:42.750205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.65:56851 (local address 127.19.236.126:36183)
0811 15:03:42.750396 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:42.750401 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:42.751463 (+ 1062us) server_negotiation.cc:407] Connection header received
0811 15:03:42.752963 (+ 1500us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:42.752966 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:42.753007 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:42.753087 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:42.754173 (+ 1086us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:42.754176 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:42.754178 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:03:42.754191 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:42.754213 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:03:42.754221 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:42.754309 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:42.754452 (+ 143us) server_negotiation.cc:299] Negotiation successful
0811 15:03:42.754492 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260811 15:03:42.755487 25932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:42.750651 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:36183 (local address 127.19.236.65:56851)
0811 15:03:42.751316 (+ 665us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:42.751357 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:42.752745 (+ 1388us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:42.753244 (+ 499us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:42.753250 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:42.753336 (+ 86us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:42.753889 (+ 553us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 15:03:42.753891 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:42.753933 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 15:03:42.754001 (+ 68us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:42.754312 (+ 311us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:42.754320 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:42.754325 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 15:03:42.754464 (+ 139us) client_negotiation.cc:240] Negotiation successful
0811 15:03:42.754663 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":110,"threads_started":1}
I20260811 15:03:42.755924 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 25782
I20260811 15:03:42.756065 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460596631409-20401-0/minicluster-data/ts-0/wal/instance
I20260811 15:03:42.756354 20401 external_mini_cluster.cc:1428] Setting key a8d527225bb1e1471aab644737f75f6a
I20260811 15:03:42.756793 25930 heartbeater.cc:347] Connected to a master server at 127.19.236.126:36183
I20260811 15:03:42.757035 25930 heartbeater.cc:464] Registering TS with master...
I20260811 15:03:42.757458 25930 heartbeater.cc:511] Master 127.19.236.126:36183 requested a full tablet report, sending...
I20260811 15:03:42.758313 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460596631409-20401-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460596631409-20401-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460596631409-20401-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.66:0
--local_ip_for_outbound_sockets=127.19.236.66
--webserver_interface=127.19.236.66
--webserver_port=0
--tserver_master_addrs=127.19.236.126:36183
--builtin_ntp_servers=127.19.236.84:39695
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260811 15:03:42.759176 25714 ts_manager.cc:194] Registered new tserver with Master: b51bb773c53345328807cd6f384b261a (127.19.236.65:33993)
W20260811 15:03:42.873994 25933 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:03:42.874258 25933 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:03:42.874297 25933 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:03:42.878352 25933 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:03:42.878408 25933 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:03:42.878463 25933 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.66
I20260811 15:03:42.883162 25933 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:39695
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460596631409-20401-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460596631409-20401-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.236.66
--webserver_port=0
--tserver_master_addrs=127.19.236.126:36183
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25933
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.66
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460596631409-20401-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:03:42.884207 25933 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:03:42.885664 25933 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:03:42.895568 25941 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:42.895586 25938 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:42.895572 25939 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:42.895993 25933 server_base.cc:1034] running on GCE node
I20260811 15:03:42.896373 25933 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:03:42.897051 25933 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:03:42.898252 25933 hybrid_clock.cc:648] HybridClock initialized: now 1786460622898235 us; error 24 us; skew 500 ppm
I20260811 15:03:42.900182 25933 webserver.cc:460] Webserver started at http://127.19.236.66:44381/ using document root <none> and password file <none>
I20260811 15:03:42.900873 25933 fs_manager.cc:359] Metadata directory not provided
I20260811 15:03:42.900971 25933 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:03:42.901217 25933 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:03:42.903350 25933 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460596631409-20401-0/minicluster-data/ts-1/data/instance:
uuid: "6c7ec86a8d2c44edbcb90a939030a322"
format_stamp: "Formatted at 2026-08-11 15:03:42 on dist-test-slave-8n49"
server_key: "f28f3839da0b92080ee21b332775f346"
server_key_iv: "492879a1f787fc88392f14f0338765eb"
server_key_version: "encryptionkey@0"
I20260811 15:03:42.903957 25933 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460596631409-20401-0/minicluster-data/ts-1/wal/instance:
uuid: "6c7ec86a8d2c44edbcb90a939030a322"
format_stamp: "Formatted at 2026-08-11 15:03:42 on dist-test-slave-8n49"
server_key: "f28f3839da0b92080ee21b332775f346"
server_key_iv: "492879a1f787fc88392f14f0338765eb"
server_key_version: "encryptionkey@0"
I20260811 15:03:42.907999 25933 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260811 15:03:42.910950 25947 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:42.912403 25933 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 15:03:42.912757 25933 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460596631409-20401-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460596631409-20401-0/minicluster-data/ts-1/wal
uuid: "6c7ec86a8d2c44edbcb90a939030a322"
format_stamp: "Formatted at 2026-08-11 15:03:42 on dist-test-slave-8n49"
server_key: "f28f3839da0b92080ee21b332775f346"
server_key_iv: "492879a1f787fc88392f14f0338765eb"
server_key_version: "encryptionkey@0"
I20260811 15:03:42.912904 25933 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460596631409-20401-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460596631409-20401-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460596631409-20401-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:03:42.917682 25933 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:03:42.918313 25933 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:03:42.918502 25933 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:03:42.919070 25933 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:03:42.920043 25933 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:03:42.920118 25933 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:42.920190 25933 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:03:42.920244 25933 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:42.929453 25933 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.66:37153
I20260811 15:03:42.929483 26082 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.66:37153 every 8 connection(s)
I20260811 15:03:42.930401 25933 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
I20260811 15:03:42.936010 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 25933
I20260811 15:03:42.936159 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460596631409-20401-0/minicluster-data/ts-1/wal/instance
I20260811 15:03:42.936518 20401 external_mini_cluster.cc:1428] Setting key d8a51213f021b82224c831190d5fd96c
I20260811 15:03:42.936970 25757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:42.932268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.66:35413 (local address 127.19.236.126:36183)
0811 15:03:42.932438 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:42.932444 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:42.933636 (+ 1192us) server_negotiation.cc:407] Connection header received
0811 15:03:42.935100 (+ 1464us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:42.935104 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:42.935154 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:42.935244 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:42.936471 (+ 1227us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:42.936475 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:42.936478 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:03:42.936496 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:42.936522 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:03:42.936535 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:42.936660 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:42.936810 (+ 150us) server_negotiation.cc:299] Negotiation successful
0811 15:03:42.936855 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 15:03:42.938347 26086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:42.932795 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:36183 (local address 127.19.236.66:35413)
0811 15:03:42.933461 (+ 666us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:42.933501 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:42.934864 (+ 1363us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:42.935427 (+ 563us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:42.935434 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:42.935527 (+ 93us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:42.936119 (+ 592us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 15:03:42.936122 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:42.936182 (+ 60us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 15:03:42.936272 (+ 90us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:42.936644 (+ 372us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:42.936655 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:42.936662 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 15:03:42.936848 (+ 186us) client_negotiation.cc:240] Negotiation successful
0811 15:03:42.937335 (+ 487us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":274,"thread_start_us":120,"threads_started":1}
I20260811 15:03:42.938800 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460596631409-20401-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460596631409-20401-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460596631409-20401-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.67:0
--local_ip_for_outbound_sockets=127.19.236.67
--webserver_interface=127.19.236.67
--webserver_port=0
--tserver_master_addrs=127.19.236.126:36183
--builtin_ntp_servers=127.19.236.84:39695
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260811 15:03:42.939558 26083 heartbeater.cc:347] Connected to a master server at 127.19.236.126:36183
I20260811 15:03:42.939812 26083 heartbeater.cc:464] Registering TS with master...
I20260811 15:03:42.940299 26083 heartbeater.cc:511] Master 127.19.236.126:36183 requested a full tablet report, sending...
I20260811 15:03:42.941555 25714 ts_manager.cc:194] Registered new tserver with Master: 6c7ec86a8d2c44edbcb90a939030a322 (127.19.236.66:37153)
W20260811 15:03:43.053944 26087 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:03:43.054217 26087 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:03:43.054256 26087 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:03:43.058272 26087 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:03:43.058331 26087 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:03:43.058387 26087 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.67
I20260811 15:03:43.063095 26087 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:39695
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460596631409-20401-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460596631409-20401-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.236.67
--webserver_port=0
--tserver_master_addrs=127.19.236.126:36183
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26087
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.67
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460596631409-20401-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:03:43.064173 26087 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:03:43.065582 26087 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:03:43.075518 26093 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:43.075518 26092 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:43.075752 26087 server_base.cc:1034] running on GCE node
W20260811 15:03:43.075578 26095 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:43.076218 26087 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:03:43.076895 26087 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:03:43.078063 26087 hybrid_clock.cc:648] HybridClock initialized: now 1786460623078048 us; error 23 us; skew 500 ppm
I20260811 15:03:43.079849 26087 webserver.cc:460] Webserver started at http://127.19.236.67:40373/ using document root <none> and password file <none>
I20260811 15:03:43.080448 26087 fs_manager.cc:359] Metadata directory not provided
I20260811 15:03:43.080513 26087 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:03:43.080798 26087 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:03:43.082891 26087 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460596631409-20401-0/minicluster-data/ts-2/data/instance:
uuid: "1d3ad4347a6a413e8d11a5a12ebf4f9a"
format_stamp: "Formatted at 2026-08-11 15:03:43 on dist-test-slave-8n49"
server_key: "dbce376be3d7c145e34afdbdcd7f1fa2"
server_key_iv: "5972a0cc4910a778a273c54206628a32"
server_key_version: "encryptionkey@0"
I20260811 15:03:43.083503 26087 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460596631409-20401-0/minicluster-data/ts-2/wal/instance:
uuid: "1d3ad4347a6a413e8d11a5a12ebf4f9a"
format_stamp: "Formatted at 2026-08-11 15:03:43 on dist-test-slave-8n49"
server_key: "dbce376be3d7c145e34afdbdcd7f1fa2"
server_key_iv: "5972a0cc4910a778a273c54206628a32"
server_key_version: "encryptionkey@0"
I20260811 15:03:43.087224 26087 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.006s
I20260811 15:03:43.089782 26101 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:43.091024 26087 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 15:03:43.091172 26087 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460596631409-20401-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460596631409-20401-0/minicluster-data/ts-2/wal
uuid: "1d3ad4347a6a413e8d11a5a12ebf4f9a"
format_stamp: "Formatted at 2026-08-11 15:03:43 on dist-test-slave-8n49"
server_key: "dbce376be3d7c145e34afdbdcd7f1fa2"
server_key_iv: "5972a0cc4910a778a273c54206628a32"
server_key_version: "encryptionkey@0"
I20260811 15:03:43.091293 26087 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460596631409-20401-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460596631409-20401-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460596631409-20401-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:03:43.096007 26087 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:03:43.096735 26087 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:03:43.096925 26087 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:03:43.097481 26087 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:03:43.098416 26087 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:03:43.098492 26087 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:43.098564 26087 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:03:43.098609 26087 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:43.107419 26087 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.67:42859
I20260811 15:03:43.107441 26227 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.67:42859 every 8 connection(s)
I20260811 15:03:43.108351 26087 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
I20260811 15:03:43.114686 25757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:43.110228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.67:49869 (local address 127.19.236.126:36183)
0811 15:03:43.110376 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:43.110379 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:43.111416 (+ 1037us) server_negotiation.cc:407] Connection header received
0811 15:03:43.112867 (+ 1451us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:43.112870 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:43.112921 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:43.113032 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:43.114182 (+ 1150us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:43.114186 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:43.114189 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:03:43.114204 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:43.114234 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:03:43.114244 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:43.114345 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:43.114486 (+ 141us) server_negotiation.cc:299] Negotiation successful
0811 15:03:43.114535 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 15:03:43.115509 26230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:43.110588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:36183 (local address 127.19.236.67:49869)
0811 15:03:43.111270 (+ 682us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:43.111310 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:43.112652 (+ 1342us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:43.113204 (+ 552us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:43.113211 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:43.113296 (+ 85us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:43.113903 (+ 607us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 15:03:43.113904 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:43.113946 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 15:03:43.114014 (+ 68us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:43.114328 (+ 314us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:43.114337 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:43.114343 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 15:03:43.114532 (+ 189us) client_negotiation.cc:240] Negotiation successful
0811 15:03:43.114773 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":267,"thread_start_us":115,"threads_started":1}
I20260811 15:03:43.116736 26228 heartbeater.cc:347] Connected to a master server at 127.19.236.126:36183
I20260811 15:03:43.116822 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 26087
I20260811 15:03:43.116964 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460596631409-20401-0/minicluster-data/ts-2/wal/instance
I20260811 15:03:43.117043 26228 heartbeater.cc:464] Registering TS with master...
I20260811 15:03:43.117300 20401 external_mini_cluster.cc:1428] Setting key f1e41d41c9fdeb6fc960d797e7553588
I20260811 15:03:43.117501 26228 heartbeater.cc:511] Master 127.19.236.126:36183 requested a full tablet report, sending...
I20260811 15:03:43.118669 25714 ts_manager.cc:194] Registered new tserver with Master: 1d3ad4347a6a413e8d11a5a12ebf4f9a (127.19.236.67:42859)
I20260811 15:03:43.119649 20401 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 15:03:43.123263 25757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:43.121664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46554 (local address 127.19.236.126:36183)
0811 15:03:43.121818 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:43.121825 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:43.122052 (+ 227us) server_negotiation.cc:407] Connection header received
0811 15:03:43.122140 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:43.122142 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:43.122174 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:43.122240 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:43.122876 (+ 636us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:43.122879 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:43.122881 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:03:43.122893 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:43.122912 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:03:43.122920 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:43.123007 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:43.123126 (+ 119us) server_negotiation.cc:299] Negotiation successful
0811 15:03:43.123159 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260811 15:03:43.126223 25713 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46554:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 15:03:43.129406 25713 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 15:03:43.142902 26245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:43.140404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54618 (local address 127.19.236.67:42859)
0811 15:03:43.140728 (+ 324us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:43.140739 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:43.140763 (+ 24us) server_negotiation.cc:407] Connection header received
0811 15:03:43.140818 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:43.140821 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:43.140955 (+ 134us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:43.141111 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:43.142231 (+ 1120us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:43.142239 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:43.142254 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:03:43.142267 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:43.142315 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:03:43.142352 (+ 37us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:43.142459 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:43.142676 (+ 217us) server_negotiation.cc:299] Negotiation successful
0811 15:03:43.142752 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":227,"thread_start_us":152,"threads_started":1}
I20260811 15:03:43.142894 26244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:43.140229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.67:42859 (local address 127.0.0.1:54618)
0811 15:03:43.140590 (+ 361us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:43.140603 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:43.140683 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:43.141117 (+ 434us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:43.141124 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:43.141202 (+ 78us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:43.141958 (+ 756us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 15:03:43.141961 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:43.141983 (+ 22us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 15:03:43.142064 (+ 81us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:43.142506 (+ 442us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:43.142518 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:43.142530 (+ 12us) client_negotiation.cc:769] Sending connection context
0811 15:03:43.142654 (+ 124us) client_negotiation.cc:240] Negotiation successful
0811 15:03:43.142728 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":263,"thread_start_us":89,"threads_started":1}
I20260811 15:03:43.143285 26239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:43.139061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.65:33993 (local address 127.0.0.1:51650)
0811 15:03:43.139466 (+ 405us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:43.139523 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:43.139633 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:43.141141 (+ 1508us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:43.141145 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:43.141213 (+ 68us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:43.142091 (+ 878us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 15:03:43.142094 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:43.142107 (+ 13us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 15:03:43.142136 (+ 29us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:43.143040 (+ 904us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:43.143045 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:43.143051 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 15:03:43.143107 (+ 56us) client_negotiation.cc:240] Negotiation successful
0811 15:03:43.143143 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":104,"threads_started":1}
I20260811 15:03:43.143716 26240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:43.139193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51650 (local address 127.19.236.65:33993)
0811 15:03:43.140659 (+ 1466us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:43.140672 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:43.140700 (+ 28us) server_negotiation.cc:407] Connection header received
0811 15:03:43.140761 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:43.140767 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:43.140984 (+ 217us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:43.141989 (+ 1005us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:43.142808 (+ 819us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:43.142813 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:43.142824 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:03:43.142836 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:43.142875 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:03:43.142906 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:43.143449 (+ 543us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:43.143489 (+ 40us) server_negotiation.cc:299] Negotiation successful
0811 15:03:43.143579 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1330,"thread_start_us":174,"threads_started":1}
I20260811 15:03:43.144519 26241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:43.139835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.66:37153 (local address 127.0.0.1:59420)
0811 15:03:43.140093 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:43.140104 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:43.140198 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:43.142013 (+ 1815us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:43.142016 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:43.142032 (+ 16us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:43.142951 (+ 919us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 15:03:43.142954 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:43.142967 (+ 13us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 15:03:43.142999 (+ 32us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:43.144246 (+ 1247us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:43.144249 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:43.144252 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 15:03:43.144358 (+ 106us) client_negotiation.cc:240] Negotiation successful
0811 15:03:43.144403 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":136,"threads_started":1}
I20260811 15:03:43.144770 26243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:43.140053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59420 (local address 127.19.236.66:37153)
0811 15:03:43.140910 (+ 857us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:43.140921 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:43.140940 (+ 19us) server_negotiation.cc:407] Connection header received
0811 15:03:43.140990 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:43.140994 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:43.141142 (+ 148us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:43.141266 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:43.143137 (+ 1871us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:43.143143 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:43.143154 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:03:43.143167 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:43.143207 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:03:43.143238 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:43.143351 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:43.144380 (+ 1029us) server_negotiation.cc:299] Negotiation successful
0811 15:03:43.144446 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":764,"thread_start_us":182,"threads_started":1}
I20260811 15:03:43.146595 25853 tablet_service.cc:1467] Processing CreateTablet for tablet 82cde6e09a3f4ae8a77fb39118c4b138 (DEFAULT_TABLE table=test-table [id=dea306f879fb437dbd146293f9154997]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:03:43.146596 26156 tablet_service.cc:1467] Processing CreateTablet for tablet 82cde6e09a3f4ae8a77fb39118c4b138 (DEFAULT_TABLE table=test-table [id=dea306f879fb437dbd146293f9154997]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:03:43.146903 26005 tablet_service.cc:1467] Processing CreateTablet for tablet 82cde6e09a3f4ae8a77fb39118c4b138 (DEFAULT_TABLE table=test-table [id=dea306f879fb437dbd146293f9154997]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:03:43.147790 26156 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82cde6e09a3f4ae8a77fb39118c4b138. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:03:43.147790 25853 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82cde6e09a3f4ae8a77fb39118c4b138. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:03:43.147814 26005 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82cde6e09a3f4ae8a77fb39118c4b138. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:03:43.153899 26246 tablet_bootstrap.cc:492] T 82cde6e09a3f4ae8a77fb39118c4b138 P 6c7ec86a8d2c44edbcb90a939030a322: Bootstrap starting.
I20260811 15:03:43.155171 26247 tablet_bootstrap.cc:492] T 82cde6e09a3f4ae8a77fb39118c4b138 P 1d3ad4347a6a413e8d11a5a12ebf4f9a: Bootstrap starting.
I20260811 15:03:43.156605 26248 tablet_bootstrap.cc:492] T 82cde6e09a3f4ae8a77fb39118c4b138 P b51bb773c53345328807cd6f384b261a: Bootstrap starting.
I20260811 15:03:43.156873 26246 tablet_bootstrap.cc:654] T 82cde6e09a3f4ae8a77fb39118c4b138 P 6c7ec86a8d2c44edbcb90a939030a322: Neither blocks nor log segments found. Creating new log.
I20260811 15:03:43.157629 26247 tablet_bootstrap.cc:654] T 82cde6e09a3f4ae8a77fb39118c4b138 P 1d3ad4347a6a413e8d11a5a12ebf4f9a: Neither blocks nor log segments found. Creating new log.
I20260811 15:03:43.157953 26246 log.cc:824] T 82cde6e09a3f4ae8a77fb39118c4b138 P 6c7ec86a8d2c44edbcb90a939030a322: Log is configured to *not* fsync() on all Append() calls
I20260811 15:03:43.158469 26247 log.cc:824] T 82cde6e09a3f4ae8a77fb39118c4b138 P 1d3ad4347a6a413e8d11a5a12ebf4f9a: Log is configured to *not* fsync() on all Append() calls
I20260811 15:03:43.158725 26248 tablet_bootstrap.cc:654] T 82cde6e09a3f4ae8a77fb39118c4b138 P b51bb773c53345328807cd6f384b261a: Neither blocks nor log segments found. Creating new log.
I20260811 15:03:43.159534 26248 log.cc:824] T 82cde6e09a3f4ae8a77fb39118c4b138 P b51bb773c53345328807cd6f384b261a: Log is configured to *not* fsync() on all Append() calls
I20260811 15:03:43.160199 26246 tablet_bootstrap.cc:492] T 82cde6e09a3f4ae8a77fb39118c4b138 P 6c7ec86a8d2c44edbcb90a939030a322: No bootstrap required, opened a new log
I20260811 15:03:43.160390 26247 tablet_bootstrap.cc:492] T 82cde6e09a3f4ae8a77fb39118c4b138 P 1d3ad4347a6a413e8d11a5a12ebf4f9a: No bootstrap required, opened a new log
I20260811 15:03:43.160418 26246 ts_tablet_manager.cc:1397] T 82cde6e09a3f4ae8a77fb39118c4b138 P 6c7ec86a8d2c44edbcb90a939030a322: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260811 15:03:43.160621 26247 ts_tablet_manager.cc:1397] T 82cde6e09a3f4ae8a77fb39118c4b138 P 1d3ad4347a6a413e8d11a5a12ebf4f9a: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260811 15:03:43.161598 26248 tablet_bootstrap.cc:492] T 82cde6e09a3f4ae8a77fb39118c4b138 P b51bb773c53345328807cd6f384b261a: No bootstrap required, opened a new log
I20260811 15:03:43.161777 26248 ts_tablet_manager.cc:1397] T 82cde6e09a3f4ae8a77fb39118c4b138 P b51bb773c53345328807cd6f384b261a: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260811 15:03:43.164042 26247 raft_consensus.cc:348] T 82cde6e09a3f4ae8a77fb39118c4b138 P 1d3ad4347a6a413e8d11a5a12ebf4f9a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b51bb773c53345328807cd6f384b261a" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 33993 } } peers { permanent_uuid: "6c7ec86a8d2c44edbcb90a939030a322" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 37153 } } peers { permanent_uuid: "1d3ad4347a6a413e8d11a5a12ebf4f9a" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 42859 } }
I20260811 15:03:43.164294 26247 raft_consensus.cc:374] T 82cde6e09a3f4ae8a77fb39118c4b138 P 1d3ad4347a6a413e8d11a5a12ebf4f9a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:03:43.164357 26247 raft_consensus.cc:729] T 82cde6e09a3f4ae8a77fb39118c4b138 P 1d3ad4347a6a413e8d11a5a12ebf4f9a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d3ad4347a6a413e8d11a5a12ebf4f9a, State: Initialized, Role: FOLLOWER
I20260811 15:03:43.164868 26247 consensus_queue.cc:260] T 82cde6e09a3f4ae8a77fb39118c4b138 P 1d3ad4347a6a413e8d11a5a12ebf4f9a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b51bb773c53345328807cd6f384b261a" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 33993 } } peers { permanent_uuid: "6c7ec86a8d2c44edbcb90a939030a322" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 37153 } } peers { permanent_uuid: "1d3ad4347a6a413e8d11a5a12ebf4f9a" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 42859 } }
I20260811 15:03:43.165542 26228 heartbeater.cc:503] Master 127.19.236.126:36183 was elected leader, sending a full tablet report...
I20260811 15:03:43.165930 26247 ts_tablet_manager.cc:1428] T 82cde6e09a3f4ae8a77fb39118c4b138 P 1d3ad4347a6a413e8d11a5a12ebf4f9a: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260811 15:03:43.166160 26248 raft_consensus.cc:348] T 82cde6e09a3f4ae8a77fb39118c4b138 P b51bb773c53345328807cd6f384b261a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b51bb773c53345328807cd6f384b261a" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 33993 } } peers { permanent_uuid: "6c7ec86a8d2c44edbcb90a939030a322" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 37153 } } peers { permanent_uuid: "1d3ad4347a6a413e8d11a5a12ebf4f9a" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 42859 } }
I20260811 15:03:43.166096 26246 raft_consensus.cc:348] T 82cde6e09a3f4ae8a77fb39118c4b138 P 6c7ec86a8d2c44edbcb90a939030a322 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b51bb773c53345328807cd6f384b261a" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 33993 } } peers { permanent_uuid: "6c7ec86a8d2c44edbcb90a939030a322" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 37153 } } peers { permanent_uuid: "1d3ad4347a6a413e8d11a5a12ebf4f9a" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 42859 } }
I20260811 15:03:43.166363 26248 raft_consensus.cc:374] T 82cde6e09a3f4ae8a77fb39118c4b138 P b51bb773c53345328807cd6f384b261a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:03:43.166364 26246 raft_consensus.cc:374] T 82cde6e09a3f4ae8a77fb39118c4b138 P 6c7ec86a8d2c44edbcb90a939030a322 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:03:43.166414 26248 raft_consensus.cc:729] T 82cde6e09a3f4ae8a77fb39118c4b138 P b51bb773c53345328807cd6f384b261a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b51bb773c53345328807cd6f384b261a, State: Initialized, Role: FOLLOWER
I20260811 15:03:43.166414 26246 raft_consensus.cc:729] T 82cde6e09a3f4ae8a77fb39118c4b138 P 6c7ec86a8d2c44edbcb90a939030a322 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c7ec86a8d2c44edbcb90a939030a322, State: Initialized, Role: FOLLOWER
I20260811 15:03:43.166882 26246 consensus_queue.cc:260] T 82cde6e09a3f4ae8a77fb39118c4b138 P 6c7ec86a8d2c44edbcb90a939030a322 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b51bb773c53345328807cd6f384b261a" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 33993 } } peers { permanent_uuid: "6c7ec86a8d2c44edbcb90a939030a322" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 37153 } } peers { permanent_uuid: "1d3ad4347a6a413e8d11a5a12ebf4f9a" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 42859 } }
I20260811 15:03:43.166882 26248 consensus_queue.cc:260] T 82cde6e09a3f4ae8a77fb39118c4b138 P b51bb773c53345328807cd6f384b261a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b51bb773c53345328807cd6f384b261a" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 33993 } } peers { permanent_uuid: "6c7ec86a8d2c44edbcb90a939030a322" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 37153 } } peers { permanent_uuid: "1d3ad4347a6a413e8d11a5a12ebf4f9a" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 42859 } }
I20260811 15:03:43.167562 25930 heartbeater.cc:503] Master 127.19.236.126:36183 was elected leader, sending a full tablet report...
I20260811 15:03:43.167878 26246 ts_tablet_manager.cc:1428] T 82cde6e09a3f4ae8a77fb39118c4b138 P 6c7ec86a8d2c44edbcb90a939030a322: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260811 15:03:43.168498 26083 heartbeater.cc:503] Master 127.19.236.126:36183 was elected leader, sending a full tablet report...
I20260811 15:03:43.169024 26248 ts_tablet_manager.cc:1428] T 82cde6e09a3f4ae8a77fb39118c4b138 P b51bb773c53345328807cd6f384b261a: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
W20260811 15:03:43.181479 26084 tablet.cc:2369] T 82cde6e09a3f4ae8a77fb39118c4b138 P 6c7ec86a8d2c44edbcb90a939030a322: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 15:03:43.249558 25931 tablet.cc:2369] T 82cde6e09a3f4ae8a77fb39118c4b138 P b51bb773c53345328807cd6f384b261a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 15:03:43.318712 26254 raft_consensus.cc:482] T 82cde6e09a3f4ae8a77fb39118c4b138 P 1d3ad4347a6a413e8d11a5a12ebf4f9a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 15:03:43.318980 26254 raft_consensus.cc:504] T 82cde6e09a3f4ae8a77fb39118c4b138 P 1d3ad4347a6a413e8d11a5a12ebf4f9a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b51bb773c53345328807cd6f384b261a" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 33993 } } peers { permanent_uuid: "6c7ec86a8d2c44edbcb90a939030a322" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 37153 } } peers { permanent_uuid: "1d3ad4347a6a413e8d11a5a12ebf4f9a" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 42859 } }
I20260811 15:03:43.320232 26254 leader_election.cc:288] T 82cde6e09a3f4ae8a77fb39118c4b138 P 1d3ad4347a6a413e8d11a5a12ebf4f9a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b51bb773c53345328807cd6f384b261a (127.19.236.65:33993), 6c7ec86a8d2c44edbcb90a939030a322 (127.19.236.66:37153)
I20260811 15:03:43.322368 26240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:43.320752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.67:46967 (local address 127.19.236.65:33993)
0811 15:03:43.320886 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:43.320890 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:43.320905 (+ 15us) server_negotiation.cc:407] Connection header received
0811 15:03:43.321046 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:43.321049 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:43.321093 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:43.321216 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:43.321975 (+ 759us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:43.321979 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:43.321981 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:03:43.321995 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:43.322022 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:03:43.322030 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:43.322125 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:43.322199 (+ 74us) server_negotiation.cc:299] Negotiation successful
0811 15:03:43.322239 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 15:03:43.322368 26230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:43.320654 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.65:33993 (local address 127.19.236.67:46967)
0811 15:03:43.320793 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:43.320811 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:43.320928 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:43.321238 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:43.321241 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:43.321260 (+ 19us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:43.321792 (+ 532us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 15:03:43.321794 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:43.321807 (+ 13us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 15:03:43.321843 (+ 36us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:43.322119 (+ 276us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:43.322123 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:43.322126 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 15:03:43.322205 (+ 79us) client_negotiation.cc:240] Negotiation successful
0811 15:03:43.322239 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44}
I20260811 15:03:43.322847 26258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:43.321006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.66:37153 (local address 127.19.236.67:57525)
0811 15:03:43.321402 (+ 396us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:43.321413 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:43.321520 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:43.321760 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:43.321763 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:43.321778 (+ 15us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:43.322261 (+ 483us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 15:03:43.322263 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:43.322274 (+ 11us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 15:03:43.322308 (+ 34us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:43.322588 (+ 280us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:43.322595 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:43.322599 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 15:03:43.322680 (+ 81us) client_negotiation.cc:240] Negotiation successful
0811 15:03:43.322712 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":336,"thread_start_us":127,"threads_started":1}
I20260811 15:03:43.322842 26243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:43.321154 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.67:57525 (local address 127.19.236.66:37153)
0811 15:03:43.321296 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:43.321301 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:43.321493 (+ 192us) server_negotiation.cc:407] Connection header received
0811 15:03:43.321600 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:43.321605 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:43.321647 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:43.321737 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:43.322439 (+ 702us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:43.322444 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:43.322450 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:03:43.322467 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:43.322494 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:03:43.322507 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:43.322596 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:43.322675 (+ 79us) server_negotiation.cc:299] Negotiation successful
0811 15:03:43.322715 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 15:03:43.323127 25878 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82cde6e09a3f4ae8a77fb39118c4b138" candidate_uuid: "1d3ad4347a6a413e8d11a5a12ebf4f9a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b51bb773c53345328807cd6f384b261a" is_pre_election: true
I20260811 15:03:43.323467 25878 raft_consensus.cc:2454] T 82cde6e09a3f4ae8a77fb39118c4b138 P b51bb773c53345328807cd6f384b261a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d3ad4347a6a413e8d11a5a12ebf4f9a in term 0.
I20260811 15:03:43.323558 26029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82cde6e09a3f4ae8a77fb39118c4b138" candidate_uuid: "1d3ad4347a6a413e8d11a5a12ebf4f9a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c7ec86a8d2c44edbcb90a939030a322" is_pre_election: true
I20260811 15:03:43.323853 26029 raft_consensus.cc:2454] T 82cde6e09a3f4ae8a77fb39118c4b138 P 6c7ec86a8d2c44edbcb90a939030a322 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d3ad4347a6a413e8d11a5a12ebf4f9a in term 0.
I20260811 15:03:43.323940 26106 leader_election.cc:302] T 82cde6e09a3f4ae8a77fb39118c4b138 P 1d3ad4347a6a413e8d11a5a12ebf4f9a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d3ad4347a6a413e8d11a5a12ebf4f9a, b51bb773c53345328807cd6f384b261a; no voters:
I20260811 15:03:43.324246 26254 raft_consensus.cc:2781] T 82cde6e09a3f4ae8a77fb39118c4b138 P 1d3ad4347a6a413e8d11a5a12ebf4f9a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 15:03:43.324347 26254 raft_consensus.cc:482] T 82cde6e09a3f4ae8a77fb39118c4b138 P 1d3ad4347a6a413e8d11a5a12ebf4f9a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 15:03:43.324406 26254 raft_consensus.cc:3037] T 82cde6e09a3f4ae8a77fb39118c4b138 P 1d3ad4347a6a413e8d11a5a12ebf4f9a [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:03:43.325542 26254 raft_consensus.cc:504] T 82cde6e09a3f4ae8a77fb39118c4b138 P 1d3ad4347a6a413e8d11a5a12ebf4f9a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b51bb773c53345328807cd6f384b261a" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 33993 } } peers { permanent_uuid: "6c7ec86a8d2c44edbcb90a939030a322" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 37153 } } peers { permanent_uuid: "1d3ad4347a6a413e8d11a5a12ebf4f9a" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 42859 } }
I20260811 15:03:43.325875 26254 leader_election.cc:288] T 82cde6e09a3f4ae8a77fb39118c4b138 P 1d3ad4347a6a413e8d11a5a12ebf4f9a [CANDIDATE]: Term 1 election: Requested vote from peers b51bb773c53345328807cd6f384b261a (127.19.236.65:33993), 6c7ec86a8d2c44edbcb90a939030a322 (127.19.236.66:37153)
I20260811 15:03:43.326215 25878 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82cde6e09a3f4ae8a77fb39118c4b138" candidate_uuid: "1d3ad4347a6a413e8d11a5a12ebf4f9a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b51bb773c53345328807cd6f384b261a"
I20260811 15:03:43.326288 26029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82cde6e09a3f4ae8a77fb39118c4b138" candidate_uuid: "1d3ad4347a6a413e8d11a5a12ebf4f9a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c7ec86a8d2c44edbcb90a939030a322"
I20260811 15:03:43.326349 25878 raft_consensus.cc:3037] T 82cde6e09a3f4ae8a77fb39118c4b138 P b51bb773c53345328807cd6f384b261a [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:03:43.326414 26029 raft_consensus.cc:3037] T 82cde6e09a3f4ae8a77fb39118c4b138 P 6c7ec86a8d2c44edbcb90a939030a322 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:03:43.327725 25878 raft_consensus.cc:2454] T 82cde6e09a3f4ae8a77fb39118c4b138 P b51bb773c53345328807cd6f384b261a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d3ad4347a6a413e8d11a5a12ebf4f9a in term 1.
I20260811 15:03:43.327725 26029 raft_consensus.cc:2454] T 82cde6e09a3f4ae8a77fb39118c4b138 P 6c7ec86a8d2c44edbcb90a939030a322 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d3ad4347a6a413e8d11a5a12ebf4f9a in term 1.
I20260811 15:03:43.328011 26106 leader_election.cc:302] T 82cde6e09a3f4ae8a77fb39118c4b138 P 1d3ad4347a6a413e8d11a5a12ebf4f9a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d3ad4347a6a413e8d11a5a12ebf4f9a, 6c7ec86a8d2c44edbcb90a939030a322; no voters:
I20260811 15:03:43.328214 26254 raft_consensus.cc:2781] T 82cde6e09a3f4ae8a77fb39118c4b138 P 1d3ad4347a6a413e8d11a5a12ebf4f9a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:03:43.328500 26254 raft_consensus.cc:686] T 82cde6e09a3f4ae8a77fb39118c4b138 P 1d3ad4347a6a413e8d11a5a12ebf4f9a [term 1 LEADER]: Becoming Leader. State: Replica: 1d3ad4347a6a413e8d11a5a12ebf4f9a, State: Running, Role: LEADER
I20260811 15:03:43.328919 26254 consensus_queue.cc:237] T 82cde6e09a3f4ae8a77fb39118c4b138 P 1d3ad4347a6a413e8d11a5a12ebf4f9a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b51bb773c53345328807cd6f384b261a" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 33993 } } peers { permanent_uuid: "6c7ec86a8d2c44edbcb90a939030a322" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 37153 } } peers { permanent_uuid: "1d3ad4347a6a413e8d11a5a12ebf4f9a" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 42859 } }
I20260811 15:03:43.332062 25713 catalog_manager.cc:5495] T 82cde6e09a3f4ae8a77fb39118c4b138 P 1d3ad4347a6a413e8d11a5a12ebf4f9a reported cstate change: term changed from 0 to 1, leader changed from <none> to 1d3ad4347a6a413e8d11a5a12ebf4f9a (127.19.236.67). New cstate: current_term: 1 leader_uuid: "1d3ad4347a6a413e8d11a5a12ebf4f9a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b51bb773c53345328807cd6f384b261a" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 33993 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c7ec86a8d2c44edbcb90a939030a322" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 37153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d3ad4347a6a413e8d11a5a12ebf4f9a" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 42859 } health_report { overall_health: HEALTHY } } }
W20260811 15:03:43.359426 26229 tablet.cc:2369] T 82cde6e09a3f4ae8a77fb39118c4b138 P 1d3ad4347a6a413e8d11a5a12ebf4f9a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 15:03:43.384328 26245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:43.382734 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54620 (local address 127.19.236.67:42859)
0811 15:03:43.382882 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:43.382887 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:43.382901 (+ 14us) server_negotiation.cc:407] Connection header received
0811 15:03:43.383055 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:43.383058 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:43.383123 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:43.383197 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:43.383898 (+ 701us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:43.383902 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:43.383904 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:03:43.383915 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:43.383942 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:03:43.383950 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:43.384026 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:43.384102 (+ 76us) server_negotiation.cc:299] Negotiation successful
0811 15:03:43.384137 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 15:03:43.390529 26029 raft_consensus.cc:1261] T 82cde6e09a3f4ae8a77fb39118c4b138 P 6c7ec86a8d2c44edbcb90a939030a322 [term 1 FOLLOWER]: Refusing update from remote peer 1d3ad4347a6a413e8d11a5a12ebf4f9a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:03:43.390528 25878 raft_consensus.cc:1261] T 82cde6e09a3f4ae8a77fb39118c4b138 P b51bb773c53345328807cd6f384b261a [term 1 FOLLOWER]: Refusing update from remote peer 1d3ad4347a6a413e8d11a5a12ebf4f9a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:03:43.391276 26254 consensus_queue.cc:1035] T 82cde6e09a3f4ae8a77fb39118c4b138 P 1d3ad4347a6a413e8d11a5a12ebf4f9a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c7ec86a8d2c44edbcb90a939030a322" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 37153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:03:43.391470 26259 consensus_queue.cc:1035] T 82cde6e09a3f4ae8a77fb39118c4b138 P 1d3ad4347a6a413e8d11a5a12ebf4f9a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b51bb773c53345328807cd6f384b261a" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 33993 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:03:43.401460 26264 mvcc.cc:205] Tried to move back new op lower bound from 7317342713400180736 to 7317342713157881856. Current Snapshot: MvccSnapshot[applied={T|T < 7317342713400180736}]
I20260811 15:03:43.408535 25713 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46554:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 15:03:43.408803 25713 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46554:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 15:03:43.411602 25713 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b09e2e047c67486d94b60dcba9b79aa5: Sending DeleteTablet for 3 replicas of tablet 82cde6e09a3f4ae8a77fb39118c4b138
I20260811 15:03:43.412463 25853 tablet_service.cc:1514] Processing DeleteTablet for tablet 82cde6e09a3f4ae8a77fb39118c4b138 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:03:43 UTC) from {username='slave'} at 127.0.0.1:51650
I20260811 15:03:43.412536 26005 tablet_service.cc:1514] Processing DeleteTablet for tablet 82cde6e09a3f4ae8a77fb39118c4b138 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:03:43 UTC) from {username='slave'} at 127.0.0.1:59420
I20260811 15:03:43.412758 26156 tablet_service.cc:1514] Processing DeleteTablet for tablet 82cde6e09a3f4ae8a77fb39118c4b138 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:03:43 UTC) from {username='slave'} at 127.0.0.1:54618
I20260811 15:03:43.413013 26272 tablet_replica.cc:330] T 82cde6e09a3f4ae8a77fb39118c4b138 P b51bb773c53345328807cd6f384b261a: stopping tablet replica
I20260811 15:03:43.413240 26273 tablet_replica.cc:330] T 82cde6e09a3f4ae8a77fb39118c4b138 P 1d3ad4347a6a413e8d11a5a12ebf4f9a: stopping tablet replica
I20260811 15:03:43.413343 26272 raft_consensus.cc:2229] T 82cde6e09a3f4ae8a77fb39118c4b138 P b51bb773c53345328807cd6f384b261a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 15:03:43.413533 26273 raft_consensus.cc:2229] T 82cde6e09a3f4ae8a77fb39118c4b138 P 1d3ad4347a6a413e8d11a5a12ebf4f9a [term 1 LEADER]: Raft consensus shutting down.
I20260811 15:03:43.413691 26272 raft_consensus.cc:2258] T 82cde6e09a3f4ae8a77fb39118c4b138 P b51bb773c53345328807cd6f384b261a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:03:43.413779 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 25782
I20260811 15:03:43.413868 26273 raft_consensus.cc:2258] T 82cde6e09a3f4ae8a77fb39118c4b138 P 1d3ad4347a6a413e8d11a5a12ebf4f9a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:03:43.414194 26271 tablet_replica.cc:330] T 82cde6e09a3f4ae8a77fb39118c4b138 P 6c7ec86a8d2c44edbcb90a939030a322: stopping tablet replica
I20260811 15:03:43.414479 26271 raft_consensus.cc:2229] T 82cde6e09a3f4ae8a77fb39118c4b138 P 6c7ec86a8d2c44edbcb90a939030a322 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 15:03:43.414773 26271 raft_consensus.cc:2258] T 82cde6e09a3f4ae8a77fb39118c4b138 P 6c7ec86a8d2c44edbcb90a939030a322 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:03:43.417294 26273 ts_tablet_manager.cc:1905] T 82cde6e09a3f4ae8a77fb39118c4b138 P 1d3ad4347a6a413e8d11a5a12ebf4f9a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 15:03:43.420060 26273 ts_tablet_manager.cc:1918] T 82cde6e09a3f4ae8a77fb39118c4b138 P 1d3ad4347a6a413e8d11a5a12ebf4f9a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 15:03:43.420186 26273 log.cc:1196] T 82cde6e09a3f4ae8a77fb39118c4b138 P 1d3ad4347a6a413e8d11a5a12ebf4f9a: Deleting WAL directory at /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786460596631409-20401-0/minicluster-data/ts-2/wal/wals/82cde6e09a3f4ae8a77fb39118c4b138
I20260811 15:03:43.420526 26273 ts_tablet_manager.cc:1939] T 82cde6e09a3f4ae8a77fb39118c4b138 P 1d3ad4347a6a413e8d11a5a12ebf4f9a: Deleting consensus metadata
I20260811 15:03:43.421670 25699 catalog_manager.cc:4841] TS 1d3ad4347a6a413e8d11a5a12ebf4f9a (127.19.236.67:42859): tablet 82cde6e09a3f4ae8a77fb39118c4b138 (table test-table [id=dea306f879fb437dbd146293f9154997]) successfully deleted
W20260811 15:03:43.425562 25699 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.19.236.65:33993 (error 108)
I20260811 15:03:43.425843 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 25933
I20260811 15:03:43.425995 26271 ts_tablet_manager.cc:1905] T 82cde6e09a3f4ae8a77fb39118c4b138 P 6c7ec86a8d2c44edbcb90a939030a322: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 15:03:43.426918 26241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:43.426579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.65:33993 (local address 127.0.0.1:51662)
0811 15:03:43.426721 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:43.426800 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.65:33993: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260811 15:03:43.428153 25699 catalog_manager.cc:4584] TS b51bb773c53345328807cd6f384b261a (127.19.236.65:33993): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 82cde6e09a3f4ae8a77fb39118c4b138: Network error: Client connection negotiation failed: client connection to 127.19.236.65:33993: connect: Connection refused (error 111)
I20260811 15:03:43.434864 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 26087
I20260811 15:03:43.435075 26241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:43.434741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.66:37153 (local address 127.0.0.1:59422)
0811 15:03:43.434900 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:43.434969 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.66:37153: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260811 15:03:43.443683 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 25673
2026-08-11T15:03:43Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (1129 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260811 15:03:43.469784 20401 mini_oidc.cc:152] Starting JWKS server
I20260811 15:03:43.471408 20401 webserver.cc:460] Webserver started at https://127.0.0.1:44249/ using document root <none> and password file <none>
I20260811 15:03:43.471590 20401 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 15:03:43.471884 20401 webserver.cc:460] Webserver started at http://127.0.0.1:42165/ using document root <none> and password file <none>
2026-08-11T15:03:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T15:03:43Z Disabled control of system clock
I20260811 15:03:43.482517 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786460596631409-20401-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786460596631409-20401-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786460596631409-20401-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:46237
--webserver_interface=127.19.236.126
--webserver_port=0
--builtin_ntp_servers=127.19.236.84:39617
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.236.126:46237
--enable_jwt_token_auth=true
--jwks_url=https://localhost:44249/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786460596631409-20401-0/testchainca.cert with env {}
W20260811 15:03:43.597214 26280 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:03:43.597525 26280 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:03:43.597568 26280 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:03:43.601783 26280 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:03:43.601861 26280 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:03:43.601877 26280 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:03:43.601894 26280 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:03:43.601910 26280 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 15:03:43.601926 26280 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 15:03:43.601940 26280 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:44249/jwks.json
I20260811 15:03:43.607625 26280 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:39617
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786460596631409-20401-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786460596631409-20401-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.236.126:46237
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:46237
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:44249/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.236.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786460596631409-20401-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26280
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786460596631409-20401-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:03:43.608920 26280 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:03:43.609956 26280 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:03:43.619374 26286 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:43.619359 26288 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:43.619354 26280 server_base.cc:1034] running on GCE node
W20260811 15:03:43.619629 26285 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:43.620273 26280 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:03:43.621541 26280 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:03:43.622740 26280 hybrid_clock.cc:648] HybridClock initialized: now 1786460623622721 us; error 32 us; skew 500 ppm
I20260811 15:03:43.624774 26280 webserver.cc:460] Webserver started at http://127.19.236.126:37045/ using document root <none> and password file <none>
I20260811 15:03:43.625408 26280 fs_manager.cc:359] Metadata directory not provided
I20260811 15:03:43.625510 26280 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:03:43.625761 26280 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:03:43.627955 26280 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786460596631409-20401-0/minicluster-data/master-0/data/instance:
uuid: "ead119f225c74316a8b7167db4758db6"
format_stamp: "Formatted at 2026-08-11 15:03:43 on dist-test-slave-8n49"
server_key: "0d20b63b11efab374b80530378b50af6"
server_key_iv: "eaa8e30ca6964d7bdb0b3cb3f54a2d23"
server_key_version: "encryptionkey@0"
I20260811 15:03:43.628662 26280 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786460596631409-20401-0/minicluster-data/master-0/wal/instance:
uuid: "ead119f225c74316a8b7167db4758db6"
format_stamp: "Formatted at 2026-08-11 15:03:43 on dist-test-slave-8n49"
server_key: "0d20b63b11efab374b80530378b50af6"
server_key_iv: "eaa8e30ca6964d7bdb0b3cb3f54a2d23"
server_key_version: "encryptionkey@0"
I20260811 15:03:43.632440 26280 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260811 15:03:43.635054 26294 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:43.636283 26280 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 15:03:43.636533 26280 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786460596631409-20401-0/minicluster-data/master-0/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786460596631409-20401-0/minicluster-data/master-0/wal
uuid: "ead119f225c74316a8b7167db4758db6"
format_stamp: "Formatted at 2026-08-11 15:03:43 on dist-test-slave-8n49"
server_key: "0d20b63b11efab374b80530378b50af6"
server_key_iv: "eaa8e30ca6964d7bdb0b3cb3f54a2d23"
server_key_version: "encryptionkey@0"
I20260811 15:03:43.636713 26280 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786460596631409-20401-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786460596631409-20401-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786460596631409-20401-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:03:43.659706 26280 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:03:43.660493 26280 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:03:43.660753 26280 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:03:43.668130 26280 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.126:46237
I20260811 15:03:43.668143 26354 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.126:46237 every 8 connection(s)
I20260811 15:03:43.669142 26280 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
I20260811 15:03:43.672616 26356 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:03:43.678457 26356 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ead119f225c74316a8b7167db4758db6: Bootstrap starting.
I20260811 15:03:43.679386 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 26280
I20260811 15:03:43.679519 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786460596631409-20401-0/minicluster-data/master-0/wal/instance
I20260811 15:03:43.679849 20401 external_mini_cluster.cc:1428] Setting key 270a9c113bc5811d61aa7929529f20dc
I20260811 15:03:43.681571 26356 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ead119f225c74316a8b7167db4758db6: Neither blocks nor log segments found. Creating new log.
I20260811 15:03:43.682332 26356 log.cc:824] T 00000000000000000000000000000000 P ead119f225c74316a8b7167db4758db6: Log is configured to *not* fsync() on all Append() calls
I20260811 15:03:43.684716 26356 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ead119f225c74316a8b7167db4758db6: No bootstrap required, opened a new log
I20260811 15:03:43.689242 26356 raft_consensus.cc:348] T 00000000000000000000000000000000 P ead119f225c74316a8b7167db4758db6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ead119f225c74316a8b7167db4758db6" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 46237 } }
I20260811 15:03:43.689488 26356 raft_consensus.cc:374] T 00000000000000000000000000000000 P ead119f225c74316a8b7167db4758db6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:03:43.689527 26356 raft_consensus.cc:729] T 00000000000000000000000000000000 P ead119f225c74316a8b7167db4758db6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ead119f225c74316a8b7167db4758db6, State: Initialized, Role: FOLLOWER
I20260811 15:03:43.689632 26359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:43.681037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43452 (local address 127.19.236.126:46237)
0811 15:03:43.681847 (+ 810us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:43.681862 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:43.681906 (+ 44us) server_negotiation.cc:407] Connection header received
0811 15:03:43.682631 (+ 725us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:43.682650 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:43.683096 (+ 446us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:43.683435 (+ 339us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:43.683784 (+ 349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:43.684860 (+ 1076us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:43.686054 (+ 1194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:43.686560 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:43.686695 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:43.687606 (+ 911us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:43.687612 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:43.687625 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:03:43.688032 (+ 407us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:43.688090 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:03:43.688110 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:43.688189 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:43.688429 (+ 240us) server_negotiation.cc:299] Negotiation successful
0811 15:03:43.688785 (+ 356us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":390,"thread_start_us":235,"threads_started":1}
I20260811 15:03:43.690074 26356 consensus_queue.cc:260] T 00000000000000000000000000000000 P ead119f225c74316a8b7167db4758db6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ead119f225c74316a8b7167db4758db6" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 46237 } }
I20260811 15:03:43.690244 26356 raft_consensus.cc:388] T 00000000000000000000000000000000 P ead119f225c74316a8b7167db4758db6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 15:03:43.690302 26356 raft_consensus.cc:482] T 00000000000000000000000000000000 P ead119f225c74316a8b7167db4758db6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 15:03:43.690402 26356 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ead119f225c74316a8b7167db4758db6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:03:43.691457 26356 raft_consensus.cc:504] T 00000000000000000000000000000000 P ead119f225c74316a8b7167db4758db6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ead119f225c74316a8b7167db4758db6" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 46237 } }
I20260811 15:03:43.691833 26356 leader_election.cc:302] T 00000000000000000000000000000000 P ead119f225c74316a8b7167db4758db6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ead119f225c74316a8b7167db4758db6; no voters:
I20260811 15:03:43.692198 26356 leader_election.cc:288] T 00000000000000000000000000000000 P ead119f225c74316a8b7167db4758db6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 15:03:43.692325 26361 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ead119f225c74316a8b7167db4758db6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:03:43.692637 26361 raft_consensus.cc:686] T 00000000000000000000000000000000 P ead119f225c74316a8b7167db4758db6 [term 1 LEADER]: Becoming Leader. State: Replica: ead119f225c74316a8b7167db4758db6, State: Running, Role: LEADER
I20260811 15:03:43.692890 20401 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 15:03:43.692970 26361 consensus_queue.cc:237] T 00000000000000000000000000000000 P ead119f225c74316a8b7167db4758db6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ead119f225c74316a8b7167db4758db6" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 46237 } }
I20260811 15:03:43.693670 26356 sys_catalog.cc:564] T 00000000000000000000000000000000 P ead119f225c74316a8b7167db4758db6 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:03:43.694626 26362 sys_catalog.cc:455] T 00000000000000000000000000000000 P ead119f225c74316a8b7167db4758db6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ead119f225c74316a8b7167db4758db6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ead119f225c74316a8b7167db4758db6" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 46237 } } }
I20260811 15:03:43.694752 26362 sys_catalog.cc:458] T 00000000000000000000000000000000 P ead119f225c74316a8b7167db4758db6 [sys.catalog]: This master's current role is: LEADER
I20260811 15:03:43.694988 26363 sys_catalog.cc:455] T 00000000000000000000000000000000 P ead119f225c74316a8b7167db4758db6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ead119f225c74316a8b7167db4758db6. Latest consensus state: current_term: 1 leader_uuid: "ead119f225c74316a8b7167db4758db6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ead119f225c74316a8b7167db4758db6" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 46237 } } }
I20260811 15:03:43.695094 26363 sys_catalog.cc:458] T 00000000000000000000000000000000 P ead119f225c74316a8b7167db4758db6 [sys.catalog]: This master's current role is: LEADER
I20260811 15:03:43.695397 26372 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:03:43.698848 26372 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:03:43.704411 26372 catalog_manager.cc:1347] Generated new cluster ID: 8096762741b24d029727b7a8da3c00a2
I20260811 15:03:43.704483 26372 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:03:43.743906 26372 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 15:03:43.745343 26372 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:03:43.756517 26372 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ead119f225c74316a8b7167db4758db6: Generated new TSK 0
I20260811 15:03:43.757527 26372 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260811 15:03:43.798753 26388 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260811 15:03:43.798928 26388 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260811 15:03:43.799456 26359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:43.781707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43468 (local address 127.19.236.126:46237)
0811 15:03:43.781859 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:43.781864 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:43.782060 (+ 196us) server_negotiation.cc:407] Connection header received
0811 15:03:43.782266 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:43.782270 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:43.782330 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:43.782460 (+ 130us) server_negotiation.cc:226] Negotiated authn=JWT
0811 15:03:43.782689 (+ 229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:43.783480 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:43.784381 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:43.784766 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:43.784868 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:43.785218 (+ 350us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 15:03:43.798971 (+ 13753us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44249/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0811 15:03:43.799279 (+ 308us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:43468: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44249/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":56}
W20260811 15:03:43.799553 26359 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:43468: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44249/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260811 15:03:43.800655 26387 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:03:43.781581 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:46237 (local address 127.0.0.1:43468)
0811 15:03:43.781968 (+ 387us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:43.781981 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:43.782103 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:43.782470 (+ 367us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:43.782472 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:43.782478 (+ 6us) client_negotiation.cc:189] Negotiated authn=JWT
0811 15:03:43.782580 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:43.782584 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:43.783616 (+ 1032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:43.783619 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:43.784268 (+ 649us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:43.784275 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:43.784894 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:43.784897 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:43.784974 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:43.785022 (+ 48us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 15:03:43.799239 (+ 14217us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44249/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0811 15:03:43.799445 (+ 206us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.19.236.126:46237: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44249/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":263,"thread_start_us":120,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.19.236.126:46237: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44249/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260811 15:03:43.801616 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 26280
2026-08-11T15:03:43Z chronyd exiting
I20260811 15:03:43.842955 20401 test_util.cc:175] -----------------------------------------------
I20260811 15:03:43.843070 20401 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786460596631409-20401-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (375 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260811 15:03:43.844236 20401 mini_oidc.cc:152] Starting JWKS server
I20260811 15:03:43.845235 20401 webserver.cc:460] Webserver started at https://127.0.0.1:45585/ using document root <none> and password file <none>
I20260811 15:03:43.845363 20401 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 15:03:43.845671 20401 webserver.cc:460] Webserver started at http://127.0.0.1:44925/ using document root <none> and password file <none>
2026-08-11T15:03:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T15:03:43Z Disabled control of system clock
I20260811 15:03:43.855971 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786460596631409-20401-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786460596631409-20401-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786460596631409-20401-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:40927
--webserver_interface=127.19.236.126
--webserver_port=0
--builtin_ntp_servers=127.19.236.84:43543
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.236.126:40927
--enable_jwt_token_auth=true
--jwks_url=https://localhost:45585/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786460596631409-20401-0/testchainca.cert with env {}
W20260811 15:03:43.975485 26394 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:03:43.975787 26394 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:03:43.975831 26394 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:03:43.979992 26394 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:03:43.980062 26394 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:03:43.980077 26394 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:03:43.980096 26394 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:03:43.980111 26394 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 15:03:43.980129 26394 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 15:03:43.980141 26394 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:45585/jwks.json
I20260811 15:03:43.985787 26394 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:43543
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786460596631409-20401-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786460596631409-20401-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.236.126:40927
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:40927
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:45585/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.236.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786460596631409-20401-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26394
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786460596631409-20401-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:03:43.986868 26394 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:03:43.987893 26394 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:03:43.996688 26404 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:43.996701 26406 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:43.996779 26394 server_base.cc:1034] running on GCE node
W20260811 15:03:43.996695 26403 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:43.997499 26394 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:03:43.998633 26394 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:03:43.999822 26394 hybrid_clock.cc:648] HybridClock initialized: now 1786460623999805 us; error 31 us; skew 500 ppm
I20260811 15:03:44.001840 26394 webserver.cc:460] Webserver started at http://127.19.236.126:33523/ using document root <none> and password file <none>
I20260811 15:03:44.002455 26394 fs_manager.cc:359] Metadata directory not provided
I20260811 15:03:44.002552 26394 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:03:44.002791 26394 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:03:44.004992 26394 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786460596631409-20401-0/minicluster-data/master-0/data/instance:
uuid: "68817b39113c48e390d5e169cbeef8c8"
format_stamp: "Formatted at 2026-08-11 15:03:43 on dist-test-slave-8n49"
server_key: "ae4fa49a9fea550f82909558e7470ebf"
server_key_iv: "60470a8ab387e69f8d7caa0bad1d4500"
server_key_version: "encryptionkey@0"
I20260811 15:03:44.005584 26394 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786460596631409-20401-0/minicluster-data/master-0/wal/instance:
uuid: "68817b39113c48e390d5e169cbeef8c8"
format_stamp: "Formatted at 2026-08-11 15:03:43 on dist-test-slave-8n49"
server_key: "ae4fa49a9fea550f82909558e7470ebf"
server_key_iv: "60470a8ab387e69f8d7caa0bad1d4500"
server_key_version: "encryptionkey@0"
I20260811 15:03:44.009349 26394 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 15:03:44.011747 26413 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:44.013271 26394 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 15:03:44.013422 26394 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786460596631409-20401-0/minicluster-data/master-0/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786460596631409-20401-0/minicluster-data/master-0/wal
uuid: "68817b39113c48e390d5e169cbeef8c8"
format_stamp: "Formatted at 2026-08-11 15:03:43 on dist-test-slave-8n49"
server_key: "ae4fa49a9fea550f82909558e7470ebf"
server_key_iv: "60470a8ab387e69f8d7caa0bad1d4500"
server_key_version: "encryptionkey@0"
I20260811 15:03:44.013556 26394 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786460596631409-20401-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786460596631409-20401-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786460596631409-20401-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:03:44.037778 26394 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:03:44.038542 26394 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:03:44.038787 26394 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:03:44.045994 26394 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.126:40927
I20260811 15:03:44.046020 26470 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.126:40927 every 8 connection(s)
I20260811 15:03:44.046999 26394 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
I20260811 15:03:44.050331 26471 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:03:44.052879 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 26394
I20260811 15:03:44.053004 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786460596631409-20401-0/minicluster-data/master-0/wal/instance
I20260811 15:03:44.053313 20401 external_mini_cluster.cc:1428] Setting key 84658eb0b5c07f25a8babf72cd6d2495
I20260811 15:03:44.056931 26471 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 68817b39113c48e390d5e169cbeef8c8: Bootstrap starting.
I20260811 15:03:44.059306 26471 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 68817b39113c48e390d5e169cbeef8c8: Neither blocks nor log segments found. Creating new log.
I20260811 15:03:44.060105 26471 log.cc:824] T 00000000000000000000000000000000 P 68817b39113c48e390d5e169cbeef8c8: Log is configured to *not* fsync() on all Append() calls
I20260811 15:03:44.062265 26471 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 68817b39113c48e390d5e169cbeef8c8: No bootstrap required, opened a new log
I20260811 15:03:44.063031 26476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:44.054743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35066 (local address 127.19.236.126:40927)
0811 15:03:44.055457 (+ 714us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:44.055473 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:44.055511 (+ 38us) server_negotiation.cc:407] Connection header received
0811 15:03:44.056177 (+ 666us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:44.056198 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:44.056789 (+ 591us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:44.057163 (+ 374us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:44.057629 (+ 466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:44.058612 (+ 983us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:44.059554 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:44.060040 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:44.060219 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:44.061178 (+ 959us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:44.061183 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:44.061197 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:03:44.061605 (+ 408us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:44.061663 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:03:44.061684 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:44.061801 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:44.061919 (+ 118us) server_negotiation.cc:299] Negotiation successful
0811 15:03:44.062204 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":340,"thread_start_us":146,"threads_started":1}
I20260811 15:03:44.066346 20401 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 15:03:44.066655 26471 raft_consensus.cc:348] T 00000000000000000000000000000000 P 68817b39113c48e390d5e169cbeef8c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68817b39113c48e390d5e169cbeef8c8" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 40927 } }
I20260811 15:03:44.066926 26471 raft_consensus.cc:374] T 00000000000000000000000000000000 P 68817b39113c48e390d5e169cbeef8c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:03:44.067011 26471 raft_consensus.cc:729] T 00000000000000000000000000000000 P 68817b39113c48e390d5e169cbeef8c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68817b39113c48e390d5e169cbeef8c8, State: Initialized, Role: FOLLOWER
I20260811 15:03:44.067528 26471 consensus_queue.cc:260] T 00000000000000000000000000000000 P 68817b39113c48e390d5e169cbeef8c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68817b39113c48e390d5e169cbeef8c8" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 40927 } }
I20260811 15:03:44.067694 26471 raft_consensus.cc:388] T 00000000000000000000000000000000 P 68817b39113c48e390d5e169cbeef8c8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 15:03:44.067762 26471 raft_consensus.cc:482] T 00000000000000000000000000000000 P 68817b39113c48e390d5e169cbeef8c8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 15:03:44.067862 26471 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 68817b39113c48e390d5e169cbeef8c8 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:03:44.068964 26471 raft_consensus.cc:504] T 00000000000000000000000000000000 P 68817b39113c48e390d5e169cbeef8c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68817b39113c48e390d5e169cbeef8c8" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 40927 } }
I20260811 15:03:44.069330 26471 leader_election.cc:302] T 00000000000000000000000000000000 P 68817b39113c48e390d5e169cbeef8c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 68817b39113c48e390d5e169cbeef8c8; no voters:
I20260811 15:03:44.069700 26471 leader_election.cc:288] T 00000000000000000000000000000000 P 68817b39113c48e390d5e169cbeef8c8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 15:03:44.069777 26478 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 68817b39113c48e390d5e169cbeef8c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:03:44.069990 26478 raft_consensus.cc:686] T 00000000000000000000000000000000 P 68817b39113c48e390d5e169cbeef8c8 [term 1 LEADER]: Becoming Leader. State: Replica: 68817b39113c48e390d5e169cbeef8c8, State: Running, Role: LEADER
I20260811 15:03:44.070309 26478 consensus_queue.cc:237] T 00000000000000000000000000000000 P 68817b39113c48e390d5e169cbeef8c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68817b39113c48e390d5e169cbeef8c8" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 40927 } }
I20260811 15:03:44.071125 26471 sys_catalog.cc:564] T 00000000000000000000000000000000 P 68817b39113c48e390d5e169cbeef8c8 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:03:44.072094 26480 sys_catalog.cc:455] T 00000000000000000000000000000000 P 68817b39113c48e390d5e169cbeef8c8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "68817b39113c48e390d5e169cbeef8c8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68817b39113c48e390d5e169cbeef8c8" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 40927 } } }
I20260811 15:03:44.072247 26480 sys_catalog.cc:458] T 00000000000000000000000000000000 P 68817b39113c48e390d5e169cbeef8c8 [sys.catalog]: This master's current role is: LEADER
I20260811 15:03:44.072592 26479 sys_catalog.cc:455] T 00000000000000000000000000000000 P 68817b39113c48e390d5e169cbeef8c8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 68817b39113c48e390d5e169cbeef8c8. Latest consensus state: current_term: 1 leader_uuid: "68817b39113c48e390d5e169cbeef8c8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68817b39113c48e390d5e169cbeef8c8" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 40927 } } }
I20260811 15:03:44.072697 26479 sys_catalog.cc:458] T 00000000000000000000000000000000 P 68817b39113c48e390d5e169cbeef8c8 [sys.catalog]: This master's current role is: LEADER
I20260811 15:03:44.072968 26487 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:03:44.076028 26487 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:03:44.081804 26487 catalog_manager.cc:1347] Generated new cluster ID: b0c6aa67e35b4a818ece8ae604190767
I20260811 15:03:44.081882 26487 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:03:44.096774 26487 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 15:03:44.097841 26487 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:03:44.102033 26487 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 68817b39113c48e390d5e169cbeef8c8: Generated new TSK 0
I20260811 15:03:44.102706 26487 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260811 15:03:44.141157 26505 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260811 15:03:44.141268 26505 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260811 15:03:44.142000 26476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:44.115706 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35068 (local address 127.19.236.126:40927)
0811 15:03:44.115851 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:44.115857 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:44.116045 (+ 188us) server_negotiation.cc:407] Connection header received
0811 15:03:44.116184 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:44.116201 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:44.116256 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:44.116359 (+ 103us) server_negotiation.cc:226] Negotiated authn=JWT
0811 15:03:44.116681 (+ 322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:44.117388 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:44.118691 (+ 1303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:44.118951 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:44.119051 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:44.119383 (+ 332us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 15:03:44.141587 (+ 22204us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45585/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0811 15:03:44.141859 (+ 272us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:35068: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45585/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":60}
W20260811 15:03:44.142091 26476 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:35068: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45585/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260811 15:03:44.142222 26503 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:03:44.115543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:40927 (local address 127.0.0.1:35068)
0811 15:03:44.115907 (+ 364us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:44.115931 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:44.116055 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:44.116381 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:44.116384 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:44.116393 (+ 9us) client_negotiation.cc:189] Negotiated authn=JWT
0811 15:03:44.116507 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:44.116513 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:44.117513 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:44.117517 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:44.118551 (+ 1034us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:44.118560 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:44.119077 (+ 517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:44.119081 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:44.119171 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:44.119200 (+ 29us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 15:03:44.141825 (+ 22625us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45585/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0811 15:03:44.142034 (+ 209us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.19.236.126:40927: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45585/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":240,"thread_start_us":122,"threads_started":1}
I20260811 15:03:44.142977 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 26394
2026-08-11T15:03:44Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (341 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260811 15:03:44.186216 20401 mini_oidc.cc:152] Starting JWKS server
I20260811 15:03:44.187193 20401 webserver.cc:460] Webserver started at https://127.0.0.1:37233/ using document root <none> and password file <none>
I20260811 15:03:44.187330 20401 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 15:03:44.187651 20401 webserver.cc:460] Webserver started at http://127.0.0.1:44985/ using document root <none> and password file <none>
2026-08-11T15:03:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T15:03:44Z Disabled control of system clock
I20260811 15:03:44.198483 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786460596631409-20401-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786460596631409-20401-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786460596631409-20401-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:39685
--webserver_interface=127.19.236.126
--webserver_port=0
--builtin_ntp_servers=127.19.236.84:42695
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.236.126:39685
--enable_jwt_token_auth=true
--jwks_url=https://localhost:37233/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260811 15:03:44.313223 26512 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:03:44.313544 26512 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:03:44.313616 26512 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:03:44.317648 26512 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:03:44.317736 26512 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:03:44.317766 26512 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:03:44.317821 26512 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:03:44.317859 26512 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 15:03:44.317898 26512 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 15:03:44.317931 26512 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:37233/jwks.json
I20260811 15:03:44.322809 26512 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:42695
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786460596631409-20401-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786460596631409-20401-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.236.126:39685
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:39685
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:37233/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.236.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26512
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786460596631409-20401-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:03:44.324013 26512 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:03:44.325482 26512 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:03:44.334023 26520 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:44.334065 26518 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:44.334151 26512 server_base.cc:1034] running on GCE node
W20260811 15:03:44.334375 26522 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:44.334934 26512 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:03:44.336194 26512 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:03:44.337417 26512 hybrid_clock.cc:648] HybridClock initialized: now 1786460624337397 us; error 33 us; skew 500 ppm
I20260811 15:03:44.339411 26512 webserver.cc:460] Webserver started at http://127.19.236.126:40831/ using document root <none> and password file <none>
I20260811 15:03:44.340062 26512 fs_manager.cc:359] Metadata directory not provided
I20260811 15:03:44.340163 26512 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:03:44.340413 26512 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:03:44.342523 26512 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786460596631409-20401-0/minicluster-data/master-0/data/instance:
uuid: "f7919a03e56740afa537eecd8c87ab1b"
format_stamp: "Formatted at 2026-08-11 15:03:44 on dist-test-slave-8n49"
server_key: "e13a4c117034422b23c03f9d4cfd8f87"
server_key_iv: "9a6b1fd67e857e8563092d9fe9ff143e"
server_key_version: "encryptionkey@0"
I20260811 15:03:44.343127 26512 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786460596631409-20401-0/minicluster-data/master-0/wal/instance:
uuid: "f7919a03e56740afa537eecd8c87ab1b"
format_stamp: "Formatted at 2026-08-11 15:03:44 on dist-test-slave-8n49"
server_key: "e13a4c117034422b23c03f9d4cfd8f87"
server_key_iv: "9a6b1fd67e857e8563092d9fe9ff143e"
server_key_version: "encryptionkey@0"
I20260811 15:03:44.346918 26512 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 15:03:44.349459 26530 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:44.350731 26512 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 15:03:44.350886 26512 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786460596631409-20401-0/minicluster-data/master-0/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786460596631409-20401-0/minicluster-data/master-0/wal
uuid: "f7919a03e56740afa537eecd8c87ab1b"
format_stamp: "Formatted at 2026-08-11 15:03:44 on dist-test-slave-8n49"
server_key: "e13a4c117034422b23c03f9d4cfd8f87"
server_key_iv: "9a6b1fd67e857e8563092d9fe9ff143e"
server_key_version: "encryptionkey@0"
I20260811 15:03:44.351017 26512 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786460596631409-20401-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786460596631409-20401-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786460596631409-20401-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:03:44.373062 26512 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:03:44.373878 26512 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:03:44.374109 26512 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:03:44.381371 26512 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.126:39685
I20260811 15:03:44.381388 26587 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.126:39685 every 8 connection(s)
I20260811 15:03:44.382349 26512 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
I20260811 15:03:44.384732 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 26512
I20260811 15:03:44.384862 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786460596631409-20401-0/minicluster-data/master-0/wal/instance
I20260811 15:03:44.385208 20401 external_mini_cluster.cc:1428] Setting key cb10663b5a1e680109ea15b766d7a5ad
I20260811 15:03:44.386106 26589 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:03:44.392089 26589 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f7919a03e56740afa537eecd8c87ab1b: Bootstrap starting.
I20260811 15:03:44.394491 26589 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f7919a03e56740afa537eecd8c87ab1b: Neither blocks nor log segments found. Creating new log.
I20260811 15:03:44.394582 26592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:44.386606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37652 (local address 127.19.236.126:39685)
0811 15:03:44.387370 (+ 764us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:44.387388 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:44.387448 (+ 60us) server_negotiation.cc:407] Connection header received
0811 15:03:44.388127 (+ 679us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:44.388144 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:44.388627 (+ 483us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:44.388966 (+ 339us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:44.389399 (+ 433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:44.390355 (+ 956us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:44.391243 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:44.391711 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:44.391887 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:44.392873 (+ 986us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:44.392878 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:44.392889 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:03:44.393259 (+ 370us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:44.393313 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:03:44.393332 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:44.393440 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:44.393606 (+ 166us) server_negotiation.cc:299] Negotiation successful
0811 15:03:44.393855 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":336,"thread_start_us":154,"threads_started":1}
I20260811 15:03:44.395306 26589 log.cc:824] T 00000000000000000000000000000000 P f7919a03e56740afa537eecd8c87ab1b: Log is configured to *not* fsync() on all Append() calls
I20260811 15:03:44.397495 20401 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 15:03:44.397660 26589 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f7919a03e56740afa537eecd8c87ab1b: No bootstrap required, opened a new log
I20260811 15:03:44.401501 26589 raft_consensus.cc:348] T 00000000000000000000000000000000 P f7919a03e56740afa537eecd8c87ab1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7919a03e56740afa537eecd8c87ab1b" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 39685 } }
I20260811 15:03:44.401746 26589 raft_consensus.cc:374] T 00000000000000000000000000000000 P f7919a03e56740afa537eecd8c87ab1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:03:44.401808 26589 raft_consensus.cc:729] T 00000000000000000000000000000000 P f7919a03e56740afa537eecd8c87ab1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7919a03e56740afa537eecd8c87ab1b, State: Initialized, Role: FOLLOWER
I20260811 15:03:44.402215 26589 consensus_queue.cc:260] T 00000000000000000000000000000000 P f7919a03e56740afa537eecd8c87ab1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7919a03e56740afa537eecd8c87ab1b" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 39685 } }
I20260811 15:03:44.402366 26589 raft_consensus.cc:388] T 00000000000000000000000000000000 P f7919a03e56740afa537eecd8c87ab1b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 15:03:44.402457 26589 raft_consensus.cc:482] T 00000000000000000000000000000000 P f7919a03e56740afa537eecd8c87ab1b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 15:03:44.402557 26589 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f7919a03e56740afa537eecd8c87ab1b [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:03:44.403517 26589 raft_consensus.cc:504] T 00000000000000000000000000000000 P f7919a03e56740afa537eecd8c87ab1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7919a03e56740afa537eecd8c87ab1b" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 39685 } }
I20260811 15:03:44.403852 26589 leader_election.cc:302] T 00000000000000000000000000000000 P f7919a03e56740afa537eecd8c87ab1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f7919a03e56740afa537eecd8c87ab1b; no voters:
I20260811 15:03:44.404162 26589 leader_election.cc:288] T 00000000000000000000000000000000 P f7919a03e56740afa537eecd8c87ab1b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 15:03:44.404304 26594 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f7919a03e56740afa537eecd8c87ab1b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:03:44.404623 26594 raft_consensus.cc:686] T 00000000000000000000000000000000 P f7919a03e56740afa537eecd8c87ab1b [term 1 LEADER]: Becoming Leader. State: Replica: f7919a03e56740afa537eecd8c87ab1b, State: Running, Role: LEADER
I20260811 15:03:44.405263 26594 consensus_queue.cc:237] T 00000000000000000000000000000000 P f7919a03e56740afa537eecd8c87ab1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7919a03e56740afa537eecd8c87ab1b" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 39685 } }
I20260811 15:03:44.405534 26589 sys_catalog.cc:564] T 00000000000000000000000000000000 P f7919a03e56740afa537eecd8c87ab1b [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:03:44.406942 26597 sys_catalog.cc:455] T 00000000000000000000000000000000 P f7919a03e56740afa537eecd8c87ab1b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f7919a03e56740afa537eecd8c87ab1b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7919a03e56740afa537eecd8c87ab1b" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 39685 } } }
I20260811 15:03:44.407078 26597 sys_catalog.cc:458] T 00000000000000000000000000000000 P f7919a03e56740afa537eecd8c87ab1b [sys.catalog]: This master's current role is: LEADER
I20260811 15:03:44.407361 26595 sys_catalog.cc:455] T 00000000000000000000000000000000 P f7919a03e56740afa537eecd8c87ab1b [sys.catalog]: SysCatalogTable state changed. Reason: New leader f7919a03e56740afa537eecd8c87ab1b. Latest consensus state: current_term: 1 leader_uuid: "f7919a03e56740afa537eecd8c87ab1b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7919a03e56740afa537eecd8c87ab1b" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 39685 } } }
I20260811 15:03:44.407457 26595 sys_catalog.cc:458] T 00000000000000000000000000000000 P f7919a03e56740afa537eecd8c87ab1b [sys.catalog]: This master's current role is: LEADER
W20260811 15:03:44.410336 26612 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f7919a03e56740afa537eecd8c87ab1b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 15:03:44.410444 26612 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 15:03:44.410555 26607 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:03:44.411482 26607 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:03:44.417006 26607 catalog_manager.cc:1347] Generated new cluster ID: 36390943802e4529ab4b32833c7062b5
I20260811 15:03:44.417068 26607 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:03:44.430500 26607 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 15:03:44.431519 26607 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:03:44.438342 26607 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f7919a03e56740afa537eecd8c87ab1b: Generated new TSK 0
I20260811 15:03:44.439170 26607 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 15:03:44.452577 26592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:44.447439 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37664 (local address 127.19.236.126:39685)
0811 15:03:44.447581 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:44.447585 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:44.447787 (+ 202us) server_negotiation.cc:407] Connection header received
0811 15:03:44.447950 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:44.447952 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:44.447999 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:44.448086 (+ 87us) server_negotiation.cc:226] Negotiated authn=JWT
0811 15:03:44.448358 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:44.448928 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:44.450205 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:44.450415 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:44.450488 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:44.450820 (+ 332us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 15:03:44.452183 (+ 1363us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37233/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0811 15:03:44.452425 (+ 242us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:37664: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37233/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":56}
W20260811 15:03:44.452642 26592 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:37664: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37233/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260811 15:03:44.454674 26622 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:03:44.447376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:39685 (local address 127.0.0.1:37664)
0811 15:03:44.447691 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:44.447707 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:44.447825 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:44.448115 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:44.448119 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:44.448127 (+ 8us) client_negotiation.cc:189] Negotiated authn=JWT
0811 15:03:44.448243 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:44.448249 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:44.449061 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:44.449065 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:44.450076 (+ 1011us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:44.450086 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:44.450536 (+ 450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:44.450542 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:44.450636 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:44.450665 (+ 29us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 15:03:44.452349 (+ 1684us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37233/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0811 15:03:44.454495 (+ 2146us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.19.236.126:39685: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37233/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":229,"mutex_wait_us":1923,"thread_start_us":123,"threads_started":1}
I20260811 15:03:44.455380 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 26512
E20260811 15:03:44.468834 26623 webserver.cc:533] Webserver: sslize failed:
E20260811 15:03:44.468919 26623 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-11T15:03:44Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (314 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-11T15:03:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T15:03:44Z Disabled control of system clock
I20260811 15:03:44.510902 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786460596631409-20401-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786460596631409-20401-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786460596631409-20401-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:44231
--webserver_interface=127.19.236.126
--webserver_port=0
--builtin_ntp_servers=127.19.236.84:35651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.236.126:44231
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786460596631409-20401-0/testchainca.cert with env {}
W20260811 15:03:44.623747 26627 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:03:44.624037 26627 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:03:44.624078 26627 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:03:44.628281 26627 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:03:44.628350 26627 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:03:44.628366 26627 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:03:44.628383 26627 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:03:44.628398 26627 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 15:03:44.628415 26627 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 15:03:44.628428 26627 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260811 15:03:44.634033 26627 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:35651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786460596631409-20401-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786460596631409-20401-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.236.126:44231
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:44231
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.236.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786460596631409-20401-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26627
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786460596631409-20401-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:03:44.635154 26627 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:03:44.636250 26627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:03:44.645344 26632 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:44.645349 26633 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:44.645344 26635 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:44.645553 26627 server_base.cc:1034] running on GCE node
I20260811 15:03:44.646136 26627 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:03:44.647321 26627 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:03:44.648535 26627 hybrid_clock.cc:648] HybridClock initialized: now 1786460624648515 us; error 31 us; skew 500 ppm
I20260811 15:03:44.650470 26627 webserver.cc:460] Webserver started at http://127.19.236.126:39229/ using document root <none> and password file <none>
I20260811 15:03:44.651083 26627 fs_manager.cc:359] Metadata directory not provided
I20260811 15:03:44.651182 26627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:03:44.651427 26627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:03:44.653613 26627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786460596631409-20401-0/minicluster-data/master-0/data/instance:
uuid: "4448f14a387849d6ac08a286ff3eb8a9"
format_stamp: "Formatted at 2026-08-11 15:03:44 on dist-test-slave-8n49"
server_key: "e539f9b6f71c4ef4b2876e907f110579"
server_key_iv: "5cd83b28a5d625effa759a11ddb7b25d"
server_key_version: "encryptionkey@0"
I20260811 15:03:44.654203 26627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786460596631409-20401-0/minicluster-data/master-0/wal/instance:
uuid: "4448f14a387849d6ac08a286ff3eb8a9"
format_stamp: "Formatted at 2026-08-11 15:03:44 on dist-test-slave-8n49"
server_key: "e539f9b6f71c4ef4b2876e907f110579"
server_key_iv: "5cd83b28a5d625effa759a11ddb7b25d"
server_key_version: "encryptionkey@0"
I20260811 15:03:44.658046 26627 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 15:03:44.660629 26642 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:44.661827 26627 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260811 15:03:44.661974 26627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786460596631409-20401-0/minicluster-data/master-0/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786460596631409-20401-0/minicluster-data/master-0/wal
uuid: "4448f14a387849d6ac08a286ff3eb8a9"
format_stamp: "Formatted at 2026-08-11 15:03:44 on dist-test-slave-8n49"
server_key: "e539f9b6f71c4ef4b2876e907f110579"
server_key_iv: "5cd83b28a5d625effa759a11ddb7b25d"
server_key_version: "encryptionkey@0"
I20260811 15:03:44.662096 26627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786460596631409-20401-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786460596631409-20401-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786460596631409-20401-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:03:44.692607 26627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:03:44.693395 26627 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:03:44.693627 26627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:03:44.700901 26627 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.126:44231
I20260811 15:03:44.700935 26701 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.126:44231 every 8 connection(s)
I20260811 15:03:44.701906 26627 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
I20260811 15:03:44.704778 26702 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:03:44.707513 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 26627
I20260811 15:03:44.707649 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786460596631409-20401-0/minicluster-data/master-0/wal/instance
I20260811 15:03:44.707916 20401 external_mini_cluster.cc:1428] Setting key cf13d39cdd3664de98ad44ba553b2f53
I20260811 15:03:44.710561 26702 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4448f14a387849d6ac08a286ff3eb8a9: Bootstrap starting.
I20260811 15:03:44.713622 26702 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4448f14a387849d6ac08a286ff3eb8a9: Neither blocks nor log segments found. Creating new log.
I20260811 15:03:44.714564 26702 log.cc:824] T 00000000000000000000000000000000 P 4448f14a387849d6ac08a286ff3eb8a9: Log is configured to *not* fsync() on all Append() calls
I20260811 15:03:44.717053 26702 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4448f14a387849d6ac08a286ff3eb8a9: No bootstrap required, opened a new log
I20260811 15:03:44.717543 26705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:44.709351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37018 (local address 127.19.236.126:44231)
0811 15:03:44.709983 (+ 632us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:44.709999 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:44.710033 (+ 34us) server_negotiation.cc:407] Connection header received
0811 15:03:44.710632 (+ 599us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:44.710648 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:44.711094 (+ 446us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:44.711365 (+ 271us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:44.711778 (+ 413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:44.712829 (+ 1051us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:44.714163 (+ 1334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:44.714616 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:44.714791 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:44.715795 (+ 1004us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:44.715800 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:44.715813 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:03:44.716183 (+ 370us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:44.716237 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:03:44.716257 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:44.716339 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:44.716526 (+ 187us) server_negotiation.cc:299] Negotiation successful
0811 15:03:44.716793 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":289,"thread_start_us":149,"threads_started":1}
I20260811 15:03:44.720414 20401 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 15:03:44.721289 26702 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4448f14a387849d6ac08a286ff3eb8a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4448f14a387849d6ac08a286ff3eb8a9" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 44231 } }
I20260811 15:03:44.721629 26702 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4448f14a387849d6ac08a286ff3eb8a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:03:44.721720 26702 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4448f14a387849d6ac08a286ff3eb8a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4448f14a387849d6ac08a286ff3eb8a9, State: Initialized, Role: FOLLOWER
I20260811 15:03:44.722240 26702 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4448f14a387849d6ac08a286ff3eb8a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4448f14a387849d6ac08a286ff3eb8a9" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 44231 } }
I20260811 15:03:44.722455 26702 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4448f14a387849d6ac08a286ff3eb8a9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 15:03:44.722563 26702 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4448f14a387849d6ac08a286ff3eb8a9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 15:03:44.722677 26702 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4448f14a387849d6ac08a286ff3eb8a9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:03:44.723764 26702 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4448f14a387849d6ac08a286ff3eb8a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4448f14a387849d6ac08a286ff3eb8a9" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 44231 } }
I20260811 15:03:44.724172 26702 leader_election.cc:302] T 00000000000000000000000000000000 P 4448f14a387849d6ac08a286ff3eb8a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4448f14a387849d6ac08a286ff3eb8a9; no voters:
I20260811 15:03:44.724766 26702 leader_election.cc:288] T 00000000000000000000000000000000 P 4448f14a387849d6ac08a286ff3eb8a9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 15:03:44.724922 26708 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4448f14a387849d6ac08a286ff3eb8a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:03:44.725176 26708 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4448f14a387849d6ac08a286ff3eb8a9 [term 1 LEADER]: Becoming Leader. State: Replica: 4448f14a387849d6ac08a286ff3eb8a9, State: Running, Role: LEADER
I20260811 15:03:44.725525 26708 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4448f14a387849d6ac08a286ff3eb8a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4448f14a387849d6ac08a286ff3eb8a9" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 44231 } }
I20260811 15:03:44.726295 26702 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4448f14a387849d6ac08a286ff3eb8a9 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:03:44.727355 26710 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4448f14a387849d6ac08a286ff3eb8a9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4448f14a387849d6ac08a286ff3eb8a9. Latest consensus state: current_term: 1 leader_uuid: "4448f14a387849d6ac08a286ff3eb8a9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4448f14a387849d6ac08a286ff3eb8a9" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 44231 } } }
I20260811 15:03:44.727535 26710 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4448f14a387849d6ac08a286ff3eb8a9 [sys.catalog]: This master's current role is: LEADER
I20260811 15:03:44.727905 26709 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4448f14a387849d6ac08a286ff3eb8a9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4448f14a387849d6ac08a286ff3eb8a9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4448f14a387849d6ac08a286ff3eb8a9" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 44231 } } }
I20260811 15:03:44.728022 26709 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4448f14a387849d6ac08a286ff3eb8a9 [sys.catalog]: This master's current role is: LEADER
I20260811 15:03:44.729059 26720 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:03:44.731959 26720 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:03:44.738103 26720 catalog_manager.cc:1347] Generated new cluster ID: 4a031e8e9f234b0f84bff167a05656ba
I20260811 15:03:44.738178 26720 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:03:44.747519 26720 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 15:03:44.748874 26720 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:03:44.763661 26720 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4448f14a387849d6ac08a286ff3eb8a9: Generated new TSK 0
I20260811 15:03:44.764662 26720 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 15:03:45.695816 26705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:44.776460 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37030 (local address 127.19.236.126:44231)
0811 15:03:44.776636 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:44.776642 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:44.776840 (+ 198us) server_negotiation.cc:407] Connection header received
0811 15:03:44.777051 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:44.777054 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:44.777107 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:44.777209 (+ 102us) server_negotiation.cc:226] Negotiated authn=JWT
0811 15:03:44.777503 (+ 294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:44.778038 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:44.779266 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:44.779495 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:44.779576 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:44.779920 (+ 344us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 15:03:45.695247 (+915327us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0811 15:03:45.695653 (+ 406us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:37030: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":64}
W20260811 15:03:45.695922 26705 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:37030: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260811 15:03:45.695935 26735 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:03:44.776387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:44231 (local address 127.0.0.1:37030)
0811 15:03:44.776740 (+ 353us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:44.776756 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:44.776880 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:44.777257 (+ 377us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:44.777260 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:44.777269 (+ 9us) client_negotiation.cc:189] Negotiated authn=JWT
0811 15:03:44.777385 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:44.777391 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:44.778149 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:44.778153 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:44.779138 (+ 985us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:44.779148 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:44.779622 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:44.779626 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:44.779722 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:44.779752 (+ 30us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 15:03:45.695540 (+915788us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0811 15:03:45.695741 (+ 201us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.19.236.126:44231: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":147,"threads_started":1}
I20260811 15:03:45.696875 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 26627
2026-08-11T15:03:45Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (1218 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (126 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (132 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 15:03:46 dist-test-slave-8n49 krb5kdc[26750](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 15:03:46 dist-test-slave-8n49 krb5kdc[26750](info): set up 2 sockets
Aug 11 15:03:46 dist-test-slave-8n49 krb5kdc[26750](info): commencing operation
krb5kdc: starting...
W20260811 15:03:47.094269 20401 mini_kdc.cc:121] Time spent starting KDC: real 1.115s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/krb5kdc/test-user.keytab.
Aug 11 15:03:47 dist-test-slave-8n49 krb5kdc[26750](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460627, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T15:03:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T15:03:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.236.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.236.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.236.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab.
Entry for principal kudu/127.19.236.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab.
I20260811 15:03:47.227408 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:39427
--webserver_interface=127.19.236.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab
--principal=kudu/127.19.236.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:36437
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.236.126:39427
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:03:47.342275 26764 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:03:47.342666 26764 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:03:47.342747 26764 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:03:47.346912 26764 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:03:47.347003 26764 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:03:47.347043 26764 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:03:47.347096 26764 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:03:47.347136 26764 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:03:47.352837 26764 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:36437
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.236.126:39427
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab
--principal=kudu/127.19.236.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:39427
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.236.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26764
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:03:47.354233 26764 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:03:47.355326 26764 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:03:47.364470 26774 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:47.364478 26771 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:47.364482 26772 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:47.364652 26764 server_base.cc:1034] running on GCE node
I20260811 15:03:47.365362 26764 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:03:47.366564 26764 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:03:47.367760 26764 hybrid_clock.cc:648] HybridClock initialized: now 1786460627367742 us; error 31 us; skew 500 ppm
Aug 11 15:03:47 dist-test-slave-8n49 krb5kdc[26750](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460627, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:03:47.374811 26764 init.cc:377] Logged in from keytab as kudu/127.19.236.126@KRBTEST.COM (short username kudu)
I20260811 15:03:47.376119 26764 webserver.cc:460] Webserver started at http://127.19.236.126:45901/ using document root <none> and password file <none>
I20260811 15:03:47.376981 26764 fs_manager.cc:359] Metadata directory not provided
I20260811 15:03:47.377077 26764 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:03:47.377341 26764 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:03:47.379882 26764 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/minicluster-data/master-0/data/instance:
uuid: "0e853800110045b9bd23c244b0cf17d2"
format_stamp: "Formatted at 2026-08-11 15:03:47 on dist-test-slave-8n49"
server_key: "b4557573e895e549fcd716b5280109b8"
server_key_iv: "4ab03040cf0b24dca35f053b74ac43aa"
server_key_version: "encryptionkey@0"
I20260811 15:03:47.380429 26764 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/minicluster-data/master-0/wal/instance:
uuid: "0e853800110045b9bd23c244b0cf17d2"
format_stamp: "Formatted at 2026-08-11 15:03:47 on dist-test-slave-8n49"
server_key: "b4557573e895e549fcd716b5280109b8"
server_key_iv: "4ab03040cf0b24dca35f053b74ac43aa"
server_key_version: "encryptionkey@0"
I20260811 15:03:47.384457 26764 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260811 15:03:47.387043 26781 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:47.388406 26764 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 15:03:47.388530 26764 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/minicluster-data/master-0/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/minicluster-data/master-0/wal
uuid: "0e853800110045b9bd23c244b0cf17d2"
format_stamp: "Formatted at 2026-08-11 15:03:47 on dist-test-slave-8n49"
server_key: "b4557573e895e549fcd716b5280109b8"
server_key_iv: "4ab03040cf0b24dca35f053b74ac43aa"
server_key_version: "encryptionkey@0"
I20260811 15:03:47.388702 26764 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:03:47.401918 26764 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:03:47.405364 26764 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:03:47.405535 26764 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:03:47.412755 26764 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.126:39427
I20260811 15:03:47.412779 26840 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.126:39427 every 8 connection(s)
I20260811 15:03:47.413695 26764 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
I20260811 15:03:47.414806 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 26764
I20260811 15:03:47.414901 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/minicluster-data/master-0/wal/instance
I20260811 15:03:47.415208 20401 external_mini_cluster.cc:1428] Setting key 9e7f5f59c2bfcf63d6fd3c9f022b2392
I20260811 15:03:47.416795 26841 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:03:47.422402 26841 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0e853800110045b9bd23c244b0cf17d2: Bootstrap starting.
Aug 11 15:03:47 dist-test-slave-8n49 krb5kdc[26750](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460627, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
I20260811 15:03:47.425096 26841 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0e853800110045b9bd23c244b0cf17d2: Neither blocks nor log segments found. Creating new log.
I20260811 15:03:47.425835 26841 log.cc:824] T 00000000000000000000000000000000 P 0e853800110045b9bd23c244b0cf17d2: Log is configured to *not* fsync() on all Append() calls
I20260811 15:03:47.428357 26841 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0e853800110045b9bd23c244b0cf17d2: No bootstrap required, opened a new log
I20260811 15:03:47.429786 26845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:47.416656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47860 (local address 127.19.236.126:39427)
0811 15:03:47.417100 (+ 444us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:47.417114 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:47.417149 (+ 35us) server_negotiation.cc:407] Connection header received
0811 15:03:47.417771 (+ 622us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:47.417787 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:47.418088 (+ 301us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:47.418407 (+ 319us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:47.419209 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:47.420202 (+ 993us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:47.421161 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:47.421619 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:47.421788 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:47.424649 (+ 2861us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:47.424654 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:47.424666 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:47.424693 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:47.426652 (+ 1959us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:47.427281 (+ 629us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:47.427286 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:47.427291 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:47.427410 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:47.427800 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:47.427803 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:47.427804 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:47.428192 (+ 388us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:47.428338 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:47.428749 (+ 411us) server_negotiation.cc:299] Negotiation successful
0811 15:03:47.429069 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":309,"thread_start_us":138,"threads_started":1}
I20260811 15:03:47.432524 26841 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0e853800110045b9bd23c244b0cf17d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e853800110045b9bd23c244b0cf17d2" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 39427 } }
I20260811 15:03:47.432817 26841 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0e853800110045b9bd23c244b0cf17d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:03:47.432896 26841 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0e853800110045b9bd23c244b0cf17d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e853800110045b9bd23c244b0cf17d2, State: Initialized, Role: FOLLOWER
I20260811 15:03:47.433312 26841 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0e853800110045b9bd23c244b0cf17d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e853800110045b9bd23c244b0cf17d2" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 39427 } }
I20260811 15:03:47.433475 26841 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0e853800110045b9bd23c244b0cf17d2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 15:03:47.433547 26841 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0e853800110045b9bd23c244b0cf17d2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 15:03:47.433687 26841 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0e853800110045b9bd23c244b0cf17d2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:03:47.434667 26841 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0e853800110045b9bd23c244b0cf17d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e853800110045b9bd23c244b0cf17d2" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 39427 } }
I20260811 15:03:47.435021 26841 leader_election.cc:302] T 00000000000000000000000000000000 P 0e853800110045b9bd23c244b0cf17d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0e853800110045b9bd23c244b0cf17d2; no voters:
I20260811 15:03:47.435352 26841 leader_election.cc:288] T 00000000000000000000000000000000 P 0e853800110045b9bd23c244b0cf17d2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 15:03:47.435573 26848 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0e853800110045b9bd23c244b0cf17d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:03:47.435847 26848 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0e853800110045b9bd23c244b0cf17d2 [term 1 LEADER]: Becoming Leader. State: Replica: 0e853800110045b9bd23c244b0cf17d2, State: Running, Role: LEADER
I20260811 15:03:47.436159 26848 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0e853800110045b9bd23c244b0cf17d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e853800110045b9bd23c244b0cf17d2" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 39427 } }
I20260811 15:03:47.436841 26841 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0e853800110045b9bd23c244b0cf17d2 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:03:47.438372 26849 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0e853800110045b9bd23c244b0cf17d2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0e853800110045b9bd23c244b0cf17d2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e853800110045b9bd23c244b0cf17d2" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 39427 } } }
I20260811 15:03:47.438524 26849 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0e853800110045b9bd23c244b0cf17d2 [sys.catalog]: This master's current role is: LEADER
I20260811 15:03:47.438823 26850 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0e853800110045b9bd23c244b0cf17d2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0e853800110045b9bd23c244b0cf17d2. Latest consensus state: current_term: 1 leader_uuid: "0e853800110045b9bd23c244b0cf17d2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e853800110045b9bd23c244b0cf17d2" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 39427 } } }
I20260811 15:03:47.438915 26860 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:03:47.438998 26850 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0e853800110045b9bd23c244b0cf17d2 [sys.catalog]: This master's current role is: LEADER
I20260811 15:03:47.441872 26860 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:03:47.448311 26860 catalog_manager.cc:1347] Generated new cluster ID: 39bf090d1b01429dbb00383369ae23c8
I20260811 15:03:47.448398 26860 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:03:47.463685 26860 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 15:03:47.465080 26860 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:03:47.469732 26860 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0e853800110045b9bd23c244b0cf17d2: Generated new TSK 0
I20260811 15:03:47.470572 26860 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.236.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.236.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.236.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.65.keytab.
Entry for principal kudu/127.19.236.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.65.keytab.
I20260811 15:03:47.503859 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.65:0
--local_ip_for_outbound_sockets=127.19.236.65
--webserver_interface=127.19.236.65
--webserver_port=0
--tserver_master_addrs=127.19.236.126:39427
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.65.keytab
--principal=kudu/127.19.236.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:36437
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:03:47.622267 26872 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:03:47.622601 26872 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:03:47.622679 26872 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:03:47.626837 26872 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:03:47.626940 26872 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:03:47.627031 26872 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.65
I20260811 15:03:47.632381 26872 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:36437
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.65.keytab
--principal=kudu/127.19.236.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.236.65
--webserver_port=0
--tserver_master_addrs=127.19.236.126:39427
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26872
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.65
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:03:47.633561 26872 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:03:47.634634 26872 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:03:47.644649 26877 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:47.644697 26872 server_base.cc:1034] running on GCE node
W20260811 15:03:47.644649 26881 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:47.644675 26878 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:47.645313 26872 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:03:47.645963 26872 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:03:47.647152 26872 hybrid_clock.cc:648] HybridClock initialized: now 1786460627647130 us; error 31 us; skew 500 ppm
Aug 11 15:03:47 dist-test-slave-8n49 krb5kdc[26750](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460627, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:03:47.650142 26872 init.cc:377] Logged in from keytab as kudu/127.19.236.65@KRBTEST.COM (short username kudu)
I20260811 15:03:47.651139 26872 webserver.cc:460] Webserver started at http://127.19.236.65:32903/ using document root <none> and password file <none>
I20260811 15:03:47.651748 26872 fs_manager.cc:359] Metadata directory not provided
I20260811 15:03:47.651846 26872 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:03:47.652102 26872 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:03:47.654335 26872 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/minicluster-data/ts-0/data/instance:
uuid: "f6546343bab74ef082bb66be1ef53a85"
format_stamp: "Formatted at 2026-08-11 15:03:47 on dist-test-slave-8n49"
server_key: "69c5ccfefec69ca74b1225fdb60c71a3"
server_key_iv: "acedfc4ff2990c55e9bdc3700b209ce4"
server_key_version: "encryptionkey@0"
I20260811 15:03:47.654948 26872 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/minicluster-data/ts-0/wal/instance:
uuid: "f6546343bab74ef082bb66be1ef53a85"
format_stamp: "Formatted at 2026-08-11 15:03:47 on dist-test-slave-8n49"
server_key: "69c5ccfefec69ca74b1225fdb60c71a3"
server_key_iv: "acedfc4ff2990c55e9bdc3700b209ce4"
server_key_version: "encryptionkey@0"
I20260811 15:03:47.658921 26872 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.002s
I20260811 15:03:47.661711 26888 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:47.662957 26872 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 15:03:47.663103 26872 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/minicluster-data/ts-0/wal
uuid: "f6546343bab74ef082bb66be1ef53a85"
format_stamp: "Formatted at 2026-08-11 15:03:47 on dist-test-slave-8n49"
server_key: "69c5ccfefec69ca74b1225fdb60c71a3"
server_key_iv: "acedfc4ff2990c55e9bdc3700b209ce4"
server_key_version: "encryptionkey@0"
I20260811 15:03:47.663230 26872 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:03:47.685967 26872 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:03:47.689514 26872 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:03:47.689743 26872 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:03:47.690382 26872 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:03:47.691252 26872 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:03:47.691326 26872 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:47.691409 26872 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:03:47.691462 26872 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:47.700943 26872 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.65:43663
I20260811 15:03:47.700973 27015 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.65:43663 every 8 connection(s)
I20260811 15:03:47.701865 26872 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
Aug 11 15:03:47 dist-test-slave-8n49 krb5kdc[26750](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460627, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.65@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
I20260811 15:03:47.712069 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 26872
I20260811 15:03:47.712211 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/minicluster-data/ts-0/wal/instance
I20260811 15:03:47.712512 20401 external_mini_cluster.cc:1428] Setting key 43efe6d4d4ecb68d61380fd79c265b89
I20260811 15:03:47.716437 26845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:47.703688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.65:55989 (local address 127.19.236.126:39427)
0811 15:03:47.703844 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:47.703849 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:47.704780 (+ 931us) server_negotiation.cc:407] Connection header received
0811 15:03:47.706151 (+ 1371us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:47.706154 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:47.706204 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:47.706284 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:47.707456 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:47.708021 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:47.709561 (+ 1540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:47.710009 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:47.710115 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:47.712723 (+ 2608us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:47.712726 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:47.712728 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:47.712754 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:47.714268 (+ 1514us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:47.714828 (+ 560us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:47.714832 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:47.714833 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:47.714911 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:47.715279 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:47.715283 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:47.715284 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:47.715474 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:47.715586 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:47.716118 (+ 532us) server_negotiation.cc:299] Negotiation successful
0811 15:03:47.716259 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 15:03:47.717446 27018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:47.704109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:39427 (local address 127.19.236.65:55989)
0811 15:03:47.704626 (+ 517us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:47.704671 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:47.705919 (+ 1248us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:47.706457 (+ 538us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:47.706463 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:47.706832 (+ 369us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:47.707313 (+ 481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:47.707326 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:47.708135 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:47.708137 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:47.709353 (+ 1216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:47.709369 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:47.710164 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:47.710167 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:47.710309 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:47.710850 (+ 541us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:03:47.710867 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:47.712511 (+ 1644us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:47.714397 (+ 1886us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:47.714404 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:47.714421 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:47.714705 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:47.715006 (+ 301us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:47.715013 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:47.715017 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:47.715171 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:47.715587 (+ 416us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:47.715595 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:47.715862 (+ 267us) client_negotiation.cc:769] Sending connection context
0811 15:03:47.716060 (+ 198us) client_negotiation.cc:240] Negotiation successful
0811 15:03:47.716402 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":122,"threads_started":1}
I20260811 15:03:47.718803 27016 heartbeater.cc:347] Connected to a master server at 127.19.236.126:39427
I20260811 15:03:47.719089 27016 heartbeater.cc:464] Registering TS with master...
I20260811 15:03:47.719738 27016 heartbeater.cc:511] Master 127.19.236.126:39427 requested a full tablet report, sending...
I20260811 15:03:47.721669 26800 ts_manager.cc:194] Registered new tserver with Master: f6546343bab74ef082bb66be1ef53a85 (127.19.236.65:43663)
I20260811 15:03:47.723412 26800 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.236.65@KRBTEST.COM'} at 127.19.236.65:55989
WARNING: no policy specified for kudu/127.19.236.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.236.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.236.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.66.keytab.
Entry for principal kudu/127.19.236.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.66.keytab.
I20260811 15:03:47.743896 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.66:0
--local_ip_for_outbound_sockets=127.19.236.66
--webserver_interface=127.19.236.66
--webserver_port=0
--tserver_master_addrs=127.19.236.126:39427
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.66.keytab
--principal=kudu/127.19.236.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:36437
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:03:47.861783 27022 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:03:47.862102 27022 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:03:47.862174 27022 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:03:47.866382 27022 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:03:47.866473 27022 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:03:47.866561 27022 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.66
I20260811 15:03:47.872233 27022 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:36437
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.66.keytab
--principal=kudu/127.19.236.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.236.66
--webserver_port=0
--tserver_master_addrs=127.19.236.126:39427
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27022
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.66
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:03:47.873492 27022 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:03:47.874563 27022 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:03:47.884784 27027 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:47.884807 27031 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:47.884981 27022 server_base.cc:1034] running on GCE node
W20260811 15:03:47.884773 27029 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:47.885447 27022 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:03:47.886137 27022 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:03:47.887317 27022 hybrid_clock.cc:648] HybridClock initialized: now 1786460627887281 us; error 48 us; skew 500 ppm
Aug 11 15:03:47 dist-test-slave-8n49 krb5kdc[26750](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460627, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:03:47.890317 27022 init.cc:377] Logged in from keytab as kudu/127.19.236.66@KRBTEST.COM (short username kudu)
I20260811 15:03:47.891232 27022 webserver.cc:460] Webserver started at http://127.19.236.66:41655/ using document root <none> and password file <none>
I20260811 15:03:47.891896 27022 fs_manager.cc:359] Metadata directory not provided
I20260811 15:03:47.891996 27022 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:03:47.892241 27022 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:03:47.894511 27022 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/minicluster-data/ts-1/data/instance:
uuid: "8457c5edc26045ee94f18866aefa63ea"
format_stamp: "Formatted at 2026-08-11 15:03:47 on dist-test-slave-8n49"
server_key: "cbc79f5899844f7bf162ec0edd7a6e6c"
server_key_iv: "e6fce167e9d1dde401dd85e6216aa11a"
server_key_version: "encryptionkey@0"
I20260811 15:03:47.895108 27022 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/minicluster-data/ts-1/wal/instance:
uuid: "8457c5edc26045ee94f18866aefa63ea"
format_stamp: "Formatted at 2026-08-11 15:03:47 on dist-test-slave-8n49"
server_key: "cbc79f5899844f7bf162ec0edd7a6e6c"
server_key_iv: "e6fce167e9d1dde401dd85e6216aa11a"
server_key_version: "encryptionkey@0"
I20260811 15:03:47.899067 27022 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 15:03:47.901721 27038 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:47.902989 27022 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 15:03:47.903136 27022 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/minicluster-data/ts-1/wal
uuid: "8457c5edc26045ee94f18866aefa63ea"
format_stamp: "Formatted at 2026-08-11 15:03:47 on dist-test-slave-8n49"
server_key: "cbc79f5899844f7bf162ec0edd7a6e6c"
server_key_iv: "e6fce167e9d1dde401dd85e6216aa11a"
server_key_version: "encryptionkey@0"
I20260811 15:03:47.903268 27022 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:03:47.925084 27022 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:03:47.928507 27022 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:03:47.928853 27022 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:03:47.929920 27022 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:03:47.930899 27022 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:03:47.930980 27022 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:47.931064 27022 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:03:47.931124 27022 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:47.942118 27022 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.66:36855
I20260811 15:03:47.942142 27164 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.66:36855 every 8 connection(s)
I20260811 15:03:47.943145 27022 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
I20260811 15:03:47.951959 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 27022
I20260811 15:03:47.952111 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/minicluster-data/ts-1/wal/instance
I20260811 15:03:47.952432 20401 external_mini_cluster.cc:1428] Setting key e1edb572b3ae6551db48c624f7504446
Aug 11 15:03:47 dist-test-slave-8n49 krb5kdc[26750](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460627, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.66@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
I20260811 15:03:47.957754 26845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:47.945137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.66:57175 (local address 127.19.236.126:39427)
0811 15:03:47.945320 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:47.945326 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:47.946230 (+ 904us) server_negotiation.cc:407] Connection header received
0811 15:03:47.947647 (+ 1417us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:47.947651 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:47.947704 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:47.947784 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:47.949049 (+ 1265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:47.949622 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:47.950761 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:47.951007 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:47.951104 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:47.954018 (+ 2914us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:47.954022 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:47.954026 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:47.954054 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:47.955508 (+ 1454us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:47.956060 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:47.956065 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:47.956067 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:47.956151 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:47.956507 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:47.956512 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:47.956514 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:47.956775 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:47.956887 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:47.957426 (+ 539us) server_negotiation.cc:299] Negotiation successful
0811 15:03:47.957570 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260811 15:03:47.958606 27167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:47.945595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:39427 (local address 127.19.236.66:57175)
0811 15:03:47.946070 (+ 475us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:47.946116 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:47.947435 (+ 1319us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:47.947952 (+ 517us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:47.947959 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:47.948324 (+ 365us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:47.948894 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:47.948910 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:47.949732 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:47.949735 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:47.950628 (+ 893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:47.950637 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:47.951170 (+ 533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:47.951173 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:47.951318 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:47.951997 (+ 679us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:03:47.952016 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:47.953833 (+ 1817us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:47.955641 (+ 1808us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:47.955648 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:47.955666 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:47.955950 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:47.956249 (+ 299us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:47.956252 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:47.956254 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:47.956406 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:47.956888 (+ 482us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:47.956896 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:47.957168 (+ 272us) client_negotiation.cc:769] Sending connection context
0811 15:03:47.957367 (+ 199us) client_negotiation.cc:240] Negotiation successful
0811 15:03:47.957747 (+ 380us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":282,"thread_start_us":133,"threads_started":1}
I20260811 15:03:47.959975 27165 heartbeater.cc:347] Connected to a master server at 127.19.236.126:39427
I20260811 15:03:47.960235 27165 heartbeater.cc:464] Registering TS with master...
I20260811 15:03:47.960824 27165 heartbeater.cc:511] Master 127.19.236.126:39427 requested a full tablet report, sending...
I20260811 15:03:47.962023 26800 ts_manager.cc:194] Registered new tserver with Master: 8457c5edc26045ee94f18866aefa63ea (127.19.236.66:36855)
I20260811 15:03:47.962878 26800 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.236.66@KRBTEST.COM'} at 127.19.236.66:57175
WARNING: no policy specified for kudu/127.19.236.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.236.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.236.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.67.keytab.
Entry for principal kudu/127.19.236.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.67.keytab.
I20260811 15:03:47.981863 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.67:0
--local_ip_for_outbound_sockets=127.19.236.67
--webserver_interface=127.19.236.67
--webserver_port=0
--tserver_master_addrs=127.19.236.126:39427
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.67.keytab
--principal=kudu/127.19.236.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:36437
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:03:48.100338 27172 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:03:48.100720 27172 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:03:48.100813 27172 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:03:48.104960 27172 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:03:48.105046 27172 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:03:48.105131 27172 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.67
I20260811 15:03:48.110795 27172 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:36437
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.67.keytab
--principal=kudu/127.19.236.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.236.67
--webserver_port=0
--tserver_master_addrs=127.19.236.126:39427
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27172
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.67
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:03:48.111959 27172 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:03:48.113092 27172 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:03:48.122978 27177 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:48.122985 27180 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:48.122978 27178 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:48.123311 27172 server_base.cc:1034] running on GCE node
I20260811 15:03:48.123775 27172 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:03:48.124439 27172 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:03:48.125627 27172 hybrid_clock.cc:648] HybridClock initialized: now 1786460628125611 us; error 24 us; skew 500 ppm
Aug 11 15:03:48 dist-test-slave-8n49 krb5kdc[26750](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460628, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:03:48.128459 27172 init.cc:377] Logged in from keytab as kudu/127.19.236.67@KRBTEST.COM (short username kudu)
I20260811 15:03:48.129467 27172 webserver.cc:460] Webserver started at http://127.19.236.67:33185/ using document root <none> and password file <none>
I20260811 15:03:48.130060 27172 fs_manager.cc:359] Metadata directory not provided
I20260811 15:03:48.130156 27172 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:03:48.130398 27172 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:03:48.132489 27172 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/minicluster-data/ts-2/data/instance:
uuid: "f0b1bfc0254a4201905a4563b295b3a3"
format_stamp: "Formatted at 2026-08-11 15:03:48 on dist-test-slave-8n49"
server_key: "133c89135cd869cb192c6b6a1a4f0f3e"
server_key_iv: "64ec49f8573c5d7c5225be1747d13729"
server_key_version: "encryptionkey@0"
I20260811 15:03:48.133150 27172 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/minicluster-data/ts-2/wal/instance:
uuid: "f0b1bfc0254a4201905a4563b295b3a3"
format_stamp: "Formatted at 2026-08-11 15:03:48 on dist-test-slave-8n49"
server_key: "133c89135cd869cb192c6b6a1a4f0f3e"
server_key_iv: "64ec49f8573c5d7c5225be1747d13729"
server_key_version: "encryptionkey@0"
I20260811 15:03:48.136974 27172 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260811 15:03:48.139571 27189 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:48.140929 27172 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 15:03:48.141077 27172 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/minicluster-data/ts-2/wal
uuid: "f0b1bfc0254a4201905a4563b295b3a3"
format_stamp: "Formatted at 2026-08-11 15:03:48 on dist-test-slave-8n49"
server_key: "133c89135cd869cb192c6b6a1a4f0f3e"
server_key_iv: "64ec49f8573c5d7c5225be1747d13729"
server_key_version: "encryptionkey@0"
I20260811 15:03:48.141201 27172 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:03:48.163234 27172 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:03:48.166806 27172 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:03:48.167037 27172 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:03:48.167685 27172 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:03:48.168655 27172 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:03:48.168725 27172 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:48.168798 27172 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:03:48.168840 27172 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:48.178083 27172 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.67:43805
I20260811 15:03:48.178105 27313 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.67:43805 every 8 connection(s)
I20260811 15:03:48.179033 27172 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
I20260811 15:03:48.179687 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 27172
I20260811 15:03:48.179831 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/minicluster-data/ts-2/wal/instance
I20260811 15:03:48.180197 20401 external_mini_cluster.cc:1428] Setting key 3916a33976f243e13306414030652514
Aug 11 15:03:48 dist-test-slave-8n49 krb5kdc[26750](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460628, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.67@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
I20260811 15:03:48.193727 26845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:48.181206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.67:55229 (local address 127.19.236.126:39427)
0811 15:03:48.181350 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:48.181357 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:48.182373 (+ 1016us) server_negotiation.cc:407] Connection header received
0811 15:03:48.183912 (+ 1539us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:48.183916 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:48.183987 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:48.184061 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:48.185416 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:48.185967 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:48.187151 (+ 1184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:48.187357 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:48.187435 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:48.190003 (+ 2568us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:48.190007 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:48.190009 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:48.190035 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:48.191444 (+ 1409us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:48.192029 (+ 585us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:48.192033 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:48.192034 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:48.192119 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:48.192460 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:48.192462 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:48.192464 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:48.192749 (+ 285us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:48.192870 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:48.193387 (+ 517us) server_negotiation.cc:299] Negotiation successful
0811 15:03:48.193525 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 15:03:48.194880 27316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:48.181669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:39427 (local address 127.19.236.67:55229)
0811 15:03:48.182201 (+ 532us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:48.182257 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:48.183693 (+ 1436us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:48.184270 (+ 577us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:48.184278 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:48.184751 (+ 473us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:48.185236 (+ 485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:48.185250 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:48.186114 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:48.186117 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:48.187032 (+ 915us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:48.187042 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:48.187496 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:48.187498 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:48.187641 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:48.188285 (+ 644us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:03:48.188302 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:48.189820 (+ 1518us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:48.191601 (+ 1781us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:48.191606 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:48.191618 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:48.191879 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:48.192212 (+ 333us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:48.192214 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:48.192216 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:48.192352 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:48.192876 (+ 524us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:48.192882 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:48.193126 (+ 244us) client_negotiation.cc:769] Sending connection context
0811 15:03:48.193322 (+ 196us) client_negotiation.cc:240] Negotiation successful
0811 15:03:48.193720 (+ 398us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":312,"thread_start_us":172,"threads_started":1}
I20260811 15:03:48.195938 27314 heartbeater.cc:347] Connected to a master server at 127.19.236.126:39427
I20260811 15:03:48.196213 27314 heartbeater.cc:464] Registering TS with master...
I20260811 15:03:48.196802 27314 heartbeater.cc:511] Master 127.19.236.126:39427 requested a full tablet report, sending...
I20260811 15:03:48.197840 26800 ts_manager.cc:194] Registered new tserver with Master: f0b1bfc0254a4201905a4563b295b3a3 (127.19.236.67:43805)
I20260811 15:03:48.198421 26800 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.236.67@KRBTEST.COM'} at 127.19.236.67:55229
I20260811 15:03:48.206704 20401 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/krb5kdc/test-admin.keytab.
Aug 11 15:03:48 dist-test-slave-8n49 krb5kdc[26750](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460628, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:03:48.224890 20401 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260811 15:03:48.227869 27321 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:03:48.226381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56618 (local address 127.19.236.65:43663)
0811 15:03:48.226733 (+ 352us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:48.226741 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:48.226765 (+ 24us) server_negotiation.cc:407] Connection header received
0811 15:03:48.226818 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:48.226823 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:48.227013 (+ 190us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:48.227138 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:48.227709 (+ 571us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56618: BlockingRecv error: recv got EOF from 127.0.0.1:56618 (error 108)
Metrics: {"server-negotiator.queue_time_us":245,"thread_start_us":151,"threads_started":1}
W20260811 15:03:48.228240 20401 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/krb5kdc/krb5cc' of type FILE
Aug 11 15:03:48 dist-test-slave-8n49 krb5kdc[26750](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460628, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:03:48.229365 20401 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 15:03:48 dist-test-slave-8n49 krb5kdc[26750](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460628, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:03:48.230377 20401 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 15:03:48 dist-test-slave-8n49 krb5kdc[26750](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460628, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.236.65@KRBTEST.COM
I20260811 15:03:48.241025 27321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:48.231316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56620 (local address 127.19.236.65:43663)
0811 15:03:48.231459 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:48.231462 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:48.231480 (+ 18us) server_negotiation.cc:407] Connection header received
0811 15:03:48.231608 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:48.231610 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:48.231649 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:48.231720 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:48.232299 (+ 579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:48.233183 (+ 884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:48.234073 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:48.234456 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:48.234553 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:48.237156 (+ 2603us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:48.237167 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:48.237183 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:48.237210 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:48.239001 (+ 1791us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:48.239458 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:48.239464 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:48.239466 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:48.239555 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:48.239928 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:48.239932 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:48.239934 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:48.240225 (+ 291us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:48.240418 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:48.240724 (+ 306us) server_negotiation.cc:299] Negotiation successful
0811 15:03:48.240888 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
W20260811 15:03:48.245275 27321 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:03:48.244127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56628 (local address 127.19.236.65:43663)
0811 15:03:48.244290 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:48.244293 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:48.244364 (+ 71us) server_negotiation.cc:407] Connection header received
0811 15:03:48.244466 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:48.244469 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:48.244508 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:48.244644 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:48.245157 (+ 513us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56628: BlockingRecv error: recv got EOF from 127.0.0.1:56628 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
W20260811 15:03:48.245419 20401 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/krb5kdc/krb5cc' of type FILE
Aug 11 15:03:48 dist-test-slave-8n49 krb5kdc[26750](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460628, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:03:48.246690 20401 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 15:03:48 dist-test-slave-8n49 krb5kdc[26750](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460628, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:03:48.247710 20401 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 15:03:48 dist-test-slave-8n49 krb5kdc[26750](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460628, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.236.65@KRBTEST.COM
I20260811 15:03:48.257207 27321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:48.248700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56644 (local address 127.19.236.65:43663)
0811 15:03:48.248843 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:48.248849 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:48.248952 (+ 103us) server_negotiation.cc:407] Connection header received
0811 15:03:48.249109 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:48.249113 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:48.249161 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:48.249251 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:48.249779 (+ 528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:48.250296 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:48.251098 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:48.251329 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:48.251451 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:48.254196 (+ 2745us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:48.254200 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:48.254202 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:48.254227 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:48.255499 (+ 1272us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:48.255946 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:48.255949 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:48.255950 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:48.256025 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:48.256309 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:48.256313 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:48.256315 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:48.256485 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:48.256658 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:48.256908 (+ 250us) server_negotiation.cc:299] Negotiation successful
0811 15:03:48.257027 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
W20260811 15:03:48.259953 27321 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:03:48.259061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56652 (local address 127.19.236.65:43663)
0811 15:03:48.259223 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:48.259226 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:48.259240 (+ 14us) server_negotiation.cc:407] Connection header received
0811 15:03:48.259357 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:48.259360 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:48.259396 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:48.259469 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:48.259851 (+ 382us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56652: BlockingRecv error: recv got EOF from 127.0.0.1:56652 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
W20260811 15:03:48.260084 20401 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786460596631409-20401-0/krb5kdc/krb5cc' of type FILE
Aug 11 15:03:48 dist-test-slave-8n49 krb5kdc[26750](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460628, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:03:48.261234 20401 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 15:03:48 dist-test-slave-8n49 krb5kdc[26750](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460628, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:03:48.262286 20401 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 15:03:48 dist-test-slave-8n49 krb5kdc[26750](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460628, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.236.65@KRBTEST.COM
I20260811 15:03:48.271330 27321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:48.263177 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56654 (local address 127.19.236.65:43663)
0811 15:03:48.263311 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:48.263314 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:48.263351 (+ 37us) server_negotiation.cc:407] Connection header received
0811 15:03:48.263465 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:48.263468 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:48.263504 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:48.263579 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:48.264087 (+ 508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:48.264721 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:48.265542 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:48.265780 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:48.265877 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:48.268390 (+ 2513us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:48.268393 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:48.268396 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:48.268418 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:48.269879 (+ 1461us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:48.270293 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:48.270296 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:48.270297 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:48.270372 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:48.270641 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:48.270644 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:48.270645 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:48.270817 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:48.270958 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:48.271106 (+ 148us) server_negotiation.cc:299] Negotiation successful
0811 15:03:48.271201 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 15:03:48.272536 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 26872
I20260811 15:03:48.282992 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 27022
I20260811 15:03:48.298307 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 27172
I20260811 15:03:48.308301 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 26764
2026-08-11T15:03:48Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (2353 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 15:03:48 dist-test-slave-8n49 krb5kdc[27335](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 15:03:48 dist-test-slave-8n49 krb5kdc[27335](info): set up 2 sockets
Aug 11 15:03:48 dist-test-slave-8n49 krb5kdc[27335](info): commencing operation
krb5kdc: starting...
W20260811 15:03:49.414769 20401 mini_kdc.cc:121] Time spent starting KDC: real 1.083s user 0.005s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/krb5kdc/test-user.keytab.
Aug 11 15:03:49 dist-test-slave-8n49 krb5kdc[27335](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460629, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T15:03:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T15:03:49Z Disabled control of system clock
WARNING: no policy specified for oryx/127.19.236.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.19.236.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.19.236.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/krb5kdc/oryx_127.19.236.126.keytab.
Entry for principal oryx/127.19.236.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/krb5kdc/oryx_127.19.236.126.keytab.
I20260811 15:03:49.552068 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:45445
--webserver_interface=127.19.236.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/krb5kdc/oryx_127.19.236.126.keytab
--principal=oryx/127.19.236.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:41993
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.236.126:45445
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:03:49.670488 27349 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:03:49.670806 27349 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:03:49.670886 27349 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:03:49.675014 27349 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:03:49.675110 27349 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:03:49.675148 27349 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:03:49.675210 27349 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:03:49.675247 27349 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:03:49.680751 27349 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:41993
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.236.126:45445
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/krb5kdc/oryx_127.19.236.126.keytab
--principal=oryx/127.19.236.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:45445
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.236.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27349
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:03:49.681902 27349 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:03:49.682981 27349 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:03:49.692031 27355 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:49.692212 27359 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:49.692031 27356 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:49.692121 27349 server_base.cc:1034] running on GCE node
I20260811 15:03:49.693009 27349 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:03:49.694159 27349 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:03:49.695325 27349 hybrid_clock.cc:648] HybridClock initialized: now 1786460629695313 us; error 27 us; skew 500 ppm
Aug 11 15:03:49 dist-test-slave-8n49 krb5kdc[27335](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460629, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.236.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:03:49.698261 27349 init.cc:377] Logged in from keytab as oryx/127.19.236.126@KRBTEST.COM (short username oryx)
I20260811 15:03:49.699225 27349 webserver.cc:460] Webserver started at http://127.19.236.126:44719/ using document root <none> and password file <none>
I20260811 15:03:49.699769 27349 fs_manager.cc:359] Metadata directory not provided
I20260811 15:03:49.699828 27349 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:03:49.700006 27349 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:03:49.702113 27349 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/master-0/data/instance:
uuid: "dfa4f7cc43ed43e1bb70ce239a69cd99"
format_stamp: "Formatted at 2026-08-11 15:03:49 on dist-test-slave-8n49"
server_key: "b1edd04b2b925ebf0ea6d41b1c6dcb75"
server_key_iv: "784ad71b0d25e386d1a7b644ca9a0492"
server_key_version: "encryptionkey@0"
I20260811 15:03:49.702629 27349 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/master-0/wal/instance:
uuid: "dfa4f7cc43ed43e1bb70ce239a69cd99"
format_stamp: "Formatted at 2026-08-11 15:03:49 on dist-test-slave-8n49"
server_key: "b1edd04b2b925ebf0ea6d41b1c6dcb75"
server_key_iv: "784ad71b0d25e386d1a7b644ca9a0492"
server_key_version: "encryptionkey@0"
I20260811 15:03:49.706423 27349 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260811 15:03:49.708873 27366 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:49.710199 27349 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260811 15:03:49.710343 27349 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/master-0/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/master-0/wal
uuid: "dfa4f7cc43ed43e1bb70ce239a69cd99"
format_stamp: "Formatted at 2026-08-11 15:03:49 on dist-test-slave-8n49"
server_key: "b1edd04b2b925ebf0ea6d41b1c6dcb75"
server_key_iv: "784ad71b0d25e386d1a7b644ca9a0492"
server_key_version: "encryptionkey@0"
I20260811 15:03:49.710464 27349 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:03:49.730482 27349 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:03:49.734321 27349 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:03:49.734489 27349 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:03:49.741801 27349 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.126:45445
I20260811 15:03:49.742120 27427 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.126:45445 every 8 connection(s)
I20260811 15:03:49.742887 27349 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
I20260811 15:03:49.745939 27428 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:03:49.749605 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 27349
I20260811 15:03:49.749769 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/master-0/wal/instance
I20260811 15:03:49.750066 20401 external_mini_cluster.cc:1428] Setting key 9bc7fa6101b87495248cfe313647e15f
I20260811 15:03:49.752669 27428 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dfa4f7cc43ed43e1bb70ce239a69cd99: Bootstrap starting.
I20260811 15:03:49.755590 27428 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dfa4f7cc43ed43e1bb70ce239a69cd99: Neither blocks nor log segments found. Creating new log.
I20260811 15:03:49.756668 27428 log.cc:824] T 00000000000000000000000000000000 P dfa4f7cc43ed43e1bb70ce239a69cd99: Log is configured to *not* fsync() on all Append() calls
I20260811 15:03:49.759064 27428 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dfa4f7cc43ed43e1bb70ce239a69cd99: No bootstrap required, opened a new log
Aug 11 15:03:49 dist-test-slave-8n49 krb5kdc[27335](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460629, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM
I20260811 15:03:49.763737 27428 raft_consensus.cc:348] T 00000000000000000000000000000000 P dfa4f7cc43ed43e1bb70ce239a69cd99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dfa4f7cc43ed43e1bb70ce239a69cd99" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 45445 } }
I20260811 15:03:49.764050 27428 raft_consensus.cc:374] T 00000000000000000000000000000000 P dfa4f7cc43ed43e1bb70ce239a69cd99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:03:49.764106 27428 raft_consensus.cc:729] T 00000000000000000000000000000000 P dfa4f7cc43ed43e1bb70ce239a69cd99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dfa4f7cc43ed43e1bb70ce239a69cd99, State: Initialized, Role: FOLLOWER
I20260811 15:03:49.764684 27428 consensus_queue.cc:260] T 00000000000000000000000000000000 P dfa4f7cc43ed43e1bb70ce239a69cd99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dfa4f7cc43ed43e1bb70ce239a69cd99" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 45445 } }
I20260811 15:03:49.764824 27428 raft_consensus.cc:388] T 00000000000000000000000000000000 P dfa4f7cc43ed43e1bb70ce239a69cd99 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 15:03:49.764914 27428 raft_consensus.cc:482] T 00000000000000000000000000000000 P dfa4f7cc43ed43e1bb70ce239a69cd99 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 15:03:49.765066 27428 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dfa4f7cc43ed43e1bb70ce239a69cd99 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:03:49.766031 27428 raft_consensus.cc:504] T 00000000000000000000000000000000 P dfa4f7cc43ed43e1bb70ce239a69cd99 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dfa4f7cc43ed43e1bb70ce239a69cd99" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 45445 } }
I20260811 15:03:49.766402 27428 leader_election.cc:302] T 00000000000000000000000000000000 P dfa4f7cc43ed43e1bb70ce239a69cd99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dfa4f7cc43ed43e1bb70ce239a69cd99; no voters:
I20260811 15:03:49.766814 27428 leader_election.cc:288] T 00000000000000000000000000000000 P dfa4f7cc43ed43e1bb70ce239a69cd99 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 15:03:49.766901 27433 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dfa4f7cc43ed43e1bb70ce239a69cd99 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:03:49.767114 27433 raft_consensus.cc:686] T 00000000000000000000000000000000 P dfa4f7cc43ed43e1bb70ce239a69cd99 [term 1 LEADER]: Becoming Leader. State: Replica: dfa4f7cc43ed43e1bb70ce239a69cd99, State: Running, Role: LEADER
I20260811 15:03:49.767496 27433 consensus_queue.cc:237] T 00000000000000000000000000000000 P dfa4f7cc43ed43e1bb70ce239a69cd99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dfa4f7cc43ed43e1bb70ce239a69cd99" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 45445 } }
I20260811 15:03:49.767879 27431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:49.751585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43464 (local address 127.19.236.126:45445)
0811 15:03:49.752050 (+ 465us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:49.752070 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:49.752113 (+ 43us) server_negotiation.cc:407] Connection header received
0811 15:03:49.752993 (+ 880us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:49.753017 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:49.753430 (+ 413us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:49.753798 (+ 368us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:49.755186 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:49.756774 (+ 1588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:49.757750 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:49.758456 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:49.758617 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:49.761702 (+ 3085us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:49.761709 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:49.761729 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:49.761766 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:49.764452 (+ 2686us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:49.765019 (+ 567us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:49.765030 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:49.765034 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:49.765185 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:49.765502 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:49.765505 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:49.765507 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:49.765942 (+ 435us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:49.766147 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:49.766469 (+ 322us) server_negotiation.cc:299] Negotiation successful
0811 15:03:49.766821 (+ 352us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":288,"thread_start_us":121,"threads_started":1}
I20260811 15:03:49.768214 27428 sys_catalog.cc:564] T 00000000000000000000000000000000 P dfa4f7cc43ed43e1bb70ce239a69cd99 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:03:49.769335 27434 sys_catalog.cc:455] T 00000000000000000000000000000000 P dfa4f7cc43ed43e1bb70ce239a69cd99 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dfa4f7cc43ed43e1bb70ce239a69cd99" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dfa4f7cc43ed43e1bb70ce239a69cd99" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 45445 } } }
I20260811 15:03:49.769466 27434 sys_catalog.cc:458] T 00000000000000000000000000000000 P dfa4f7cc43ed43e1bb70ce239a69cd99 [sys.catalog]: This master's current role is: LEADER
I20260811 15:03:49.769860 27435 sys_catalog.cc:455] T 00000000000000000000000000000000 P dfa4f7cc43ed43e1bb70ce239a69cd99 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dfa4f7cc43ed43e1bb70ce239a69cd99. Latest consensus state: current_term: 1 leader_uuid: "dfa4f7cc43ed43e1bb70ce239a69cd99" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dfa4f7cc43ed43e1bb70ce239a69cd99" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 45445 } } }
I20260811 15:03:49.769996 27435 sys_catalog.cc:458] T 00000000000000000000000000000000 P dfa4f7cc43ed43e1bb70ce239a69cd99 [sys.catalog]: This master's current role is: LEADER
I20260811 15:03:49.770797 27443 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:03:49.773679 27443 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:03:49.779881 27443 catalog_manager.cc:1347] Generated new cluster ID: 2f2396d66c644234b32f65149aa17925
I20260811 15:03:49.779963 27443 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:03:49.794867 27443 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 15:03:49.796221 27443 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:03:49.814545 27443 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dfa4f7cc43ed43e1bb70ce239a69cd99: Generated new TSK 0
I20260811 15:03:49.815442 27443 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.19.236.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.19.236.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.19.236.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/krb5kdc/oryx_127.19.236.65.keytab.
Entry for principal oryx/127.19.236.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/krb5kdc/oryx_127.19.236.65.keytab.
I20260811 15:03:49.848413 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.65:0
--local_ip_for_outbound_sockets=127.19.236.65
--webserver_interface=127.19.236.65
--webserver_port=0
--tserver_master_addrs=127.19.236.126:45445
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/krb5kdc/oryx_127.19.236.65.keytab
--principal=oryx/127.19.236.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:41993
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:03:49.965114 27456 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:03:49.965436 27456 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:03:49.965517 27456 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:03:49.969854 27456 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:03:49.969971 27456 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:03:49.970096 27456 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.65
I20260811 15:03:49.975505 27456 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:41993
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/krb5kdc/oryx_127.19.236.65.keytab
--principal=oryx/127.19.236.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.236.65
--webserver_port=0
--tserver_master_addrs=127.19.236.126:45445
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27456
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.65
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:03:49.976703 27456 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:03:49.977733 27456 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:03:49.987797 27464 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:49.987828 27462 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:49.987941 27456 server_base.cc:1034] running on GCE node
W20260811 15:03:49.987850 27461 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:49.988471 27456 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:03:49.989229 27456 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:03:49.990422 27456 hybrid_clock.cc:648] HybridClock initialized: now 1786460629990405 us; error 27 us; skew 500 ppm
Aug 11 15:03:49 dist-test-slave-8n49 krb5kdc[27335](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460629, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.236.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:03:49.993175 27456 init.cc:377] Logged in from keytab as oryx/127.19.236.65@KRBTEST.COM (short username oryx)
I20260811 15:03:49.994053 27456 webserver.cc:460] Webserver started at http://127.19.236.65:40373/ using document root <none> and password file <none>
I20260811 15:03:49.994643 27456 fs_manager.cc:359] Metadata directory not provided
I20260811 15:03:49.994735 27456 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:03:49.994975 27456 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:03:49.997117 27456 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-0/data/instance:
uuid: "55302221fdca40ec9f7bf6d725c0da72"
format_stamp: "Formatted at 2026-08-11 15:03:49 on dist-test-slave-8n49"
server_key: "398d81fc84130685497d1127b5a19090"
server_key_iv: "5eef159e862ebe8e5f3b68379390670d"
server_key_version: "encryptionkey@0"
I20260811 15:03:49.997689 27456 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-0/wal/instance:
uuid: "55302221fdca40ec9f7bf6d725c0da72"
format_stamp: "Formatted at 2026-08-11 15:03:49 on dist-test-slave-8n49"
server_key: "398d81fc84130685497d1127b5a19090"
server_key_iv: "5eef159e862ebe8e5f3b68379390670d"
server_key_version: "encryptionkey@0"
I20260811 15:03:50.001370 27456 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260811 15:03:50.003796 27472 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:50.005151 27456 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 15:03:50.005295 27456 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-0/wal
uuid: "55302221fdca40ec9f7bf6d725c0da72"
format_stamp: "Formatted at 2026-08-11 15:03:49 on dist-test-slave-8n49"
server_key: "398d81fc84130685497d1127b5a19090"
server_key_iv: "5eef159e862ebe8e5f3b68379390670d"
server_key_version: "encryptionkey@0"
I20260811 15:03:50.005414 27456 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:03:50.025597 27456 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:03:50.029000 27456 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:03:50.029222 27456 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:03:50.029856 27456 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:03:50.030759 27456 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:03:50.030831 27456 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:50.030920 27456 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:03:50.030970 27456 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:50.039836 27456 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.65:32827
I20260811 15:03:50.039857 27604 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.65:32827 every 8 connection(s)
I20260811 15:03:50.040827 27456 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
I20260811 15:03:50.046545 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 27456
I20260811 15:03:50.046718 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-0/wal/instance
I20260811 15:03:50.047057 20401 external_mini_cluster.cc:1428] Setting key 13a7abd6ae392caf63573b0d9f8bbaba
Aug 11 15:03:50 dist-test-slave-8n49 krb5kdc[27335](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460629, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.236.65@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM
I20260811 15:03:50.056368 27431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:50.042826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.65:47045 (local address 127.19.236.126:45445)
0811 15:03:50.042998 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:50.043002 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:50.043830 (+ 828us) server_negotiation.cc:407] Connection header received
0811 15:03:50.045265 (+ 1435us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:50.045269 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:50.045333 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:50.045414 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:50.046715 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:50.047376 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:50.048606 (+ 1230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:50.048840 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:50.048964 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:50.051708 (+ 2744us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:50.051714 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:50.051718 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:50.051749 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:50.053689 (+ 1940us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:50.054414 (+ 725us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:50.054420 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:50.054423 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:50.054527 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:50.054940 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:50.054954 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:50.054958 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:50.055256 (+ 298us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:50.055381 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:50.055986 (+ 605us) server_negotiation.cc:299] Negotiation successful
0811 15:03:50.056150 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260811 15:03:50.057228 27607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:50.043184 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:45445 (local address 127.19.236.65:47045)
0811 15:03:50.043670 (+ 486us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:50.043714 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:50.045037 (+ 1323us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:50.045598 (+ 561us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:50.045604 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:50.045970 (+ 366us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:50.046469 (+ 499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:50.046483 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:50.047542 (+ 1059us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:50.047545 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:50.048437 (+ 892us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:50.048458 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:50.049014 (+ 556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:50.049018 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:50.049273 (+ 255us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:50.049941 (+ 668us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:03:50.049960 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:50.051523 (+ 1563us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:50.053854 (+ 2331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:50.053860 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:50.053876 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:50.054296 (+ 420us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:50.054658 (+ 362us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:50.054661 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:50.054662 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:50.054823 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:50.055400 (+ 577us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:50.055406 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:50.055698 (+ 292us) client_negotiation.cc:769] Sending connection context
0811 15:03:50.055884 (+ 186us) client_negotiation.cc:240] Negotiation successful
0811 15:03:50.056181 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":280,"thread_start_us":115,"threads_started":1}
WARNING: no policy specified for oryx/127.19.236.66@KRBTEST.COM; defaulting to no policy
I20260811 15:03:50.058836 27605 heartbeater.cc:347] Connected to a master server at 127.19.236.126:45445
I20260811 15:03:50.059134 27605 heartbeater.cc:464] Registering TS with master...
I20260811 15:03:50.059695 27605 heartbeater.cc:511] Master 127.19.236.126:45445 requested a full tablet report, sending...
I20260811 15:03:50.061474 27385 ts_manager.cc:194] Registered new tserver with Master: 55302221fdca40ec9f7bf6d725c0da72 (127.19.236.65:32827)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.19.236.66@KRBTEST.COM" created.
I20260811 15:03:50.063174 27385 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.19.236.65@KRBTEST.COM'} at 127.19.236.65:47045
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.19.236.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/krb5kdc/oryx_127.19.236.66.keytab.
Entry for principal oryx/127.19.236.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/krb5kdc/oryx_127.19.236.66.keytab.
I20260811 15:03:50.079479 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.66:0
--local_ip_for_outbound_sockets=127.19.236.66
--webserver_interface=127.19.236.66
--webserver_port=0
--tserver_master_addrs=127.19.236.126:45445
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/krb5kdc/oryx_127.19.236.66.keytab
--principal=oryx/127.19.236.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:41993
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:03:50.197041 27610 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:03:50.197336 27610 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:03:50.197391 27610 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:03:50.201488 27610 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:03:50.201553 27610 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:03:50.201613 27610 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.66
I20260811 15:03:50.207168 27610 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:41993
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/krb5kdc/oryx_127.19.236.66.keytab
--principal=oryx/127.19.236.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.236.66
--webserver_port=0
--tserver_master_addrs=127.19.236.126:45445
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27610
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.66
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:03:50.208381 27610 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:03:50.209597 27610 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:03:50.219548 27618 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:50.219645 27615 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:50.219630 27616 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:50.219791 27610 server_base.cc:1034] running on GCE node
I20260811 15:03:50.220261 27610 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:03:50.221110 27610 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:03:50.222311 27610 hybrid_clock.cc:648] HybridClock initialized: now 1786460630222285 us; error 33 us; skew 500 ppm
Aug 11 15:03:50 dist-test-slave-8n49 krb5kdc[27335](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460630, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.236.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:03:50.225209 27610 init.cc:377] Logged in from keytab as oryx/127.19.236.66@KRBTEST.COM (short username oryx)
I20260811 15:03:50.226111 27610 webserver.cc:460] Webserver started at http://127.19.236.66:42569/ using document root <none> and password file <none>
I20260811 15:03:50.226718 27610 fs_manager.cc:359] Metadata directory not provided
I20260811 15:03:50.226814 27610 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:03:50.227061 27610 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:03:50.229216 27610 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-1/data/instance:
uuid: "f6c63cee7b22430ea73e77d9429091a3"
format_stamp: "Formatted at 2026-08-11 15:03:50 on dist-test-slave-8n49"
server_key: "0f6e05386debbc11c5676cf2bd99d83e"
server_key_iv: "cc825448f2115f4c6f7f73051e842110"
server_key_version: "encryptionkey@0"
I20260811 15:03:50.229805 27610 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-1/wal/instance:
uuid: "f6c63cee7b22430ea73e77d9429091a3"
format_stamp: "Formatted at 2026-08-11 15:03:50 on dist-test-slave-8n49"
server_key: "0f6e05386debbc11c5676cf2bd99d83e"
server_key_iv: "cc825448f2115f4c6f7f73051e842110"
server_key_version: "encryptionkey@0"
I20260811 15:03:50.233644 27610 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260811 15:03:50.236128 27625 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:50.237478 27610 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260811 15:03:50.237643 27610 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-1/wal
uuid: "f6c63cee7b22430ea73e77d9429091a3"
format_stamp: "Formatted at 2026-08-11 15:03:50 on dist-test-slave-8n49"
server_key: "0f6e05386debbc11c5676cf2bd99d83e"
server_key_iv: "cc825448f2115f4c6f7f73051e842110"
server_key_version: "encryptionkey@0"
I20260811 15:03:50.237764 27610 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:03:50.263607 27610 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:03:50.267858 27610 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:03:50.268081 27610 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:03:50.268934 27610 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:03:50.270275 27610 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:03:50.270349 27610 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:50.270416 27610 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:03:50.270452 27610 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:50.280164 27610 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.66:36551
I20260811 15:03:50.280189 27752 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.66:36551 every 8 connection(s)
I20260811 15:03:50.281170 27610 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
I20260811 15:03:50.287751 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 27610
I20260811 15:03:50.287856 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-1/wal/instance
I20260811 15:03:50.288166 20401 external_mini_cluster.cc:1428] Setting key 25442f1247c1963bef4d46d897b3f214
Aug 11 15:03:50 dist-test-slave-8n49 krb5kdc[27335](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460630, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.236.66@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM
I20260811 15:03:50.296495 27431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:50.283114 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.66:47445 (local address 127.19.236.126:45445)
0811 15:03:50.283267 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:50.283271 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:50.284138 (+ 867us) server_negotiation.cc:407] Connection header received
0811 15:03:50.285595 (+ 1457us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:50.285598 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:50.285677 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:50.285784 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:50.286966 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:50.287520 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:50.288924 (+ 1404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:50.289177 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:50.289293 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:50.292225 (+ 2932us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:50.292232 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:50.292236 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:50.292272 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:50.294083 (+ 1811us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:50.294592 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:50.294600 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:50.294605 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:50.294721 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:50.295145 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:50.295151 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:50.295155 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:50.295427 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:50.295540 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:50.296069 (+ 529us) server_negotiation.cc:299] Negotiation successful
0811 15:03:50.296239 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 15:03:50.297269 27755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:50.283477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:45445 (local address 127.19.236.66:47445)
0811 15:03:50.283982 (+ 505us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:50.284025 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:50.285378 (+ 1353us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:50.285954 (+ 576us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:50.285961 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:50.286322 (+ 361us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:50.286813 (+ 491us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:50.286826 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:50.287654 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:50.287663 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:50.288785 (+ 1122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:50.288795 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:50.289336 (+ 541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:50.289340 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:50.289595 (+ 255us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:50.290281 (+ 686us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:03:50.290297 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:50.292035 (+ 1738us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:50.294208 (+ 2173us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:50.294214 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:50.294226 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:50.294482 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:50.294827 (+ 345us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:50.294829 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:50.294830 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:50.295024 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:50.295538 (+ 514us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:50.295543 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:50.295795 (+ 252us) client_negotiation.cc:769] Sending connection context
0811 15:03:50.295960 (+ 165us) client_negotiation.cc:240] Negotiation successful
0811 15:03:50.296243 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":305,"thread_start_us":122,"threads_started":1}
I20260811 15:03:50.298516 27753 heartbeater.cc:347] Connected to a master server at 127.19.236.126:45445
I20260811 15:03:50.298811 27753 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for oryx/127.19.236.67@KRBTEST.COM; defaulting to no policy
I20260811 15:03:50.299391 27753 heartbeater.cc:511] Master 127.19.236.126:45445 requested a full tablet report, sending...
I20260811 15:03:50.300514 27385 ts_manager.cc:194] Registered new tserver with Master: f6c63cee7b22430ea73e77d9429091a3 (127.19.236.66:36551)
I20260811 15:03:50.301129 27385 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.19.236.66@KRBTEST.COM'} at 127.19.236.66:47445
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.19.236.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.19.236.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/krb5kdc/oryx_127.19.236.67.keytab.
Entry for principal oryx/127.19.236.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/krb5kdc/oryx_127.19.236.67.keytab.
I20260811 15:03:50.320048 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.67:0
--local_ip_for_outbound_sockets=127.19.236.67
--webserver_interface=127.19.236.67
--webserver_port=0
--tserver_master_addrs=127.19.236.126:45445
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/krb5kdc/oryx_127.19.236.67.keytab
--principal=oryx/127.19.236.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:41993
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:03:50.436671 27759 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:03:50.437004 27759 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:03:50.437083 27759 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:03:50.441542 27759 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:03:50.441648 27759 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:03:50.441742 27759 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.67
I20260811 15:03:50.447296 27759 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:41993
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/krb5kdc/oryx_127.19.236.67.keytab
--principal=oryx/127.19.236.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.236.67
--webserver_port=0
--tserver_master_addrs=127.19.236.126:45445
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27759
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.67
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:03:50.448508 27759 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:03:50.449627 27759 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:03:50.460220 27766 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:50.460232 27764 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:50.460232 27768 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:50.460355 27759 server_base.cc:1034] running on GCE node
I20260811 15:03:50.460986 27759 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:03:50.461653 27759 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:03:50.462841 27759 hybrid_clock.cc:648] HybridClock initialized: now 1786460630462824 us; error 27 us; skew 500 ppm
Aug 11 15:03:50 dist-test-slave-8n49 krb5kdc[27335](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460630, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.236.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:03:50.465898 27759 init.cc:377] Logged in from keytab as oryx/127.19.236.67@KRBTEST.COM (short username oryx)
I20260811 15:03:50.466887 27759 webserver.cc:460] Webserver started at http://127.19.236.67:36755/ using document root <none> and password file <none>
I20260811 15:03:50.467502 27759 fs_manager.cc:359] Metadata directory not provided
I20260811 15:03:50.467595 27759 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:03:50.467845 27759 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:03:50.470204 27759 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-2/data/instance:
uuid: "df8cbef0d8594cbaa3c9f32b33b38654"
format_stamp: "Formatted at 2026-08-11 15:03:50 on dist-test-slave-8n49"
server_key: "7b8940269838107d867fa5999038e7ad"
server_key_iv: "1dff5331fb2598c617c6b1e12dd27246"
server_key_version: "encryptionkey@0"
I20260811 15:03:50.470808 27759 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-2/wal/instance:
uuid: "df8cbef0d8594cbaa3c9f32b33b38654"
format_stamp: "Formatted at 2026-08-11 15:03:50 on dist-test-slave-8n49"
server_key: "7b8940269838107d867fa5999038e7ad"
server_key_iv: "1dff5331fb2598c617c6b1e12dd27246"
server_key_version: "encryptionkey@0"
I20260811 15:03:50.474961 27759 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 15:03:50.478688 27776 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:50.480225 27759 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 15:03:50.480394 27759 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-2/wal
uuid: "df8cbef0d8594cbaa3c9f32b33b38654"
format_stamp: "Formatted at 2026-08-11 15:03:50 on dist-test-slave-8n49"
server_key: "7b8940269838107d867fa5999038e7ad"
server_key_iv: "1dff5331fb2598c617c6b1e12dd27246"
server_key_version: "encryptionkey@0"
I20260811 15:03:50.480543 27759 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:03:50.498044 27759 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:03:50.501580 27759 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:03:50.501814 27759 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:03:50.502475 27759 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:03:50.503400 27759 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:03:50.503456 27759 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:50.503527 27759 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:03:50.503571 27759 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:50.513995 27759 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.67:37021
I20260811 15:03:50.514076 27905 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.67:37021 every 8 connection(s)
I20260811 15:03:50.515023 27759 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
I20260811 15:03:50.518014 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 27759
I20260811 15:03:50.518152 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-2/wal/instance
I20260811 15:03:50.518517 20401 external_mini_cluster.cc:1428] Setting key 51a36a0cb2123a57ac558fb3ba12cd87
Aug 11 15:03:50 dist-test-slave-8n49 krb5kdc[27335](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460630, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.236.67@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM
I20260811 15:03:50.530779 27431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:50.517173 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.67:53179 (local address 127.19.236.126:45445)
0811 15:03:50.517346 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:50.517350 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:50.518302 (+ 952us) server_negotiation.cc:407] Connection header received
0811 15:03:50.520174 (+ 1872us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:50.520177 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:50.520231 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:50.520320 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:50.521686 (+ 1366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:50.522226 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:50.523373 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:50.523593 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:50.523680 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:50.526331 (+ 2651us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:50.526334 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:50.526336 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:50.526361 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:50.527735 (+ 1374us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:50.528327 (+ 592us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:50.528331 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:50.528332 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:50.528417 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:50.529017 (+ 600us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:50.529023 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:50.529025 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:50.529475 (+ 450us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:50.529583 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:50.530495 (+ 912us) server_negotiation.cc:299] Negotiation successful
0811 15:03:50.530623 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260811 15:03:50.532451 27908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:50.517554 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:45445 (local address 127.19.236.67:53179)
0811 15:03:50.518119 (+ 565us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:50.518181 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:50.519938 (+ 1757us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:50.520494 (+ 556us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:50.520501 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:50.521064 (+ 563us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:50.521552 (+ 488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:50.521566 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:50.522353 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:50.522355 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:50.523258 (+ 903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:50.523268 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:50.523731 (+ 463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:50.523734 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:50.523874 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:50.524514 (+ 640us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:03:50.524531 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:50.526160 (+ 1629us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:50.527882 (+ 1722us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:50.527888 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:50.527901 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:50.528202 (+ 301us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:50.528542 (+ 340us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:50.528545 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:50.528546 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:50.528761 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:50.529608 (+ 847us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:50.529614 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:50.530069 (+ 455us) client_negotiation.cc:769] Sending connection context
0811 15:03:50.530386 (+ 317us) client_negotiation.cc:240] Negotiation successful
0811 15:03:50.530880 (+ 494us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":319,"thread_start_us":116,"threads_started":1}
I20260811 15:03:50.533818 27906 heartbeater.cc:347] Connected to a master server at 127.19.236.126:45445
I20260811 15:03:50.534065 27906 heartbeater.cc:464] Registering TS with master...
I20260811 15:03:50.534560 27906 heartbeater.cc:511] Master 127.19.236.126:45445 requested a full tablet report, sending...
I20260811 15:03:50.535913 27385 ts_manager.cc:194] Registered new tserver with Master: df8cbef0d8594cbaa3c9f32b33b38654 (127.19.236.67:37021)
I20260811 15:03:50.536904 27385 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.19.236.67@KRBTEST.COM'} at 127.19.236.67:53179
I20260811 15:03:50.545667 20401 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.19.236.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.19.236.125@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.19.236.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/krb5kdc/oryx_127.19.236.125.keytab.
Entry for principal oryx/127.19.236.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/krb5kdc/oryx_127.19.236.125.keytab.
I20260811 15:03:50.578152 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.125:40287
--webserver_interface=127.19.236.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/krb5kdc/oryx_127.19.236.125.keytab
--principal=oryx/127.19.236.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:41993
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.236.126:45445,127.19.236.125:40287
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:03:50.696987 27912 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:03:50.697356 27912 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:03:50.697438 27912 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:03:50.701630 27912 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:03:50.701746 27912 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:03:50.701789 27912 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:03:50.701845 27912 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:03:50.701900 27912 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:03:50.707523 27912 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:41993
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.19.236.126:45445,127.19.236.125:40287
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/krb5kdc/oryx_127.19.236.125.keytab
--principal=oryx/127.19.236.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.125:40287
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.19.236.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27912
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
W20260811 15:03:50.707830 27912 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.19.236.126:45445,127.19.236.125:40287'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260811 15:03:50.708968 27912 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:03:50.710170 27912 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:03:50.719762 27918 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:50.719720 27912 server_base.cc:1034] running on GCE node
W20260811 15:03:50.719667 27921 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:50.719635 27919 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:50.720706 27912 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:03:50.721961 27912 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:03:50.723146 27912 hybrid_clock.cc:648] HybridClock initialized: now 1786460630723130 us; error 33 us; skew 500 ppm
Aug 11 15:03:50 dist-test-slave-8n49 krb5kdc[27335](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460630, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.236.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:03:50.726303 27912 init.cc:377] Logged in from keytab as oryx/127.19.236.125@KRBTEST.COM (short username oryx)
I20260811 15:03:50.727345 27912 webserver.cc:460] Webserver started at http://127.19.236.125:46873/ using document root <none> and password file <none>
I20260811 15:03:50.727949 27912 fs_manager.cc:359] Metadata directory not provided
I20260811 15:03:50.728055 27912 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:03:50.728307 27912 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:03:50.730538 27912 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/master-1/data/instance:
uuid: "a46978a611c144cdb5359f623cd44007"
format_stamp: "Formatted at 2026-08-11 15:03:50 on dist-test-slave-8n49"
server_key: "6633e83a1422b6baf12c1c74123ce1ff"
server_key_iv: "1e4d8ef3786c77173940b42c35632aff"
server_key_version: "encryptionkey@0"
I20260811 15:03:50.731151 27912 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/master-1/wal/instance:
uuid: "a46978a611c144cdb5359f623cd44007"
format_stamp: "Formatted at 2026-08-11 15:03:50 on dist-test-slave-8n49"
server_key: "6633e83a1422b6baf12c1c74123ce1ff"
server_key_iv: "1e4d8ef3786c77173940b42c35632aff"
server_key_version: "encryptionkey@0"
I20260811 15:03:50.735417 27912 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 15:03:50.738288 27928 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:50.739763 27912 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 15:03:50.739915 27912 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/master-1/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/master-1/wal
uuid: "a46978a611c144cdb5359f623cd44007"
format_stamp: "Formatted at 2026-08-11 15:03:50 on dist-test-slave-8n49"
server_key: "6633e83a1422b6baf12c1c74123ce1ff"
server_key_iv: "1e4d8ef3786c77173940b42c35632aff"
server_key_version: "encryptionkey@0"
I20260811 15:03:50.740039 27912 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:03:50.755934 27912 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:03:50.759068 27912 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:03:50.759238 27912 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:03:50.766546 27912 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.125:40287
I20260811 15:03:50.766829 27983 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.125:40287 every 8 connection(s)
I20260811 15:03:50.767608 27912 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/master-1/data/info.pb
I20260811 15:03:50.770776 27984 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:03:50.774566 27984 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.236.126" port: 45445 } has no permanent_uuid. Determining permanent_uuid...
I20260811 15:03:50.776679 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 27912
Aug 11 15:03:50 dist-test-slave-8n49 krb5kdc[27335](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460630, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.236.125@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM
Aug 11 15:03:50 dist-test-slave-8n49 krb5kdc[27335](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460629, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.19.236.125@KRBTEST.COM
I20260811 15:03:50.789211 27431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:50.776472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43480 (local address 127.19.236.126:45445)
0811 15:03:50.776640 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:50.776645 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:50.777641 (+ 996us) server_negotiation.cc:407] Connection header received
0811 15:03:50.778800 (+ 1159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:50.778803 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:50.778851 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:50.778919 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:50.779891 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:50.780419 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:50.781571 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:50.781832 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:50.781911 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:50.784844 (+ 2933us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:50.784847 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:50.784850 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:50.784875 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:50.786565 (+ 1690us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:50.787143 (+ 578us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:50.787146 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:50.787147 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:50.787231 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:50.787658 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:50.787663 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:50.787668 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:50.788008 (+ 340us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:50.788142 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:50.788861 (+ 719us) server_negotiation.cc:299] Negotiation successful
0811 15:03:50.789015 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 15:03:50.790442 27988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:50.776967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:45445 (local address 127.0.0.1:43480)
0811 15:03:50.777490 (+ 523us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:50.777542 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:50.778563 (+ 1021us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:50.779011 (+ 448us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:50.779016 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:50.779458 (+ 442us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:50.779736 (+ 278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:50.779751 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:50.780576 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:50.780580 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:50.781448 (+ 868us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:50.781458 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:50.781984 (+ 526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:50.781989 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:50.782179 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:50.782944 (+ 765us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:03:50.782977 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:50.784637 (+ 1660us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:50.786676 (+ 2039us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:50.786688 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:50.786703 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:50.787019 (+ 316us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:50.787323 (+ 304us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:50.787329 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:50.787334 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:50.787515 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:50.788166 (+ 651us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:50.788172 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:50.788526 (+ 354us) client_negotiation.cc:769] Sending connection context
0811 15:03:50.788769 (+ 243us) client_negotiation.cc:240] Negotiation successful
0811 15:03:50.789145 (+ 376us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":313,"mutex_wait_us":42,"thread_start_us":156,"threads_started":1}
I20260811 15:03:50.790442 27990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:50.777605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50776 (local address 127.19.236.125:40287)
0811 15:03:50.778025 (+ 420us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:50.778036 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:50.778076 (+ 40us) server_negotiation.cc:407] Connection header received
0811 15:03:50.778563 (+ 487us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:50.778590 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:50.778828 (+ 238us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:50.779031 (+ 203us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:50.779751 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:50.780818 (+ 1067us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:50.781659 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:50.782102 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:50.782265 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:50.785350 (+ 3085us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:50.785358 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:50.785375 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:50.785405 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:50.787292 (+ 1887us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:50.787904 (+ 612us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:50.787909 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:50.787910 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:50.787998 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:50.788313 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:50.788316 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:50.788317 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:50.788663 (+ 346us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:50.788881 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:50.789137 (+ 256us) server_negotiation.cc:299] Negotiation successful
0811 15:03:50.789265 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":52,"server-negotiator.queue_time_us":332,"spinlock_wait_cycles":35456,"thread_start_us":155,"threads_started":1}
I20260811 15:03:50.792052 27984 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.236.125" port: 40287 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 15:03:50 dist-test-slave-8n49 krb5kdc[27335](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460630, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.236.125@KRBTEST.COM for oryx/127.19.236.125@KRBTEST.COM
I20260811 15:03:50.801054 27988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:50.792703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.125:40287 (local address 127.0.0.1:50788)
0811 15:03:50.792894 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:50.792910 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:50.793002 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:50.793187 (+ 185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:50.793189 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:50.793347 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:50.793457 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:50.793462 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:50.794189 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:50.794192 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:50.794781 (+ 589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:50.794790 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:50.795280 (+ 490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:50.795283 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:50.795393 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:50.795919 (+ 526us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:03:50.795931 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:50.797291 (+ 1360us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:50.799225 (+ 1934us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:50.799228 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:50.799230 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:50.799451 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:50.799959 (+ 508us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:50.799962 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:50.799963 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:50.800055 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:50.800527 (+ 472us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:50.800529 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:50.800690 (+ 161us) client_negotiation.cc:769] Sending connection context
0811 15:03:50.800785 (+ 95us) client_negotiation.cc:240] Negotiation successful
0811 15:03:50.800904 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"mutex_wait_us":14}
I20260811 15:03:50.801169 27990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:50.792715 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50788 (local address 127.19.236.125:40287)
0811 15:03:50.792831 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:50.792835 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:50.792988 (+ 153us) server_negotiation.cc:407] Connection header received
0811 15:03:50.793073 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:50.793075 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:50.793112 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:50.793178 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:50.793552 (+ 374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:50.794066 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:50.794957 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:50.795191 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:50.795272 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:50.797425 (+ 2153us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:50.797429 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:50.797431 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:50.797452 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:50.799084 (+ 1632us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:50.799737 (+ 653us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:50.799741 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:50.799742 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:50.799819 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:50.800174 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:50.800177 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:50.800178 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:50.800379 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:50.800468 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:50.800914 (+ 446us) server_negotiation.cc:299] Negotiation successful
0811 15:03:50.801022 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":41}
I20260811 15:03:50.804711 27984 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a46978a611c144cdb5359f623cd44007: Bootstrap starting.
I20260811 15:03:50.807150 27984 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a46978a611c144cdb5359f623cd44007: Neither blocks nor log segments found. Creating new log.
I20260811 15:03:50.807928 27984 log.cc:824] T 00000000000000000000000000000000 P a46978a611c144cdb5359f623cd44007: Log is configured to *not* fsync() on all Append() calls
I20260811 15:03:50.810271 27984 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a46978a611c144cdb5359f623cd44007: No bootstrap required, opened a new log
I20260811 15:03:50.813431 27984 raft_consensus.cc:348] T 00000000000000000000000000000000 P a46978a611c144cdb5359f623cd44007 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfa4f7cc43ed43e1bb70ce239a69cd99" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 45445 } } peers { permanent_uuid: "a46978a611c144cdb5359f623cd44007" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 40287 } }
I20260811 15:03:50.813647 27984 raft_consensus.cc:374] T 00000000000000000000000000000000 P a46978a611c144cdb5359f623cd44007 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:03:50.813715 27984 raft_consensus.cc:729] T 00000000000000000000000000000000 P a46978a611c144cdb5359f623cd44007 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a46978a611c144cdb5359f623cd44007, State: Initialized, Role: FOLLOWER
I20260811 15:03:50.814245 27984 consensus_queue.cc:260] T 00000000000000000000000000000000 P a46978a611c144cdb5359f623cd44007 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfa4f7cc43ed43e1bb70ce239a69cd99" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 45445 } } peers { permanent_uuid: "a46978a611c144cdb5359f623cd44007" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 40287 } }
I20260811 15:03:50.814924 27992 sys_catalog.cc:455] T 00000000000000000000000000000000 P a46978a611c144cdb5359f623cd44007 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfa4f7cc43ed43e1bb70ce239a69cd99" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 45445 } } peers { permanent_uuid: "a46978a611c144cdb5359f623cd44007" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 40287 } } }
I20260811 15:03:50.815125 27992 sys_catalog.cc:458] T 00000000000000000000000000000000 P a46978a611c144cdb5359f623cd44007 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 15:03:50.815650 27984 sys_catalog.cc:564] T 00000000000000000000000000000000 P a46978a611c144cdb5359f623cd44007 [sys.catalog]: configured and running, proceeding with master startup.
W20260811 15:03:50.820914 28003 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a46978a611c144cdb5359f623cd44007: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 15:03:50.821025 28003 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 15:03:50.823350 27912 master_runner.cc:428] Detected that this master a46978a611c144cdb5359f623cd44007 is joining an existing cluster
I20260811 15:03:50.823421 27912 master_runner.cc:432] Initiating AddMaster RPC to add 127.19.236.125:40287
I20260811 15:03:50.834812 27431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:50.825951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43494 (local address 127.19.236.126:45445)
0811 15:03:50.826108 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:50.826113 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:50.826257 (+ 144us) server_negotiation.cc:407] Connection header received
0811 15:03:50.826403 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:50.826407 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:50.826459 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:50.826518 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:50.827217 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:50.828061 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:50.829354 (+ 1293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:50.829692 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:50.829770 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:50.831295 (+ 1525us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:50.831301 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:50.831306 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:50.831333 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:50.833009 (+ 1676us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:50.833493 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:50.833496 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:50.833498 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:50.833581 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:50.833896 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:50.833899 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:50.833901 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:50.834126 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:50.834236 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:50.834523 (+ 287us) server_negotiation.cc:299] Negotiation successful
0811 15:03:50.834645 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 15:03:50.834811 27990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:50.826353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50800 (local address 127.19.236.125:40287)
0811 15:03:50.826473 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:50.826478 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:50.826728 (+ 250us) server_negotiation.cc:407] Connection header received
0811 15:03:50.826930 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:50.826935 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:50.826986 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:50.827067 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:50.827490 (+ 423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:50.827958 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:50.828875 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:50.829100 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:50.829210 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:50.830323 (+ 1113us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:50.830328 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:50.830331 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:50.830354 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:50.832195 (+ 1841us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:50.833644 (+ 1449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:50.833649 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:50.833653 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:50.833737 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:50.834023 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:50.834026 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:50.834028 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:50.834233 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:50.834331 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:50.834554 (+ 223us) server_negotiation.cc:299] Negotiation successful
0811 15:03:50.834644 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 15:03:50.834824 28009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:50.825808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:45445 (local address 127.0.0.1:43494)
0811 15:03:50.826147 (+ 339us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:50.826163 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:50.826276 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:50.826681 (+ 405us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:50.826685 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:50.826915 (+ 230us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:50.827075 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:50.827083 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:50.828209 (+ 1126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:50.828212 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:50.829207 (+ 995us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:50.829218 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:50.829965 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:50.829968 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:50.830062 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:50.830601 (+ 539us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:03:50.830618 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:50.831112 (+ 494us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:50.833121 (+ 2009us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:50.833124 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:50.833125 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:50.833380 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:50.833685 (+ 305us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:50.833688 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:50.833690 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:50.833778 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:50.834225 (+ 447us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:50.834229 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:50.834327 (+ 98us) client_negotiation.cc:769] Sending connection context
0811 15:03:50.834437 (+ 110us) client_negotiation.cc:240] Negotiation successful
0811 15:03:50.834603 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":254,"mutex_wait_us":22,"thread_start_us":105,"threads_started":1}
I20260811 15:03:50.835469 28010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:50.826353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.125:40287 (local address 127.0.0.1:50800)
0811 15:03:50.826640 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:50.826651 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:50.826774 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:50.827081 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:50.827084 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:50.827281 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:50.827370 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:50.827376 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:50.828063 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:50.828069 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:50.828764 (+ 695us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:50.828773 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:50.829219 (+ 446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:50.829222 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:50.829302 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:50.829840 (+ 538us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:03:50.829852 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:50.830182 (+ 330us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:50.833134 (+ 2952us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:50.833138 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:50.833140 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:50.833538 (+ 398us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:50.833828 (+ 290us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:50.833833 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:50.833835 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:50.833920 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:50.834319 (+ 399us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:50.834322 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:50.834391 (+ 69us) client_negotiation.cc:769] Sending connection context
0811 15:03:50.835160 (+ 769us) client_negotiation.cc:240] Negotiation successful
0811 15:03:50.835285 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":231,"mutex_wait_us":1,"thread_start_us":93,"threads_started":1}
Aug 11 15:03:50 dist-test-slave-8n49 krb5kdc[27335](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460629, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.236.126@KRBTEST.COM for oryx/127.19.236.125@KRBTEST.COM
I20260811 15:03:50.851416 28011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:50.840232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.125:40287 (local address 127.0.0.1:50810)
0811 15:03:50.840679 (+ 447us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:50.840735 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:50.840870 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:50.841228 (+ 358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:50.841234 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:50.841675 (+ 441us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:50.841809 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:50.841817 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:50.842720 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:50.842723 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:50.843811 (+ 1088us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:50.843823 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:50.844653 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:50.844657 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:50.844774 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:50.845317 (+ 543us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:03:50.845332 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:50.847127 (+ 1795us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:50.849356 (+ 2229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:50.849368 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:50.849376 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:50.849699 (+ 323us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:50.850038 (+ 339us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:50.850041 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:50.850043 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:50.850140 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:50.850662 (+ 522us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:50.850670 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:50.850816 (+ 146us) client_negotiation.cc:769] Sending connection context
0811 15:03:50.850993 (+ 177us) client_negotiation.cc:240] Negotiation successful
0811 15:03:50.851216 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":128,"threads_started":1}
I20260811 15:03:50.852072 27990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:50.840264 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50810 (local address 127.19.236.125:40287)
0811 15:03:50.840429 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:50.840434 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:50.840879 (+ 445us) server_negotiation.cc:407] Connection header received
0811 15:03:50.841043 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:50.841046 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:50.841103 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:50.841171 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:50.842033 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:50.842606 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:50.843958 (+ 1352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:50.844296 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:50.844365 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:50.847294 (+ 2929us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:50.847297 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:50.847300 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:50.847330 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:50.849221 (+ 1891us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:50.849800 (+ 579us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:50.849807 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:50.849812 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:50.849924 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:50.850245 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:50.850249 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:50.850250 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:50.850531 (+ 281us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:50.850653 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:50.851095 (+ 442us) server_negotiation.cc:299] Negotiation successful
0811 15:03:50.851243 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 15:03:50.853850 27385 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.19.236.125:40287: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "a46978a611c144cdb5359f623cd44007"
member_type: NON_VOTER
last_known_addr {
host: "127.19.236.125"
port: 40287
}
attrs {
promote: true
}
}
dest_uuid: "dfa4f7cc43ed43e1bb70ce239a69cd99"
cas_config_opid_index: -1
WARNING: no policy specified for oryx/127.19.236.124@KRBTEST.COM; defaulting to no policy
I20260811 15:03:50.854598 27385 consensus_queue.cc:237] T 00000000000000000000000000000000 P dfa4f7cc43ed43e1bb70ce239a69cd99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "dfa4f7cc43ed43e1bb70ce239a69cd99" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 45445 } } peers { permanent_uuid: "a46978a611c144cdb5359f623cd44007" member_type: NON_VOTER last_known_addr { host: "127.19.236.125" port: 40287 } attrs { promote: true } }
I20260811 15:03:50.857048 28014 raft_consensus.cc:2932] T 00000000000000000000000000000000 P dfa4f7cc43ed43e1bb70ce239a69cd99 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER a46978a611c144cdb5359f623cd44007 (127.19.236.125) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "dfa4f7cc43ed43e1bb70ce239a69cd99" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 45445 } } peers { permanent_uuid: "a46978a611c144cdb5359f623cd44007" member_type: NON_VOTER last_known_addr { host: "127.19.236.125" port: 40287 } attrs { promote: true } } }
I20260811 15:03:50.857394 27955 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a46978a611c144cdb5359f623cd44007 [term 0 FOLLOWER]: Advancing to term 1
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.19.236.124@KRBTEST.COM" created.
I20260811 15:03:50.859097 27955 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a46978a611c144cdb5359f623cd44007 [term 1 FOLLOWER]: Refusing update from remote peer dfa4f7cc43ed43e1bb70ce239a69cd99: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260811 15:03:50.859216 28014 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.19.236.125:40287
I20260811 15:03:50.859820 27912 master.cc:537] Master@127.19.236.125:40287 shutting down...
I20260811 15:03:50.860855 28014 consensus_queue.cc:1035] T 00000000000000000000000000000000 P dfa4f7cc43ed43e1bb70ce239a69cd99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46978a611c144cdb5359f623cd44007" member_type: NON_VOTER last_known_addr { host: "127.19.236.125" port: 40287 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:03:50.862339 28017 sys_catalog.cc:455] T 00000000000000000000000000000000 P dfa4f7cc43ed43e1bb70ce239a69cd99 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "dfa4f7cc43ed43e1bb70ce239a69cd99" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "dfa4f7cc43ed43e1bb70ce239a69cd99" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 45445 } } peers { permanent_uuid: "a46978a611c144cdb5359f623cd44007" member_type: NON_VOTER last_known_addr { host: "127.19.236.125" port: 40287 } attrs { promote: true } } }
I20260811 15:03:50.862485 28017 sys_catalog.cc:458] T 00000000000000000000000000000000 P dfa4f7cc43ed43e1bb70ce239a69cd99 [sys.catalog]: This master's current role is: LEADER
W20260811 15:03:50.864356 27371 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
I20260811 15:03:50.864989 27912 raft_consensus.cc:2229] T 00000000000000000000000000000000 P a46978a611c144cdb5359f623cd44007 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 15:03:50.865303 27912 raft_consensus.cc:2258] T 00000000000000000000000000000000 P a46978a611c144cdb5359f623cd44007 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:03:50.865425 27912 tablet_replica.cc:330] T 00000000000000000000000000000000 P a46978a611c144cdb5359f623cd44007: stopping tablet replica
I20260811 15:03:50.871181 28011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:50.870854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.125:40287 (local address 127.0.0.1:50826)
0811 15:03:50.871001 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:50.871079 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.125:40287: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260811 15:03:50.871400 27371 consensus_peers.cc:487] T 00000000000000000000000000000000 P dfa4f7cc43ed43e1bb70ce239a69cd99 -> Peer a46978a611c144cdb5359f623cd44007 (127.19.236.125:40287): Couldn't send request to peer a46978a611c144cdb5359f623cd44007. Status: Network error: Client connection negotiation failed: client connection to 127.19.236.125:40287: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 15:03:50.881789 27912 master.cc:552] Master@127.19.236.125:40287 shutdown complete.
I20260811 15:03:50.881881 27912 master_runner.cc:305] Clearing existing system tablet
I20260811 15:03:50.882205 27912 fs_manager.cc:359] Metadata directory not provided
I20260811 15:03:50.882282 27912 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:03:50.883895 27912 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 15:03:50.885054 28022 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:50.885424 27912 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:03:50.885574 27912 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 15:03:50.885614 27912 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/master-1/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/master-1/wal
uuid: "a46978a611c144cdb5359f623cd44007"
format_stamp: "Formatted at 2026-08-11 15:03:50 on dist-test-slave-8n49"
server_key: "6633e83a1422b6baf12c1c74123ce1ff"
server_key_iv: "1e4d8ef3786c77173940b42c35632aff"
server_key_version: "encryptionkey@0"
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.19.236.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/krb5kdc/oryx_127.19.236.124.keytab.
Entry for principal oryx/127.19.236.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/krb5kdc/oryx_127.19.236.124.keytab.
I20260811 15:03:50.887940 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.124:39963
--webserver_interface=127.19.236.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/krb5kdc/oryx_127.19.236.124.keytab
--principal=oryx/127.19.236.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:41993
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.236.126:45445,127.19.236.125:40287,127.19.236.124:39963
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 15:03:50.888144 27912 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P a46978a611c144cdb5359f623cd44007: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 15:03:50.890986 27912 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P a46978a611c144cdb5359f623cd44007: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260811 15:03:50.891099 27912 log.cc:1196] T 00000000000000000000000000000000 P a46978a611c144cdb5359f623cd44007: Deleting WAL directory at /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260811 15:03:50.891388 27912 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P a46978a611c144cdb5359f623cd44007: Deleting consensus metadata
I20260811 15:03:50.891587 27912 master_runner.cc:315] Copying system tablet from 127.19.236.126:45445
I20260811 15:03:50.893003 27912 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P a46978a611c144cdb5359f623cd44007: tablet copy: Beginning tablet copy session from remote peer at address 127.19.236.126:45445
I20260811 15:03:50.906251 28031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:50.893689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:45445 (local address 127.0.0.1:43508)
0811 15:03:50.896800 (+ 3111us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:50.896821 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:50.896997 (+ 176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:50.897342 (+ 345us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:50.897348 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:50.897608 (+ 260us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:50.897799 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:50.897812 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:50.899036 (+ 1224us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:50.899043 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:50.900149 (+ 1106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:50.900164 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:50.900838 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:50.900842 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:50.900956 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:50.901605 (+ 649us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:03:50.901620 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:50.902075 (+ 455us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:50.904387 (+ 2312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:50.904391 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:50.904394 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:50.904702 (+ 308us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:50.905033 (+ 331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:50.905036 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:50.905038 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:50.905132 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:50.905654 (+ 522us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:50.905657 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:50.905762 (+ 105us) client_negotiation.cc:769] Sending connection context
0811 15:03:50.905870 (+ 108us) client_negotiation.cc:240] Negotiation successful
0811 15:03:50.906036 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2996,"thread_start_us":111,"threads_started":1}
I20260811 15:03:50.906294 27431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:50.893792 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43508 (local address 127.19.236.126:45445)
0811 15:03:50.893943 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:50.893949 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:50.896951 (+ 3002us) server_negotiation.cc:407] Connection header received
0811 15:03:50.897122 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:50.897125 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:50.897186 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:50.897296 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:50.897980 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:50.898890 (+ 910us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:50.900301 (+ 1411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:50.900705 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:50.900827 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:50.902242 (+ 1415us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:50.902247 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:50.902250 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:50.902280 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:50.904258 (+ 1978us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:50.904811 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:50.904815 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:50.904817 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:50.904919 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:50.905259 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:50.905263 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:50.905265 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:50.905542 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:50.905659 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:50.905975 (+ 316us) server_negotiation.cc:299] Negotiation successful
0811 15:03:50.906114 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 15:03:50.907470 27412 tablet_copy_service.cc:140] P dfa4f7cc43ed43e1bb70ce239a69cd99: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer a46978a611c144cdb5359f623cd44007 ({username='oryx', principal='oryx/127.19.236.125@KRBTEST.COM'} at 127.0.0.1:43508)
I20260811 15:03:50.907683 27412 tablet_copy_service.cc:161] P dfa4f7cc43ed43e1bb70ce239a69cd99: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer a46978a611c144cdb5359f623cd44007 at {username='oryx', principal='oryx/127.19.236.125@KRBTEST.COM'} at 127.0.0.1:43508: session id = a46978a611c144cdb5359f623cd44007-00000000000000000000000000000000
I20260811 15:03:50.909802 27412 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P dfa4f7cc43ed43e1bb70ce239a69cd99: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 15:03:50.911685 27912 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260811 15:03:50.915527 27912 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P a46978a611c144cdb5359f623cd44007: tablet copy: Starting download of 0 data blocks...
I20260811 15:03:50.915761 27912 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P a46978a611c144cdb5359f623cd44007: tablet copy: Starting download of 1 WAL segments...
I20260811 15:03:50.917964 27912 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P a46978a611c144cdb5359f623cd44007: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 15:03:50.920192 27412 tablet_copy_service.cc:342] P dfa4f7cc43ed43e1bb70ce239a69cd99: Request end of tablet copy session a46978a611c144cdb5359f623cd44007-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.19.236.125@KRBTEST.COM'} at 127.0.0.1:43508
I20260811 15:03:50.920346 27412 tablet_copy_service.cc:433] P dfa4f7cc43ed43e1bb70ce239a69cd99: ending tablet copy session a46978a611c144cdb5359f623cd44007-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer a46978a611c144cdb5359f623cd44007
I20260811 15:03:50.929314 27912 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:03:50.931282 28032 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:50.931327 28035 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:50.931399 28033 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:50.932734 27912 server_base.cc:1034] running on GCE node
I20260811 15:03:50.932914 27912 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:03:50.933246 27912 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:03:50.934407 27912 hybrid_clock.cc:648] HybridClock initialized: now 1786460630934391 us; error 34 us; skew 500 ppm
Aug 11 15:03:50 dist-test-slave-8n49 krb5kdc[27335](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460630, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.236.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:03:50.936216 27912 init.cc:377] Logged in from keytab as oryx/127.19.236.125@KRBTEST.COM (short username oryx)
I20260811 15:03:50.936770 27912 webserver.cc:460] Webserver started at http://127.19.236.125:39137/ using document root <none> and password file <none>
I20260811 15:03:50.936967 27912 fs_manager.cc:359] Metadata directory not provided
I20260811 15:03:50.937011 27912 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:03:50.938428 27912 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 15:03:50.939587 28042 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:50.939930 27912 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 15:03:50.940013 27912 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/master-1/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/master-1/wal
uuid: "a46978a611c144cdb5359f623cd44007"
format_stamp: "Formatted at 2026-08-11 15:03:50 on dist-test-slave-8n49"
server_key: "6633e83a1422b6baf12c1c74123ce1ff"
server_key_iv: "1e4d8ef3786c77173940b42c35632aff"
server_key_version: "encryptionkey@0"
I20260811 15:03:50.940104 27912 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:03:50.959326 27912 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:03:50.961820 27912 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:03:50.967092 27912 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.125:40287
I20260811 15:03:50.967280 28097 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.125:40287 every 8 connection(s)
I20260811 15:03:50.967751 27912 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/master-1/data/info.pb
I20260811 15:03:50.969969 28098 sys_catalog.cc:263] Verifying existing consensus state
I20260811 15:03:50.971189 28098 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a46978a611c144cdb5359f623cd44007: Bootstrap starting.
I20260811 15:03:50.983093 28098 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a46978a611c144cdb5359f623cd44007: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 15:03:50.983465 28098 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a46978a611c144cdb5359f623cd44007: Bootstrap complete.
I20260811 15:03:50.984205 28098 raft_consensus.cc:348] T 00000000000000000000000000000000 P a46978a611c144cdb5359f623cd44007 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "dfa4f7cc43ed43e1bb70ce239a69cd99" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 45445 } } peers { permanent_uuid: "a46978a611c144cdb5359f623cd44007" member_type: NON_VOTER last_known_addr { host: "127.19.236.125" port: 40287 } attrs { promote: true } }
I20260811 15:03:50.984480 28098 raft_consensus.cc:729] T 00000000000000000000000000000000 P a46978a611c144cdb5359f623cd44007 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a46978a611c144cdb5359f623cd44007, State: Initialized, Role: LEARNER
I20260811 15:03:50.984654 28098 consensus_queue.cc:260] T 00000000000000000000000000000000 P a46978a611c144cdb5359f623cd44007 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "dfa4f7cc43ed43e1bb70ce239a69cd99" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 45445 } } peers { permanent_uuid: "a46978a611c144cdb5359f623cd44007" member_type: NON_VOTER last_known_addr { host: "127.19.236.125" port: 40287 } attrs { promote: true } }
I20260811 15:03:50.985103 28101 sys_catalog.cc:455] T 00000000000000000000000000000000 P a46978a611c144cdb5359f623cd44007 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "dfa4f7cc43ed43e1bb70ce239a69cd99" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 45445 } } peers { permanent_uuid: "a46978a611c144cdb5359f623cd44007" member_type: NON_VOTER last_known_addr { host: "127.19.236.125" port: 40287 } attrs { promote: true } } }
I20260811 15:03:50.985266 28098 sys_catalog.cc:564] T 00000000000000000000000000000000 P a46978a611c144cdb5359f623cd44007 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:03:50.985273 28101 sys_catalog.cc:458] T 00000000000000000000000000000000 P a46978a611c144cdb5359f623cd44007 [sys.catalog]: This master's current role is: LEARNER
I20260811 15:03:50.989571 28114 catalog_manager.cc:1259] Loaded cluster ID: 2f2396d66c644234b32f65149aa17925
I20260811 15:03:50.989642 28114 catalog_manager.cc:1552] T 00000000000000000000000000000000 P a46978a611c144cdb5359f623cd44007: loading cluster ID for follower catalog manager: success
I20260811 15:03:50.991721 28114 catalog_manager.cc:1574] T 00000000000000000000000000000000 P a46978a611c144cdb5359f623cd44007: acquiring CA information for follower catalog manager: success
I20260811 15:03:50.993212 28114 catalog_manager.cc:1602] T 00000000000000000000000000000000 P a46978a611c144cdb5359f623cd44007: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260811 15:03:51.040520 28023 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:03:51.040884 28023 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:03:51.040974 28023 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:03:51.045542 28023 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:03:51.045639 28023 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:03:51.045677 28023 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:03:51.045715 28023 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:03:51.045749 28023 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:03:51.051476 28023 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:41993
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.19.236.126:45445,127.19.236.125:40287,127.19.236.124:39963
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/krb5kdc/oryx_127.19.236.124.keytab
--principal=oryx/127.19.236.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.124:39963
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.19.236.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28023
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:03:51.052788 28023 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:03:51.053882 28023 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:03:51.062937 28119 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:51.062944 28120 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:51.062945 28122 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:51.063072 28023 server_base.cc:1034] running on GCE node
I20260811 15:03:51.063874 28023 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:03:51.065133 28023 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:03:51.065852 27605 heartbeater.cc:503] Master 127.19.236.126:45445 was elected leader, sending a full tablet report...
I20260811 15:03:51.066295 28023 hybrid_clock.cc:648] HybridClock initialized: now 1786460631066257 us; error 53 us; skew 500 ppm
Aug 11 15:03:51 dist-test-slave-8n49 krb5kdc[27335](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460631, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.236.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:03:51.069721 28023 init.cc:377] Logged in from keytab as oryx/127.19.236.124@KRBTEST.COM (short username oryx)
I20260811 15:03:51.070713 28023 webserver.cc:460] Webserver started at http://127.19.236.124:45045/ using document root <none> and password file <none>
I20260811 15:03:51.071311 28023 fs_manager.cc:359] Metadata directory not provided
I20260811 15:03:51.071404 28023 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:03:51.071655 28023 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:03:51.073877 28023 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/master-2/data/instance:
uuid: "d6f7d38fca23431e8a90efc41b9d67d9"
format_stamp: "Formatted at 2026-08-11 15:03:51 on dist-test-slave-8n49"
server_key: "5f97ae079a4754ab34fcdf84b13dd8d0"
server_key_iv: "d87d57e52782e3e69f699cc83f8f6210"
server_key_version: "encryptionkey@0"
I20260811 15:03:51.074501 28023 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/master-2/wal/instance:
uuid: "d6f7d38fca23431e8a90efc41b9d67d9"
format_stamp: "Formatted at 2026-08-11 15:03:51 on dist-test-slave-8n49"
server_key: "5f97ae079a4754ab34fcdf84b13dd8d0"
server_key_iv: "d87d57e52782e3e69f699cc83f8f6210"
server_key_version: "encryptionkey@0"
I20260811 15:03:51.078583 28023 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 15:03:51.081197 28131 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:51.082540 28023 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 15:03:51.082690 28023 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/master-2/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/master-2/wal
uuid: "d6f7d38fca23431e8a90efc41b9d67d9"
format_stamp: "Formatted at 2026-08-11 15:03:51 on dist-test-slave-8n49"
server_key: "5f97ae079a4754ab34fcdf84b13dd8d0"
server_key_iv: "d87d57e52782e3e69f699cc83f8f6210"
server_key_version: "encryptionkey@0"
I20260811 15:03:51.082816 28023 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:03:51.098022 28023 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:03:51.101578 28023 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:03:51.101799 28023 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:03:51.109150 28023 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.124:39963
I20260811 15:03:51.109536 28193 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.124:39963 every 8 connection(s)
I20260811 15:03:51.110390 28023 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/master-2/data/info.pb
I20260811 15:03:51.113500 28194 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:03:51.116860 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 28023
I20260811 15:03:51.118170 28194 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.236.126" port: 45445 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 15:03:51 dist-test-slave-8n49 krb5kdc[27335](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460631, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.236.124@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM
Aug 11 15:03:51 dist-test-slave-8n49 krb5kdc[27335](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460629, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.19.236.124@KRBTEST.COM
I20260811 15:03:51.130949 27431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:51.120110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43516 (local address 127.19.236.126:45445)
0811 15:03:51.120247 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:51.120252 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:51.120897 (+ 645us) server_negotiation.cc:407] Connection header received
0811 15:03:51.120941 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:51.120943 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:51.120985 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:51.121082 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:51.121973 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.122489 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.123548 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.123772 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.123874 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:51.126645 (+ 2771us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:51.126651 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:51.126656 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:51.126689 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:51.128382 (+ 1693us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:51.129034 (+ 652us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:51.129037 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:51.129039 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:51.129116 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:51.129554 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:51.129557 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:51.129559 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:51.129838 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:51.129919 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:51.130611 (+ 692us) server_negotiation.cc:299] Negotiation successful
0811 15:03:51.130747 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 15:03:51.132146 28196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:51.118460 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46948 (local address 127.19.236.124:39963)
0811 15:03:51.118974 (+ 514us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:51.118991 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:51.119029 (+ 38us) server_negotiation.cc:407] Connection header received
0811 15:03:51.119697 (+ 668us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:51.119714 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:51.120186 (+ 472us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:51.120532 (+ 346us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:51.121271 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.122474 (+ 1203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.123347 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.123812 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.124007 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:51.127118 (+ 3111us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:51.127127 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:51.127142 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:51.127172 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:51.129264 (+ 2092us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:51.129825 (+ 561us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:51.129830 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:51.129831 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:51.129944 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:51.130243 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:51.130246 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:51.130248 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:51.130520 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:51.130724 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:51.130999 (+ 275us) server_negotiation.cc:299] Negotiation successful
0811 15:03:51.131147 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":73,"server-negotiator.queue_time_us":361,"spinlock_wait_cycles":2560,"thread_start_us":166,"threads_started":1}
I20260811 15:03:51.132146 28197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:51.119872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:45445 (local address 127.0.0.1:43516)
0811 15:03:51.120294 (+ 422us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:51.120344 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:51.120460 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:51.121138 (+ 678us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:51.121144 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:51.121612 (+ 468us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:51.121803 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:51.121817 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.122648 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.122651 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:51.123431 (+ 780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:51.123440 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.123931 (+ 491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.123935 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:51.124051 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:51.124822 (+ 771us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:03:51.124838 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:51.126401 (+ 1563us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:51.128511 (+ 2110us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:51.128519 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:51.128530 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:51.128904 (+ 374us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:51.129217 (+ 313us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:51.129221 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:51.129223 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:51.129441 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:51.129951 (+ 510us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:51.129958 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:51.130297 (+ 339us) client_negotiation.cc:769] Sending connection context
0811 15:03:51.130532 (+ 235us) client_negotiation.cc:240] Negotiation successful
0811 15:03:51.130900 (+ 368us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":262,"mutex_wait_us":42,"spinlock_wait_cycles":4352,"thread_start_us":159,"threads_started":1}
I20260811 15:03:51.133636 28194 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.236.125" port: 40287 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 15:03:51 dist-test-slave-8n49 krb5kdc[27335](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460631, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.236.124@KRBTEST.COM for oryx/127.19.236.125@KRBTEST.COM
I20260811 15:03:51.142421 28197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:51.134168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.125:40287 (local address 127.0.0.1:50828)
0811 15:03:51.134355 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:51.134371 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:51.134442 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:51.134896 (+ 454us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:51.134899 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:51.135042 (+ 143us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:51.135136 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:51.135141 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.136096 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.136100 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:51.136730 (+ 630us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:51.136738 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.137184 (+ 446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.137186 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:51.137267 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:51.137710 (+ 443us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:03:51.137721 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:51.138965 (+ 1244us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:51.140877 (+ 1912us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:51.140880 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:51.140882 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:51.141069 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:51.141368 (+ 299us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:51.141372 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:51.141374 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:51.141487 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:51.141974 (+ 487us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:51.141976 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:51.142066 (+ 90us) client_negotiation.cc:769] Sending connection context
0811 15:03:51.142160 (+ 94us) client_negotiation.cc:240] Negotiation successful
0811 15:03:51.142282 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":105}
I20260811 15:03:51.142448 28199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:51.134289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50828 (local address 127.19.236.125:40287)
0811 15:03:51.134670 (+ 381us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:51.134674 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:51.134686 (+ 12us) server_negotiation.cc:407] Connection header received
0811 15:03:51.134723 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:51.134725 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:51.134764 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:51.134842 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:51.135306 (+ 464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.135983 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.136835 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.137087 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.137168 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:51.139104 (+ 1936us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:51.139154 (+ 50us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:51.139156 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:51.139190 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:51.140758 (+ 1568us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:51.141151 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:51.141154 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:51.141155 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:51.141232 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:51.141604 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:51.141606 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:51.141607 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:51.141887 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:51.141967 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:51.142216 (+ 249us) server_negotiation.cc:299] Negotiation successful
0811 15:03:51.142322 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":314,"thread_start_us":122,"threads_started":1}
I20260811 15:03:51.143371 28194 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.236.124" port: 39963 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 15:03:51 dist-test-slave-8n49 krb5kdc[27335](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460631, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.236.124@KRBTEST.COM for oryx/127.19.236.124@KRBTEST.COM
I20260811 15:03:51.151000 28197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:51.143855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.124:39963 (local address 127.0.0.1:46958)
0811 15:03:51.143988 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:51.144003 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:51.144085 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:51.144343 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:51.144346 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:51.144525 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:51.144665 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:51.144671 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.145467 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.145471 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:51.146020 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:51.146027 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.146537 (+ 510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.146540 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:51.146623 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:51.147098 (+ 475us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:03:51.147109 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:51.148312 (+ 1203us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:51.149787 (+ 1475us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:51.149790 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:51.149791 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:51.149986 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:51.150219 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:51.150221 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:51.150222 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:51.150294 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:51.150608 (+ 314us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:51.150610 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:51.150685 (+ 75us) client_negotiation.cc:769] Sending connection context
0811 15:03:51.150763 (+ 78us) client_negotiation.cc:240] Negotiation successful
0811 15:03:51.150858 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260811 15:03:51.151026 28196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:51.143901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46958 (local address 127.19.236.124:39963)
0811 15:03:51.144026 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:51.144033 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:51.144049 (+ 16us) server_negotiation.cc:407] Connection header received
0811 15:03:51.144200 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:51.144203 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:51.144243 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:51.144331 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:51.144782 (+ 451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.145345 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.146153 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.146417 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.146538 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:51.148440 (+ 1902us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:51.148443 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:51.148446 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:51.148467 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:51.149687 (+ 1220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:51.150070 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:51.150072 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:51.150074 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:51.150140 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:51.150369 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:51.150371 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:51.150372 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:51.150529 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:51.150601 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:51.150820 (+ 219us) server_negotiation.cc:299] Negotiation successful
0811 15:03:51.150909 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 15:03:51.154670 28194 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d6f7d38fca23431e8a90efc41b9d67d9: Bootstrap starting.
I20260811 15:03:51.157187 28194 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d6f7d38fca23431e8a90efc41b9d67d9: Neither blocks nor log segments found. Creating new log.
I20260811 15:03:51.157966 28194 log.cc:824] T 00000000000000000000000000000000 P d6f7d38fca23431e8a90efc41b9d67d9: Log is configured to *not* fsync() on all Append() calls
I20260811 15:03:51.160307 28194 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d6f7d38fca23431e8a90efc41b9d67d9: No bootstrap required, opened a new log
I20260811 15:03:51.163533 28194 raft_consensus.cc:348] T 00000000000000000000000000000000 P d6f7d38fca23431e8a90efc41b9d67d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfa4f7cc43ed43e1bb70ce239a69cd99" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 45445 } } peers { permanent_uuid: "a46978a611c144cdb5359f623cd44007" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 40287 } } peers { permanent_uuid: "d6f7d38fca23431e8a90efc41b9d67d9" member_type: VOTER last_known_addr { host: "127.19.236.124" port: 39963 } }
I20260811 15:03:51.163795 28194 raft_consensus.cc:374] T 00000000000000000000000000000000 P d6f7d38fca23431e8a90efc41b9d67d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:03:51.163883 28194 raft_consensus.cc:729] T 00000000000000000000000000000000 P d6f7d38fca23431e8a90efc41b9d67d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6f7d38fca23431e8a90efc41b9d67d9, State: Initialized, Role: FOLLOWER
I20260811 15:03:51.164352 28194 consensus_queue.cc:260] T 00000000000000000000000000000000 P d6f7d38fca23431e8a90efc41b9d67d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfa4f7cc43ed43e1bb70ce239a69cd99" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 45445 } } peers { permanent_uuid: "a46978a611c144cdb5359f623cd44007" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 40287 } } peers { permanent_uuid: "d6f7d38fca23431e8a90efc41b9d67d9" member_type: VOTER last_known_addr { host: "127.19.236.124" port: 39963 } }
I20260811 15:03:51.164988 28201 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6f7d38fca23431e8a90efc41b9d67d9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dfa4f7cc43ed43e1bb70ce239a69cd99" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 45445 } } peers { permanent_uuid: "a46978a611c144cdb5359f623cd44007" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 40287 } } peers { permanent_uuid: "d6f7d38fca23431e8a90efc41b9d67d9" member_type: VOTER last_known_addr { host: "127.19.236.124" port: 39963 } } }
I20260811 15:03:51.165117 28201 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6f7d38fca23431e8a90efc41b9d67d9 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 15:03:51.165763 28194 sys_catalog.cc:564] T 00000000000000000000000000000000 P d6f7d38fca23431e8a90efc41b9d67d9 [sys.catalog]: configured and running, proceeding with master startup.
W20260811 15:03:51.170825 28214 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d6f7d38fca23431e8a90efc41b9d67d9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 15:03:51.170915 28214 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 15:03:51.174263 28023 master_runner.cc:428] Detected that this master d6f7d38fca23431e8a90efc41b9d67d9 is joining an existing cluster
I20260811 15:03:51.174317 28023 master_runner.cc:432] Initiating AddMaster RPC to add 127.19.236.124:39963
I20260811 15:03:51.185896 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 27456
I20260811 15:03:51.196012 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.65:32827
--local_ip_for_outbound_sockets=127.19.236.65
--tserver_master_addrs=127.19.236.126:45445
--webserver_port=40373
--webserver_interface=127.19.236.65
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/krb5kdc/oryx_127.19.236.65.keytab
--principal=oryx/127.19.236.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:41993
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.19.236.126:45445,127.19.236.125:40287
--tserver_master_addrs=127.19.236.126:45445,127.19.236.125:40287,127.19.236.124:39963 with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 15:03:51.202088 28224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:51.177408 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.125:40287 (local address 127.0.0.1:50842)
0811 15:03:51.177762 (+ 354us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:51.177777 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:51.177913 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:51.178287 (+ 374us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:51.178290 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:51.178491 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:51.178599 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:51.178605 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.179604 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.179607 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:51.180396 (+ 789us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:51.180404 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.181100 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.181106 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:51.181552 (+ 446us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:51.197230 (+ 15678us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:03:51.197251 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:51.197670 (+ 419us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:51.200250 (+ 2580us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:51.200253 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:51.200256 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:51.200529 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:51.200901 (+ 372us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:51.200905 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:51.200907 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:51.201026 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:51.201501 (+ 475us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:51.201504 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:51.201609 (+ 105us) client_negotiation.cc:769] Sending connection context
0811 15:03:51.201707 (+ 98us) client_negotiation.cc:240] Negotiation successful
0811 15:03:51.201874 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":283,"spinlock_wait_cycles":6528,"thread_start_us":102,"threads_started":1}
I20260811 15:03:51.202747 27431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:51.176443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43522 (local address 127.19.236.126:45445)
0811 15:03:51.176589 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:51.176594 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:51.177024 (+ 430us) server_negotiation.cc:407] Connection header received
0811 15:03:51.177229 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:51.177235 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:51.177290 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:51.177348 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:51.178217 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.179015 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.180216 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.180599 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.180669 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:51.197577 (+ 16908us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:51.197585 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:51.197591 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:51.197634 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:51.199759 (+ 2125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:51.200583 (+ 824us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:51.200590 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:51.200594 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:51.200691 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:51.201050 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:51.201054 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:51.201057 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:51.201330 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:51.201415 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:51.202434 (+ 1019us) server_negotiation.cc:299] Negotiation successful
0811 15:03:51.202594 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 15:03:51.202893 28199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:51.177182 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50842 (local address 127.19.236.125:40287)
0811 15:03:51.177309 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:51.177314 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:51.177848 (+ 534us) server_negotiation.cc:407] Connection header received
0811 15:03:51.178028 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:51.178034 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:51.178085 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:51.178139 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:51.178729 (+ 590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.179469 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.180524 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.180875 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.180943 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:51.198216 (+ 17273us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:51.198221 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:51.198224 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:51.198257 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:51.200114 (+ 1857us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:51.200683 (+ 569us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:51.200687 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:51.200689 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:51.200779 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:51.201129 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:51.201132 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:51.201135 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:51.201355 (+ 220us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:51.201443 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:51.202603 (+ 1160us) server_negotiation.cc:299] Negotiation successful
0811 15:03:51.202743 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 15:03:51.203361 28222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:51.176671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.124:39963 (local address 127.0.0.1:46966)
0811 15:03:51.177053 (+ 382us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:51.177066 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:51.177187 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:51.177522 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:51.177525 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:51.177870 (+ 345us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:51.178088 (+ 218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:51.178097 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.179105 (+ 1008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.179108 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:51.180723 (+ 1615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:51.180734 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.181368 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.181371 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:51.181470 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:51.181839 (+ 369us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:03:51.181853 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:51.197998 (+ 16145us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:51.201794 (+ 3796us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:51.201799 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:51.201804 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:51.202067 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:51.202353 (+ 286us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:51.202359 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:51.202362 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:51.202442 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:51.202858 (+ 416us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:51.202860 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:51.202960 (+ 100us) client_negotiation.cc:769] Sending connection context
0811 15:03:51.203060 (+ 100us) client_negotiation.cc:240] Negotiation successful
0811 15:03:51.203194 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":323,"mutex_wait_us":59,"thread_start_us":93,"threads_started":1}
I20260811 15:03:51.203714 28196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:51.176536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46966 (local address 127.19.236.124:39963)
0811 15:03:51.176667 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:51.176671 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:51.177131 (+ 460us) server_negotiation.cc:407] Connection header received
0811 15:03:51.177281 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:51.177284 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:51.177320 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:51.177365 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:51.178205 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.178985 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.180845 (+ 1860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.181161 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.181239 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:51.198149 (+ 16910us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:51.198156 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:51.198164 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:51.198198 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:51.201678 (+ 3480us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:51.202170 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:51.202175 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:51.202180 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:51.202257 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:51.202535 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:51.202540 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:51.202544 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:51.202731 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:51.202824 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:51.203467 (+ 643us) server_negotiation.cc:299] Negotiation successful
0811 15:03:51.203578 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 15:03:51.203927 28221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:51.176629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:45445 (local address 127.0.0.1:43522)
0811 15:03:51.176922 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:51.176947 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:51.177110 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:51.177520 (+ 410us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:51.177525 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:51.177867 (+ 342us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:51.178084 (+ 217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:51.178092 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.179149 (+ 1057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.179152 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:51.180090 (+ 938us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:51.180099 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.180840 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.180843 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:51.180930 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:51.181496 (+ 566us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:03:51.181525 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:51.197299 (+ 15774us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:51.199896 (+ 2597us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:51.199901 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:51.199905 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:51.200422 (+ 517us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:51.200819 (+ 397us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:51.200824 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:51.200829 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:51.200932 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:51.201510 (+ 578us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:51.201515 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:51.201620 (+ 105us) client_negotiation.cc:769] Sending connection context
0811 15:03:51.203601 (+ 1981us) client_negotiation.cc:240] Negotiation successful
0811 15:03:51.203761 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":190,"mutex_wait_us":35,"spinlock_wait_cycles":1280,"thread_start_us":113,"threads_started":1}
Aug 11 15:03:51 dist-test-slave-8n49 krb5kdc[27335](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460629, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.236.126@KRBTEST.COM for oryx/127.19.236.124@KRBTEST.COM
I20260811 15:03:51.218302 28011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:51.208257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.124:39963 (local address 127.0.0.1:46968)
0811 15:03:51.208388 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:51.208406 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:51.208493 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:51.208848 (+ 355us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:51.208852 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:51.209052 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:51.209164 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:51.209171 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.210281 (+ 1110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.210284 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:51.211192 (+ 908us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:51.211203 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.212020 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.212026 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:51.212162 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:51.212804 (+ 642us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:03:51.212826 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:51.214528 (+ 1702us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:51.216690 (+ 2162us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:51.216694 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:51.216697 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:51.216940 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:51.217232 (+ 292us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:51.217235 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:51.217237 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:51.217318 (+ 81us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:51.217766 (+ 448us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:51.217769 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:51.217868 (+ 99us) client_negotiation.cc:769] Sending connection context
0811 15:03:51.217969 (+ 101us) client_negotiation.cc:240] Negotiation successful
0811 15:03:51.218121 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43}
I20260811 15:03:51.218919 28196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:51.208349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46968 (local address 127.19.236.124:39963)
0811 15:03:51.208469 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:51.208473 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:51.208486 (+ 13us) server_negotiation.cc:407] Connection header received
0811 15:03:51.208631 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:51.208636 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:51.208709 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:51.208793 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:51.209296 (+ 503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.210152 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.211332 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.211746 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.211868 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:51.214689 (+ 2821us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:51.214693 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:51.214695 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:51.214720 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:51.216528 (+ 1808us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:51.217052 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:51.217055 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:51.217057 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:51.217136 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:51.217411 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:51.217414 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:51.217416 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:51.217628 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:51.217719 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:51.218646 (+ 927us) server_negotiation.cc:299] Negotiation successful
0811 15:03:51.218762 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 15:03:51.220028 27385 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.19.236.124:39963: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "d6f7d38fca23431e8a90efc41b9d67d9"
member_type: NON_VOTER
last_known_addr {
host: "127.19.236.124"
port: 39963
}
attrs {
promote: true
}
}
dest_uuid: "dfa4f7cc43ed43e1bb70ce239a69cd99"
cas_config_opid_index: 5
I20260811 15:03:51.220777 27385 consensus_queue.cc:237] T 00000000000000000000000000000000 P dfa4f7cc43ed43e1bb70ce239a69cd99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "dfa4f7cc43ed43e1bb70ce239a69cd99" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 45445 } } peers { permanent_uuid: "a46978a611c144cdb5359f623cd44007" member_type: NON_VOTER last_known_addr { host: "127.19.236.125" port: 40287 } attrs { promote: true } } peers { permanent_uuid: "d6f7d38fca23431e8a90efc41b9d67d9" member_type: NON_VOTER last_known_addr { host: "127.19.236.124" port: 39963 } attrs { promote: true } }
I20260811 15:03:51.221858 28015 raft_consensus.cc:2932] T 00000000000000000000000000000000 P dfa4f7cc43ed43e1bb70ce239a69cd99 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER d6f7d38fca23431e8a90efc41b9d67d9 (127.19.236.124) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "dfa4f7cc43ed43e1bb70ce239a69cd99" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 45445 } } peers { permanent_uuid: "a46978a611c144cdb5359f623cd44007" member_type: NON_VOTER last_known_addr { host: "127.19.236.125" port: 40287 } attrs { promote: true } } peers { permanent_uuid: "d6f7d38fca23431e8a90efc41b9d67d9" member_type: NON_VOTER last_known_addr { host: "127.19.236.124" port: 39963 } attrs { promote: true } } }
I20260811 15:03:51.223449 28015 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.19.236.124:39963
I20260811 15:03:51.223636 28015 sys_catalog.cc:455] T 00000000000000000000000000000000 P dfa4f7cc43ed43e1bb70ce239a69cd99 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "dfa4f7cc43ed43e1bb70ce239a69cd99" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "dfa4f7cc43ed43e1bb70ce239a69cd99" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 45445 } } peers { permanent_uuid: "a46978a611c144cdb5359f623cd44007" member_type: NON_VOTER last_known_addr { host: "127.19.236.125" port: 40287 } attrs { promote: true } } peers { permanent_uuid: "d6f7d38fca23431e8a90efc41b9d67d9" member_type: NON_VOTER last_known_addr { host: "127.19.236.124" port: 39963 } attrs { promote: true } } }
I20260811 15:03:51.223737 28015 sys_catalog.cc:458] T 00000000000000000000000000000000 P dfa4f7cc43ed43e1bb70ce239a69cd99 [sys.catalog]: This master's current role is: LEADER
I20260811 15:03:51.225191 28164 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d6f7d38fca23431e8a90efc41b9d67d9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:03:51.226755 28164 raft_consensus.cc:1261] T 00000000000000000000000000000000 P d6f7d38fca23431e8a90efc41b9d67d9 [term 1 FOLLOWER]: Refusing update from remote peer dfa4f7cc43ed43e1bb70ce239a69cd99: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260811 15:03:51.227186 28023 master.cc:537] Master@127.19.236.124:39963 shutting down...
I20260811 15:03:51.227572 28017 consensus_queue.cc:1035] T 00000000000000000000000000000000 P dfa4f7cc43ed43e1bb70ce239a69cd99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6f7d38fca23431e8a90efc41b9d67d9" member_type: NON_VOTER last_known_addr { host: "127.19.236.124" port: 39963 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 15:03:51.229640 27369 consensus_peers.cc:487] T 00000000000000000000000000000000 P dfa4f7cc43ed43e1bb70ce239a69cd99 -> Peer d6f7d38fca23431e8a90efc41b9d67d9 (127.19.236.124:39963): Couldn't send request to peer d6f7d38fca23431e8a90efc41b9d67d9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260811 15:03:51.234748 28023 raft_consensus.cc:2229] T 00000000000000000000000000000000 P d6f7d38fca23431e8a90efc41b9d67d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 15:03:51.235077 28023 raft_consensus.cc:2258] T 00000000000000000000000000000000 P d6f7d38fca23431e8a90efc41b9d67d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:03:51.235196 28023 tablet_replica.cc:330] T 00000000000000000000000000000000 P d6f7d38fca23431e8a90efc41b9d67d9: stopping tablet replica
I20260811 15:03:51.236918 28011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:51.224073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.125:40287 (local address 127.0.0.1:50846)
0811 15:03:51.231664 (+ 7591us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:51.231683 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:51.231789 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:51.232282 (+ 493us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:51.232286 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:51.232309 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:03:51.232427 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:51.232433 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.233674 (+ 1241us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.233677 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:51.235053 (+ 1376us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:51.235065 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.236425 (+ 1360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.236429 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:51.236537 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:51.236617 (+ 80us) client_negotiation.cc:769] Sending connection context
0811 15:03:51.236690 (+ 73us) client_negotiation.cc:240] Negotiation successful
0811 15:03:51.236773 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7488}
I20260811 15:03:51.237354 28199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:51.224253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50846 (local address 127.19.236.125:40287)
0811 15:03:51.224401 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:51.224406 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:51.231902 (+ 7496us) server_negotiation.cc:407] Connection header received
0811 15:03:51.232064 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:51.232067 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:51.232137 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:51.232228 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:03:51.232639 (+ 411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.233423 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.235311 (+ 1888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.235989 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.236089 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:51.236250 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:51.237153 (+ 903us) server_negotiation.cc:299] Negotiation successful
0811 15:03:51.237240 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 15:03:51.240111 28072 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a46978a611c144cdb5359f623cd44007 [term 1 LEARNER]: Refusing update from remote peer dfa4f7cc43ed43e1bb70ce239a69cd99: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260811 15:03:51.240458 28023 master.cc:552] Master@127.19.236.124:39963 shutdown complete.
I20260811 15:03:51.240500 28023 master_runner.cc:305] Clearing existing system tablet
I20260811 15:03:51.240621 28017 consensus_queue.cc:1035] T 00000000000000000000000000000000 P dfa4f7cc43ed43e1bb70ce239a69cd99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46978a611c144cdb5359f623cd44007" member_type: NON_VOTER last_known_addr { host: "127.19.236.125" port: 40287 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260811 15:03:51.240800 28023 fs_manager.cc:359] Metadata directory not provided
I20260811 15:03:51.240855 28023 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:03:51.242599 28072 raft_consensus.cc:2932] T 00000000000000000000000000000000 P a46978a611c144cdb5359f623cd44007 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER d6f7d38fca23431e8a90efc41b9d67d9 (127.19.236.124) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "dfa4f7cc43ed43e1bb70ce239a69cd99" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 45445 } } peers { permanent_uuid: "a46978a611c144cdb5359f623cd44007" member_type: NON_VOTER last_known_addr { host: "127.19.236.125" port: 40287 } attrs { promote: true } } peers { permanent_uuid: "d6f7d38fca23431e8a90efc41b9d67d9" member_type: NON_VOTER last_known_addr { host: "127.19.236.124" port: 39963 } attrs { promote: true } } }
I20260811 15:03:51.244953 28101 sys_catalog.cc:455] T 00000000000000000000000000000000 P a46978a611c144cdb5359f623cd44007 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dfa4f7cc43ed43e1bb70ce239a69cd99. Latest consensus state: current_term: 1 leader_uuid: "dfa4f7cc43ed43e1bb70ce239a69cd99" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "dfa4f7cc43ed43e1bb70ce239a69cd99" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 45445 } } peers { permanent_uuid: "a46978a611c144cdb5359f623cd44007" member_type: NON_VOTER last_known_addr { host: "127.19.236.125" port: 40287 } attrs { promote: true } } peers { permanent_uuid: "d6f7d38fca23431e8a90efc41b9d67d9" member_type: NON_VOTER last_known_addr { host: "127.19.236.124" port: 39963 } attrs { promote: true } } }
I20260811 15:03:51.245069 28101 sys_catalog.cc:458] T 00000000000000000000000000000000 P a46978a611c144cdb5359f623cd44007 [sys.catalog]: This master's current role is: LEARNER
I20260811 15:03:51.245160 28101 sys_catalog.cc:455] T 00000000000000000000000000000000 P a46978a611c144cdb5359f623cd44007 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "dfa4f7cc43ed43e1bb70ce239a69cd99" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "dfa4f7cc43ed43e1bb70ce239a69cd99" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 45445 } } peers { permanent_uuid: "a46978a611c144cdb5359f623cd44007" member_type: NON_VOTER last_known_addr { host: "127.19.236.125" port: 40287 } attrs { promote: true } } peers { permanent_uuid: "d6f7d38fca23431e8a90efc41b9d67d9" member_type: NON_VOTER last_known_addr { host: "127.19.236.124" port: 39963 } attrs { promote: true } } }
I20260811 15:03:51.245221 28101 sys_catalog.cc:458] T 00000000000000000000000000000000 P a46978a611c144cdb5359f623cd44007 [sys.catalog]: This master's current role is: LEARNER
I20260811 15:03:51.246294 28017 raft_consensus.cc:1050] T 00000000000000000000000000000000 P dfa4f7cc43ed43e1bb70ce239a69cd99: attempting to promote NON_VOTER a46978a611c144cdb5359f623cd44007 to VOTER
I20260811 15:03:51.246799 28017 consensus_queue.cc:237] T 00000000000000000000000000000000 P dfa4f7cc43ed43e1bb70ce239a69cd99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "dfa4f7cc43ed43e1bb70ce239a69cd99" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 45445 } } peers { permanent_uuid: "a46978a611c144cdb5359f623cd44007" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 40287 } attrs { promote: false } } peers { permanent_uuid: "d6f7d38fca23431e8a90efc41b9d67d9" member_type: NON_VOTER last_known_addr { host: "127.19.236.124" port: 39963 } attrs { promote: true } }
I20260811 15:03:51.248769 28072 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a46978a611c144cdb5359f623cd44007 [term 1 LEARNER]: Refusing update from remote peer dfa4f7cc43ed43e1bb70ce239a69cd99: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260811 15:03:51.248883 28229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:51.248348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.124:39963 (local address 127.0.0.1:46984)
0811 15:03:51.248697 (+ 349us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:51.248769 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.124:39963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":124,"threads_started":1}
I20260811 15:03:51.249188 28014 consensus_queue.cc:1035] T 00000000000000000000000000000000 P dfa4f7cc43ed43e1bb70ce239a69cd99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46978a611c144cdb5359f623cd44007" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 40287 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260811 15:03:51.250176 28229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:51.249918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.124:39963 (local address 127.0.0.1:46996)
0811 15:03:51.250050 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:51.250111 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.124:39963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260811 15:03:51.250412 27369 consensus_peers.cc:487] T 00000000000000000000000000000000 P dfa4f7cc43ed43e1bb70ce239a69cd99 -> Peer d6f7d38fca23431e8a90efc41b9d67d9 (127.19.236.124:39963): Couldn't send request to peer d6f7d38fca23431e8a90efc41b9d67d9. Status: Network error: Client connection negotiation failed: client connection to 127.19.236.124:39963: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 15:03:51.251482 28023 fs_manager.cc:709] Time spent opening directory manager: real 0.010s user 0.001s sys 0.000s
I20260811 15:03:51.252104 28072 raft_consensus.cc:2932] T 00000000000000000000000000000000 P a46978a611c144cdb5359f623cd44007 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, a46978a611c144cdb5359f623cd44007 (127.19.236.125) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "dfa4f7cc43ed43e1bb70ce239a69cd99" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 45445 } } peers { permanent_uuid: "a46978a611c144cdb5359f623cd44007" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 40287 } attrs { promote: false } } peers { permanent_uuid: "d6f7d38fca23431e8a90efc41b9d67d9" member_type: NON_VOTER last_known_addr { host: "127.19.236.124" port: 39963 } attrs { promote: true } } }
I20260811 15:03:51.251605 28014 raft_consensus.cc:2932] T 00000000000000000000000000000000 P dfa4f7cc43ed43e1bb70ce239a69cd99 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, a46978a611c144cdb5359f623cd44007 (127.19.236.125) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "dfa4f7cc43ed43e1bb70ce239a69cd99" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 45445 } } peers { permanent_uuid: "a46978a611c144cdb5359f623cd44007" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 40287 } attrs { promote: false } } peers { permanent_uuid: "d6f7d38fca23431e8a90efc41b9d67d9" member_type: NON_VOTER last_known_addr { host: "127.19.236.124" port: 39963 } attrs { promote: true } } }
I20260811 15:03:51.254199 28014 sys_catalog.cc:455] T 00000000000000000000000000000000 P dfa4f7cc43ed43e1bb70ce239a69cd99 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "dfa4f7cc43ed43e1bb70ce239a69cd99" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "dfa4f7cc43ed43e1bb70ce239a69cd99" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 45445 } } peers { permanent_uuid: "a46978a611c144cdb5359f623cd44007" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 40287 } attrs { promote: false } } peers { permanent_uuid: "d6f7d38fca23431e8a90efc41b9d67d9" member_type: NON_VOTER last_known_addr { host: "127.19.236.124" port: 39963 } attrs { promote: true } } }
I20260811 15:03:51.254314 28014 sys_catalog.cc:458] T 00000000000000000000000000000000 P dfa4f7cc43ed43e1bb70ce239a69cd99 [sys.catalog]: This master's current role is: LEADER
I20260811 15:03:51.254467 28014 sys_catalog.cc:455] T 00000000000000000000000000000000 P dfa4f7cc43ed43e1bb70ce239a69cd99 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "dfa4f7cc43ed43e1bb70ce239a69cd99" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "dfa4f7cc43ed43e1bb70ce239a69cd99" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 45445 } } peers { permanent_uuid: "a46978a611c144cdb5359f623cd44007" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 40287 } attrs { promote: false } } peers { permanent_uuid: "d6f7d38fca23431e8a90efc41b9d67d9" member_type: NON_VOTER last_known_addr { host: "127.19.236.124" port: 39963 } attrs { promote: true } } }
I20260811 15:03:51.254549 28014 sys_catalog.cc:458] T 00000000000000000000000000000000 P dfa4f7cc43ed43e1bb70ce239a69cd99 [sys.catalog]: This master's current role is: LEADER
I20260811 15:03:51.255774 28228 sys_catalog.cc:455] T 00000000000000000000000000000000 P a46978a611c144cdb5359f623cd44007 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "dfa4f7cc43ed43e1bb70ce239a69cd99" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "dfa4f7cc43ed43e1bb70ce239a69cd99" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 45445 } } peers { permanent_uuid: "a46978a611c144cdb5359f623cd44007" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 40287 } attrs { promote: false } } peers { permanent_uuid: "d6f7d38fca23431e8a90efc41b9d67d9" member_type: NON_VOTER last_known_addr { host: "127.19.236.124" port: 39963 } attrs { promote: true } } }
I20260811 15:03:51.255919 28228 sys_catalog.cc:458] T 00000000000000000000000000000000 P a46978a611c144cdb5359f623cd44007 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 15:03:51.256735 28230 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:51.257289 28023 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:03:51.257452 28023 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.001s sys 0.000s
I20260811 15:03:51.257503 28023 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/master-2/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/master-2/wal
uuid: "d6f7d38fca23431e8a90efc41b9d67d9"
format_stamp: "Formatted at 2026-08-11 15:03:51 on dist-test-slave-8n49"
server_key: "5f97ae079a4754ab34fcdf84b13dd8d0"
server_key_iv: "d87d57e52782e3e69f699cc83f8f6210"
server_key_version: "encryptionkey@0"
I20260811 15:03:51.259756 28023 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P d6f7d38fca23431e8a90efc41b9d67d9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 15:03:51.262547 28023 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P d6f7d38fca23431e8a90efc41b9d67d9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260811 15:03:51.262650 28023 log.cc:1196] T 00000000000000000000000000000000 P d6f7d38fca23431e8a90efc41b9d67d9: Deleting WAL directory at /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260811 15:03:51.262912 28023 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P d6f7d38fca23431e8a90efc41b9d67d9: Deleting consensus metadata
I20260811 15:03:51.263082 28023 master_runner.cc:315] Copying system tablet from 127.19.236.126:45445
I20260811 15:03:51.264281 28023 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P d6f7d38fca23431e8a90efc41b9d67d9: tablet copy: Beginning tablet copy session from remote peer at address 127.19.236.126:45445
I20260811 15:03:51.274597 27431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:51.264990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43532 (local address 127.19.236.126:45445)
0811 15:03:51.265127 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:51.265132 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:51.265311 (+ 179us) server_negotiation.cc:407] Connection header received
0811 15:03:51.265421 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:51.265425 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:51.265482 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:51.265578 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:51.266130 (+ 552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.267013 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.268451 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.268841 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.268954 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:51.270867 (+ 1913us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:51.270871 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:51.270874 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:51.270902 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:51.272646 (+ 1744us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:51.273148 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:51.273152 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:51.273154 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:51.273246 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:51.273563 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:51.273566 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:51.273568 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:51.273858 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:51.273974 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:51.274295 (+ 321us) server_negotiation.cc:299] Negotiation successful
0811 15:03:51.274420 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 15:03:51.274601 28236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:51.264883 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:45445 (local address 127.0.0.1:43532)
0811 15:03:51.265203 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:51.265218 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:51.265335 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:51.265614 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:51.265618 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:51.265867 (+ 249us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:51.266004 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:51.266011 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.267145 (+ 1134us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.267148 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:51.268213 (+ 1065us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:51.268224 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.268981 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.268985 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:51.269093 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:51.270222 (+ 1129us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:03:51.270238 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:51.270707 (+ 469us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:51.272762 (+ 2055us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:51.272766 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:51.272768 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:51.273036 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:51.273349 (+ 313us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:51.273352 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:51.273354 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:51.273461 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:51.273970 (+ 509us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:51.273973 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:51.274107 (+ 134us) client_negotiation.cc:769] Sending connection context
0811 15:03:51.274243 (+ 136us) client_negotiation.cc:240] Negotiation successful
0811 15:03:51.274398 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":242,"thread_start_us":87,"threads_started":1}
I20260811 15:03:51.275548 27412 tablet_copy_service.cc:140] P dfa4f7cc43ed43e1bb70ce239a69cd99: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer d6f7d38fca23431e8a90efc41b9d67d9 ({username='oryx', principal='oryx/127.19.236.124@KRBTEST.COM'} at 127.0.0.1:43532)
I20260811 15:03:51.275655 27412 tablet_copy_service.cc:161] P dfa4f7cc43ed43e1bb70ce239a69cd99: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer d6f7d38fca23431e8a90efc41b9d67d9 at {username='oryx', principal='oryx/127.19.236.124@KRBTEST.COM'} at 127.0.0.1:43532: session id = d6f7d38fca23431e8a90efc41b9d67d9-00000000000000000000000000000000
I20260811 15:03:51.276808 27412 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P dfa4f7cc43ed43e1bb70ce239a69cd99: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 15:03:51.278168 28023 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260811 15:03:51.280718 28023 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P d6f7d38fca23431e8a90efc41b9d67d9: tablet copy: Starting download of 0 data blocks...
I20260811 15:03:51.280915 28023 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P d6f7d38fca23431e8a90efc41b9d67d9: tablet copy: Starting download of 1 WAL segments...
I20260811 15:03:51.286100 28023 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P d6f7d38fca23431e8a90efc41b9d67d9: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 15:03:51.288446 27412 tablet_copy_service.cc:342] P dfa4f7cc43ed43e1bb70ce239a69cd99: Request end of tablet copy session d6f7d38fca23431e8a90efc41b9d67d9-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.19.236.124@KRBTEST.COM'} at 127.0.0.1:43532
I20260811 15:03:51.288576 27412 tablet_copy_service.cc:433] P dfa4f7cc43ed43e1bb70ce239a69cd99: ending tablet copy session d6f7d38fca23431e8a90efc41b9d67d9-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer d6f7d38fca23431e8a90efc41b9d67d9
I20260811 15:03:51.297760 28023 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:03:51.299845 28237 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:51.300028 28239 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:51.300333 28241 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:51.300485 28023 server_base.cc:1034] running on GCE node
I20260811 15:03:51.300760 28023 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:03:51.301081 28023 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:03:51.302237 28023 hybrid_clock.cc:648] HybridClock initialized: now 1786460631302212 us; error 41 us; skew 500 ppm
I20260811 15:03:51.303457 27753 heartbeater.cc:503] Master 127.19.236.126:45445 was elected leader, sending a full tablet report...
Aug 11 15:03:51 dist-test-slave-8n49 krb5kdc[27335](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460631, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.236.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:03:51.303890 28023 init.cc:377] Logged in from keytab as oryx/127.19.236.124@KRBTEST.COM (short username oryx)
I20260811 15:03:51.304381 28023 webserver.cc:460] Webserver started at http://127.19.236.124:38987/ using document root <none> and password file <none>
I20260811 15:03:51.304633 28023 fs_manager.cc:359] Metadata directory not provided
I20260811 15:03:51.304672 28023 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:03:51.306118 28023 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 15:03:51.307242 28249 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:51.307548 28023 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 15:03:51.307694 28023 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/master-2/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/master-2/wal
uuid: "d6f7d38fca23431e8a90efc41b9d67d9"
format_stamp: "Formatted at 2026-08-11 15:03:51 on dist-test-slave-8n49"
server_key: "5f97ae079a4754ab34fcdf84b13dd8d0"
server_key_iv: "d87d57e52782e3e69f699cc83f8f6210"
server_key_version: "encryptionkey@0"
I20260811 15:03:51.307878 28023 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:03:51.327715 28023 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:03:51.330458 28023 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:03:51.336161 28023 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.124:39963
I20260811 15:03:51.336230 28308 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.124:39963 every 8 connection(s)
I20260811 15:03:51.337047 28023 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/master-2/data/info.pb
I20260811 15:03:51.339205 28309 sys_catalog.cc:263] Verifying existing consensus state
I20260811 15:03:51.340529 28309 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d6f7d38fca23431e8a90efc41b9d67d9: Bootstrap starting.
W20260811 15:03:51.353632 28225 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:03:51.354007 28225 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:03:51.354097 28225 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260811 15:03:51.354740 28309 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d6f7d38fca23431e8a90efc41b9d67d9: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 15:03:51.355065 28309 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d6f7d38fca23431e8a90efc41b9d67d9: Bootstrap complete.
I20260811 15:03:51.355746 28309 raft_consensus.cc:348] T 00000000000000000000000000000000 P d6f7d38fca23431e8a90efc41b9d67d9 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "dfa4f7cc43ed43e1bb70ce239a69cd99" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 45445 } } peers { permanent_uuid: "a46978a611c144cdb5359f623cd44007" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 40287 } attrs { promote: false } } peers { permanent_uuid: "d6f7d38fca23431e8a90efc41b9d67d9" member_type: NON_VOTER last_known_addr { host: "127.19.236.124" port: 39963 } attrs { promote: true } }
I20260811 15:03:51.355890 28309 raft_consensus.cc:729] T 00000000000000000000000000000000 P d6f7d38fca23431e8a90efc41b9d67d9 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d6f7d38fca23431e8a90efc41b9d67d9, State: Initialized, Role: LEARNER
I20260811 15:03:51.356017 28309 consensus_queue.cc:260] T 00000000000000000000000000000000 P d6f7d38fca23431e8a90efc41b9d67d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "dfa4f7cc43ed43e1bb70ce239a69cd99" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 45445 } } peers { permanent_uuid: "a46978a611c144cdb5359f623cd44007" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 40287 } attrs { promote: false } } peers { permanent_uuid: "d6f7d38fca23431e8a90efc41b9d67d9" member_type: NON_VOTER last_known_addr { host: "127.19.236.124" port: 39963 } attrs { promote: true } }
I20260811 15:03:51.356400 28316 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6f7d38fca23431e8a90efc41b9d67d9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "dfa4f7cc43ed43e1bb70ce239a69cd99" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 45445 } } peers { permanent_uuid: "a46978a611c144cdb5359f623cd44007" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 40287 } attrs { promote: false } } peers { permanent_uuid: "d6f7d38fca23431e8a90efc41b9d67d9" member_type: NON_VOTER last_known_addr { host: "127.19.236.124" port: 39963 } attrs { promote: true } } }
I20260811 15:03:51.356508 28309 sys_catalog.cc:564] T 00000000000000000000000000000000 P d6f7d38fca23431e8a90efc41b9d67d9 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:03:51.356643 28316 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6f7d38fca23431e8a90efc41b9d67d9 [sys.catalog]: This master's current role is: LEARNER
I20260811 15:03:51.359897 28330 catalog_manager.cc:1259] Loaded cluster ID: 2f2396d66c644234b32f65149aa17925
I20260811 15:03:51.360035 28330 catalog_manager.cc:1552] T 00000000000000000000000000000000 P d6f7d38fca23431e8a90efc41b9d67d9: loading cluster ID for follower catalog manager: success
W20260811 15:03:51.361254 28225 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:03:51.361349 28225 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:03:51.361474 28225 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.65
I20260811 15:03:51.362480 28330 catalog_manager.cc:1574] T 00000000000000000000000000000000 P d6f7d38fca23431e8a90efc41b9d67d9: acquiring CA information for follower catalog manager: success
I20260811 15:03:51.363863 28330 catalog_manager.cc:1602] T 00000000000000000000000000000000 P d6f7d38fca23431e8a90efc41b9d67d9: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 15:03:51.367362 28225 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:41993
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/krb5kdc/oryx_127.19.236.65.keytab
--principal=oryx/127.19.236.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.65:32827
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.236.65
--webserver_port=40373
--tserver_master_addrs=127.19.236.126:45445,127.19.236.125:40287,127.19.236.124:39963
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28225
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.65
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:03:51.368724 28225 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:03:51.370604 28225 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:03:51.383926 28333 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:51.383936 28332 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:51.383926 28335 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:51.384196 28225 server_base.cc:1034] running on GCE node
I20260811 15:03:51.384747 28225 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:03:51.385493 28225 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:03:51.386700 28225 hybrid_clock.cc:648] HybridClock initialized: now 1786460631386677 us; error 37 us; skew 500 ppm
Aug 11 15:03:51 dist-test-slave-8n49 krb5kdc[27335](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460631, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.236.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:03:51.389958 28225 init.cc:377] Logged in from keytab as oryx/127.19.236.65@KRBTEST.COM (short username oryx)
I20260811 15:03:51.390988 28225 webserver.cc:460] Webserver started at http://127.19.236.65:40373/ using document root <none> and password file <none>
I20260811 15:03:51.391607 28225 fs_manager.cc:359] Metadata directory not provided
I20260811 15:03:51.391711 28225 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:03:51.396049 28225 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260811 15:03:51.398337 28343 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:51.399842 28225 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 15:03:51.400019 28225 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-0/wal
uuid: "55302221fdca40ec9f7bf6d725c0da72"
format_stamp: "Formatted at 2026-08-11 15:03:49 on dist-test-slave-8n49"
server_key: "398d81fc84130685497d1127b5a19090"
server_key_iv: "5eef159e862ebe8e5f3b68379390670d"
server_key_version: "encryptionkey@0"
I20260811 15:03:51.400704 28225 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:03:51.418697 28225 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:03:51.422372 28225 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:03:51.422601 28225 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:03:51.423251 28225 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:03:51.424186 28225 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:03:51.424260 28225 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:51.424336 28225 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:03:51.424386 28225 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:51.434602 28225 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.65:32827
I20260811 15:03:51.434628 28470 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.65:32827 every 8 connection(s)
I20260811 15:03:51.435627 28225 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
I20260811 15:03:51.441787 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 28225
I20260811 15:03:51.442055 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 27610
Aug 11 15:03:51 dist-test-slave-8n49 krb5kdc[27335](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460631, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.236.65@KRBTEST.COM for oryx/127.19.236.125@KRBTEST.COM
Aug 11 15:03:51 dist-test-slave-8n49 krb5kdc[27335](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460631, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.236.65@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM
Aug 11 15:03:51 dist-test-slave-8n49 krb5kdc[27335](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460631, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.236.65@KRBTEST.COM for oryx/127.19.236.124@KRBTEST.COM
I20260811 15:03:51.457809 28477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:51.438646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.125:40287 (local address 127.19.236.65:48439)
0811 15:03:51.439736 (+ 1090us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:51.439757 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:51.440694 (+ 937us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:51.441401 (+ 707us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:51.441412 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:51.442149 (+ 737us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:51.444415 (+ 2266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:51.444431 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.446064 (+ 1633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.446071 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:51.447474 (+ 1403us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:51.447490 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.448365 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.448372 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:51.448516 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:51.449185 (+ 669us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:03:51.449198 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:51.451099 (+ 1901us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:51.453614 (+ 2515us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:51.453620 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:51.453640 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:51.454164 (+ 524us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:51.454573 (+ 409us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:51.454580 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:51.454585 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:51.454818 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:51.455459 (+ 641us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:51.455469 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:51.455829 (+ 360us) client_negotiation.cc:769] Sending connection context
0811 15:03:51.456067 (+ 238us) client_negotiation.cc:240] Negotiation successful
0811 15:03:51.456499 (+ 432us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":969,"mutex_wait_us":2013,"spinlock_wait_cycles":36608,"thread_start_us":187,"threads_started":1}
I20260811 15:03:51.458869 28199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:51.438083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.65:48439 (local address 127.19.236.125:40287)
0811 15:03:51.438297 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:51.438303 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:51.439913 (+ 1610us) server_negotiation.cc:407] Connection header received
0811 15:03:51.441086 (+ 1173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:51.441092 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:51.441183 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:51.441272 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:51.444679 (+ 3407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.445878 (+ 1199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.447664 (+ 1786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.448193 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.448337 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:51.451367 (+ 3030us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:51.451372 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:51.451375 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:51.451418 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:51.453478 (+ 2060us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:51.454293 (+ 815us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:51.454300 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:51.454305 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:51.454426 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:51.454955 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:51.454961 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:51.454966 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:51.455283 (+ 317us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:51.455385 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:51.458462 (+ 3077us) server_negotiation.cc:299] Negotiation successful
0811 15:03:51.458631 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103}
I20260811 15:03:51.460458 27431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:51.440261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.65:55755 (local address 127.19.236.126:45445)
0811 15:03:51.440457 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:51.440461 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:51.440474 (+ 13us) server_negotiation.cc:407] Connection header received
0811 15:03:51.440960 (+ 486us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:51.440963 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:51.441055 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:51.441120 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:51.444466 (+ 3346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.445279 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.447004 (+ 1725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.447353 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.447447 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:51.453682 (+ 6235us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:51.453691 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:51.453697 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:51.453755 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:51.455874 (+ 2119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:51.456528 (+ 654us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:51.456534 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:51.456569 (+ 35us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:51.456672 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:51.457605 (+ 933us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:51.457609 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:51.457611 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:51.457931 (+ 320us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:51.458511 (+ 580us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:51.460060 (+ 1549us) server_negotiation.cc:299] Negotiation successful
0811 15:03:51.460231 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260811 15:03:51.460479 28473 heartbeater.cc:347] Connected to a master server at 127.19.236.125:40287
I20260811 15:03:51.460825 28473 heartbeater.cc:464] Registering TS with master...
I20260811 15:03:51.461364 28478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:51.439913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:45445 (local address 127.19.236.65:55755)
0811 15:03:51.440285 (+ 372us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:51.440301 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:51.440700 (+ 399us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:51.441488 (+ 788us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:51.441493 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:51.442126 (+ 633us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:51.444248 (+ 2122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:51.444270 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.445483 (+ 1213us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.445489 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:51.446848 (+ 1359us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:51.446863 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.447667 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.447673 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:51.447889 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:51.448855 (+ 966us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:03:51.448880 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:51.453424 (+ 4544us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:51.456039 (+ 2615us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:51.456045 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:51.456049 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:51.456347 (+ 298us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:51.456863 (+ 516us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:51.456866 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:51.456868 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:51.456967 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:51.458713 (+ 1746us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:51.458719 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:51.459832 (+ 1113us) client_negotiation.cc:769] Sending connection context
0811 15:03:51.460919 (+ 1087us) client_negotiation.cc:240] Negotiation successful
0811 15:03:51.461116 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":274,"mutex_wait_us":4,"spinlock_wait_cycles":5376,"thread_start_us":101,"threads_started":1}
I20260811 15:03:51.461483 28473 heartbeater.cc:511] Master 127.19.236.125:40287 requested a full tablet report, sending...
I20260811 15:03:51.462306 28472 heartbeater.cc:347] Connected to a master server at 127.19.236.126:45445
I20260811 15:03:51.462396 28472 heartbeater.cc:464] Registering TS with master...
I20260811 15:03:51.462617 28475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:51.438088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.65:45829 (local address 127.19.236.124:39963)
0811 15:03:51.438359 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:51.438371 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:51.439497 (+ 1126us) server_negotiation.cc:407] Connection header received
0811 15:03:51.440932 (+ 1435us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:51.440935 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:51.441002 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:51.441118 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:51.448830 (+ 7712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.449926 (+ 1096us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.451321 (+ 1395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.451678 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.451769 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:51.457585 (+ 5816us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:51.457591 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:51.457594 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:51.457636 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:51.459592 (+ 1956us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:51.460123 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:51.460127 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:51.460128 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:51.460264 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:51.461231 (+ 967us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:51.461237 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:51.461239 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:51.461598 (+ 359us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:51.461704 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:51.462253 (+ 549us) server_negotiation.cc:299] Negotiation successful
0811 15:03:51.462421 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":193,"thread_start_us":87,"threads_started":1}
I20260811 15:03:51.462626 28472 heartbeater.cc:511] Master 127.19.236.126:45445 requested a full tablet report, sending...
I20260811 15:03:51.462977 28476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:51.438646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.124:39963 (local address 127.19.236.65:45829)
0811 15:03:51.439268 (+ 622us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:51.439353 (+ 85us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:51.440686 (+ 1333us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:51.441401 (+ 715us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:51.441412 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:51.448491 (+ 7079us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:51.448645 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:51.448656 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.450097 (+ 1441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.450100 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:51.451185 (+ 1085us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:51.451196 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.451972 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.451979 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:51.452103 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:51.453630 (+ 1527us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:03:51.453645 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:51.457360 (+ 3715us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:51.459742 (+ 2382us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:51.459746 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:51.459748 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:51.460002 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:51.460385 (+ 383us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:51.460387 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:51.460389 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:51.460475 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:51.461941 (+ 1466us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:51.461944 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:51.462044 (+ 100us) client_negotiation.cc:769] Sending connection context
0811 15:03:51.462175 (+ 131us) client_negotiation.cc:240] Negotiation successful
0811 15:03:51.462332 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":403,"spinlock_wait_cycles":896,"thread_start_us":752,"threads_started":1}
I20260811 15:03:51.463474 28061 ts_manager.cc:194] Registered new tserver with Master: 55302221fdca40ec9f7bf6d725c0da72 (127.19.236.65:32827)
I20260811 15:03:51.463779 28471 heartbeater.cc:347] Connected to a master server at 127.19.236.124:39963
I20260811 15:03:51.463871 28471 heartbeater.cc:464] Registering TS with master...
I20260811 15:03:51.463923 27385 ts_manager.cc:194] Re-registered known tserver with Master: 55302221fdca40ec9f7bf6d725c0da72 (127.19.236.65:32827)
I20260811 15:03:51.464046 28471 heartbeater.cc:511] Master 127.19.236.124:39963 requested a full tablet report, sending...
I20260811 15:03:51.464787 27385 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.19.236.65@KRBTEST.COM'} at 127.19.236.65:55755
I20260811 15:03:51.465142 28267 ts_manager.cc:194] Registered new tserver with Master: 55302221fdca40ec9f7bf6d725c0da72 (127.19.236.65:32827)
I20260811 15:03:51.466106 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.66:36551
--local_ip_for_outbound_sockets=127.19.236.66
--tserver_master_addrs=127.19.236.126:45445
--webserver_port=42569
--webserver_interface=127.19.236.66
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/krb5kdc/oryx_127.19.236.66.keytab
--principal=oryx/127.19.236.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:41993
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.19.236.126:45445,127.19.236.125:40287
--tserver_master_addrs=127.19.236.126:45445,127.19.236.125:40287,127.19.236.124:39963 with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 15:03:51.539125 27906 heartbeater.cc:503] Master 127.19.236.126:45445 was elected leader, sending a full tablet report...
W20260811 15:03:51.590232 28479 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:03:51.590534 28479 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:03:51.590579 28479 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:03:51.594851 28479 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:03:51.594920 28479 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:03:51.594987 28479 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.66
I20260811 15:03:51.600716 28479 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:41993
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/krb5kdc/oryx_127.19.236.66.keytab
--principal=oryx/127.19.236.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.66:36551
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.236.66
--webserver_port=42569
--tserver_master_addrs=127.19.236.126:45445,127.19.236.125:40287,127.19.236.124:39963
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28479
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.66
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:03:51.601909 28479 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:03:51.603015 28479 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:03:51.613835 28488 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:51.613839 28485 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:51.614080 28479 server_base.cc:1034] running on GCE node
W20260811 15:03:51.613849 28486 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:51.614636 28479 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:03:51.615372 28479 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:03:51.616636 28479 hybrid_clock.cc:648] HybridClock initialized: now 1786460631616616 us; error 36 us; skew 500 ppm
Aug 11 15:03:51 dist-test-slave-8n49 krb5kdc[27335](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460631, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.236.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:03:51.619546 28479 init.cc:377] Logged in from keytab as oryx/127.19.236.66@KRBTEST.COM (short username oryx)
I20260811 15:03:51.620602 28479 webserver.cc:460] Webserver started at http://127.19.236.66:42569/ using document root <none> and password file <none>
I20260811 15:03:51.621227 28479 fs_manager.cc:359] Metadata directory not provided
I20260811 15:03:51.621336 28479 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:03:51.625530 28479 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 15:03:51.627878 28495 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:51.629356 28479 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 15:03:51.629514 28479 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-1/wal
uuid: "f6c63cee7b22430ea73e77d9429091a3"
format_stamp: "Formatted at 2026-08-11 15:03:50 on dist-test-slave-8n49"
server_key: "0f6e05386debbc11c5676cf2bd99d83e"
server_key_iv: "cc825448f2115f4c6f7f73051e842110"
server_key_version: "encryptionkey@0"
I20260811 15:03:51.630129 28479 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:03:51.645021 28475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:51.641246 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47006 (local address 127.19.236.124:39963)
0811 15:03:51.641385 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:51.641390 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:51.641409 (+ 19us) server_negotiation.cc:407] Connection header received
0811 15:03:51.641556 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:51.641560 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:51.641624 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:51.641735 (+ 111us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:03:51.641981 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.642774 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.643786 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.644431 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.644586 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:51.644743 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:51.644794 (+ 51us) server_negotiation.cc:299] Negotiation successful
0811 15:03:51.644866 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 15:03:51.645030 28011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:51.641177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.124:39963 (local address 127.0.0.1:47006)
0811 15:03:51.641322 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:51.641341 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:51.641440 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:51.641762 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:51.641764 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:51.641782 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:03:51.641878 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:51.641884 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.642909 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.642912 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:51.643671 (+ 759us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:51.643679 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.644619 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.644623 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:51.644693 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:51.644717 (+ 24us) client_negotiation.cc:769] Sending connection context
0811 15:03:51.644779 (+ 62us) client_negotiation.cc:240] Negotiation successful
0811 15:03:51.644846 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47}
I20260811 15:03:51.645790 28280 raft_consensus.cc:1203] T 00000000000000000000000000000000 P d6f7d38fca23431e8a90efc41b9d67d9 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260811 15:03:51.646188 28316 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6f7d38fca23431e8a90efc41b9d67d9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dfa4f7cc43ed43e1bb70ce239a69cd99. Latest consensus state: current_term: 1 leader_uuid: "dfa4f7cc43ed43e1bb70ce239a69cd99" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "dfa4f7cc43ed43e1bb70ce239a69cd99" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 45445 } } peers { permanent_uuid: "a46978a611c144cdb5359f623cd44007" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 40287 } attrs { promote: false } } peers { permanent_uuid: "d6f7d38fca23431e8a90efc41b9d67d9" member_type: NON_VOTER last_known_addr { host: "127.19.236.124" port: 39963 } attrs { promote: true } } }
I20260811 15:03:51.646337 28316 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6f7d38fca23431e8a90efc41b9d67d9 [sys.catalog]: This master's current role is: LEARNER
I20260811 15:03:51.652022 28479 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:03:51.656098 28479 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:03:51.656334 28479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:03:51.657146 28479 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:03:51.658149 28479 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:03:51.658203 28479 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:51.658247 28479 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:03:51.658263 28479 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:51.667366 28479 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.66:36551
I20260811 15:03:51.667454 28619 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.66:36551 every 8 connection(s)
I20260811 15:03:51.668624 28479 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
I20260811 15:03:51.675771 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 28479
I20260811 15:03:51.675979 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 27759
Aug 11 15:03:51 dist-test-slave-8n49 krb5kdc[27335](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460631, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.236.66@KRBTEST.COM for oryx/127.19.236.125@KRBTEST.COM
Aug 11 15:03:51 dist-test-slave-8n49 krb5kdc[27335](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460631, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.236.66@KRBTEST.COM for oryx/127.19.236.124@KRBTEST.COM
I20260811 15:03:51.686642 28199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:51.672151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.66:48423 (local address 127.19.236.125:40287)
0811 15:03:51.672290 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:51.672295 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:51.672589 (+ 294us) server_negotiation.cc:407] Connection header received
0811 15:03:51.673686 (+ 1097us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:51.673690 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:51.673740 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:51.673828 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:51.674991 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.675527 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.677147 (+ 1620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.677473 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.677537 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:51.680990 (+ 3453us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:51.680994 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:51.680997 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:51.681028 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:51.683676 (+ 2648us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:51.684637 (+ 961us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:51.684644 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:51.684649 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:51.684751 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:51.685249 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:51.685253 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:51.685254 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:51.685512 (+ 258us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:51.685598 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:51.686324 (+ 726us) server_negotiation.cc:299] Negotiation successful
0811 15:03:51.686464 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 15:03:51.686811 28475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:51.670625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.66:53145 (local address 127.19.236.124:39963)
0811 15:03:51.670776 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:51.670781 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:51.671741 (+ 960us) server_negotiation.cc:407] Connection header received
0811 15:03:51.673165 (+ 1424us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:51.673173 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:51.673362 (+ 189us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:51.673524 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:51.675739 (+ 2215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.676543 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.677997 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.678344 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.678478 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:51.681030 (+ 2552us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:51.681034 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:51.681036 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:51.681067 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:51.683676 (+ 2609us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:51.685009 (+ 1333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:51.685015 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:51.685020 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:51.685117 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:51.685520 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:51.685526 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:51.685531 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:51.685848 (+ 317us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:51.685976 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:51.686370 (+ 394us) server_negotiation.cc:299] Negotiation successful
0811 15:03:51.686570 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 15:03:51.688758 28627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:51.671986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.125:40287 (local address 127.19.236.66:48423)
0811 15:03:51.672454 (+ 468us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:51.672469 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:51.672833 (+ 364us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:51.673867 (+ 1034us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:51.673873 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:51.674292 (+ 419us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:51.674825 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:51.674834 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.675676 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.675679 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:51.677005 (+ 1326us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:51.677019 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.677719 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.677721 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:51.677918 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:51.678670 (+ 752us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:03:51.678699 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:51.680768 (+ 2069us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:51.683918 (+ 3150us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:51.683929 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:51.683959 (+ 30us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:51.684432 (+ 473us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:51.684870 (+ 438us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:51.684876 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:51.684881 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:51.685130 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:51.685672 (+ 542us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:51.685679 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:51.686025 (+ 346us) client_negotiation.cc:769] Sending connection context
0811 15:03:51.687374 (+ 1349us) client_negotiation.cc:240] Negotiation successful
0811 15:03:51.687599 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":410,"mutex_wait_us":195,"spinlock_wait_cycles":40704,"thread_start_us":80,"threads_started":1}
I20260811 15:03:51.689054 28624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:51.671074 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.124:39963 (local address 127.19.236.66:53145)
0811 15:03:51.671573 (+ 499us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:51.671629 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:51.672833 (+ 1204us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:51.673667 (+ 834us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:51.673675 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:51.674292 (+ 617us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:51.674825 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:51.674834 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.676732 (+ 1898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.676738 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:51.677860 (+ 1122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:51.677875 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.678480 (+ 605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.678484 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:51.678585 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:51.679101 (+ 516us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:03:51.679122 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:51.680839 (+ 1717us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:51.684622 (+ 3783us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:51.684627 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:51.684631 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:51.684884 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:51.685242 (+ 358us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:51.685248 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:51.685253 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:51.685393 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:51.686040 (+ 647us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:51.686046 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:51.686156 (+ 110us) client_negotiation.cc:769] Sending connection context
0811 15:03:51.686983 (+ 827us) client_negotiation.cc:240] Negotiation successful
0811 15:03:51.687439 (+ 456us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":295,"mutex_wait_us":102,"spinlock_wait_cycles":13184,"thread_start_us":121,"threads_started":1}
Aug 11 15:03:51 dist-test-slave-8n49 krb5kdc[27335](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460631, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.236.66@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM
I20260811 15:03:51.689345 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.67:37021
--local_ip_for_outbound_sockets=127.19.236.67
--tserver_master_addrs=127.19.236.126:45445
--webserver_port=36755
--webserver_interface=127.19.236.67
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/krb5kdc/oryx_127.19.236.67.keytab
--principal=oryx/127.19.236.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:41993
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.19.236.126:45445,127.19.236.125:40287
--tserver_master_addrs=127.19.236.126:45445,127.19.236.125:40287,127.19.236.124:39963 with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 15:03:51.690691 28622 heartbeater.cc:347] Connected to a master server at 127.19.236.125:40287
I20260811 15:03:51.691009 28622 heartbeater.cc:464] Registering TS with master...
I20260811 15:03:51.691685 28622 heartbeater.cc:511] Master 127.19.236.125:40287 requested a full tablet report, sending...
I20260811 15:03:51.692296 28620 heartbeater.cc:347] Connected to a master server at 127.19.236.124:39963
I20260811 15:03:51.692418 28620 heartbeater.cc:464] Registering TS with master...
I20260811 15:03:51.692641 28620 heartbeater.cc:511] Master 127.19.236.124:39963 requested a full tablet report, sending...
I20260811 15:03:51.693359 28061 ts_manager.cc:194] Registered new tserver with Master: f6c63cee7b22430ea73e77d9429091a3 (127.19.236.66:36551)
I20260811 15:03:51.693456 28625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:51.671074 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:45445 (local address 127.19.236.66:56687)
0811 15:03:51.672239 (+ 1165us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:51.672252 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:51.672920 (+ 668us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:51.673670 (+ 750us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:51.673677 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:51.674255 (+ 578us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:51.674811 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:51.674826 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.685205 (+ 10379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.685212 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:51.686206 (+ 994us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:51.686219 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.687281 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.687287 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:51.687390 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:51.687975 (+ 585us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:03:51.687991 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:51.689617 (+ 1626us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:51.691748 (+ 2131us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:51.691752 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:51.691754 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:51.691954 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:51.692305 (+ 351us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:51.692308 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:51.692310 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:51.692411 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:51.692936 (+ 525us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:51.692939 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:51.693035 (+ 96us) client_negotiation.cc:769] Sending connection context
0811 15:03:51.693126 (+ 91us) client_negotiation.cc:240] Negotiation successful
0811 15:03:51.693272 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1061,"mutex_wait_us":74,"spinlock_wait_cycles":15616,"thread_start_us":156,"threads_started":1}
I20260811 15:03:51.693451 28267 ts_manager.cc:194] Registered new tserver with Master: f6c63cee7b22430ea73e77d9429091a3 (127.19.236.66:36551)
I20260811 15:03:51.694039 27431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:51.670705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.66:56687 (local address 127.19.236.126:45445)
0811 15:03:51.670875 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:51.670881 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:51.672349 (+ 1468us) server_negotiation.cc:407] Connection header received
0811 15:03:51.673283 (+ 934us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:51.673286 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:51.673340 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:51.673419 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:51.674967 (+ 1548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.675586 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.686386 (+ 10800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.686772 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.686877 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:51.689813 (+ 2936us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:51.689820 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:51.689826 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:51.689865 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:51.691613 (+ 1748us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:51.692108 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:51.692111 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:51.692113 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:51.692205 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:51.692525 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:51.692528 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:51.692530 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:51.692792 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:51.692891 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:51.693684 (+ 793us) server_negotiation.cc:299] Negotiation successful
0811 15:03:51.693818 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 15:03:51.694621 28621 heartbeater.cc:347] Connected to a master server at 127.19.236.126:45445
I20260811 15:03:51.694721 28621 heartbeater.cc:464] Registering TS with master...
I20260811 15:03:51.694875 28621 heartbeater.cc:511] Master 127.19.236.126:45445 requested a full tablet report, sending...
I20260811 15:03:51.695564 27385 ts_manager.cc:194] Re-registered known tserver with Master: f6c63cee7b22430ea73e77d9429091a3 (127.19.236.66:36551)
I20260811 15:03:51.696442 27385 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.19.236.66@KRBTEST.COM'} at 127.19.236.66:56687
W20260811 15:03:51.811932 28628 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:03:51.812222 28628 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:03:51.812269 28628 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:03:51.816591 28628 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:03:51.816671 28628 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:03:51.816735 28628 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.67
I20260811 15:03:51.822388 28628 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:41993
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/krb5kdc/oryx_127.19.236.67.keytab
--principal=oryx/127.19.236.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.67:37021
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.236.67
--webserver_port=36755
--tserver_master_addrs=127.19.236.126:45445,127.19.236.125:40287,127.19.236.124:39963
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28628
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.67
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:03:51.823535 28628 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:03:51.824644 28628 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:03:51.835047 28635 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:51.835088 28638 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:51.835086 28636 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:51.835356 28628 server_base.cc:1034] running on GCE node
I20260811 15:03:51.835889 28628 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:03:51.836607 28628 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:03:51.837810 28628 hybrid_clock.cc:648] HybridClock initialized: now 1786460631837795 us; error 30 us; skew 500 ppm
Aug 11 15:03:51 dist-test-slave-8n49 krb5kdc[27335](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460631, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.236.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:03:51.841143 28628 init.cc:377] Logged in from keytab as oryx/127.19.236.67@KRBTEST.COM (short username oryx)
I20260811 15:03:51.842154 28628 webserver.cc:460] Webserver started at http://127.19.236.67:36755/ using document root <none> and password file <none>
I20260811 15:03:51.842757 28628 fs_manager.cc:359] Metadata directory not provided
I20260811 15:03:51.842859 28628 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:03:51.846922 28628 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 15:03:51.849123 28645 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:51.850528 28628 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 15:03:51.850682 28628 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-2/wal
uuid: "df8cbef0d8594cbaa3c9f32b33b38654"
format_stamp: "Formatted at 2026-08-11 15:03:50 on dist-test-slave-8n49"
server_key: "7b8940269838107d867fa5999038e7ad"
server_key_iv: "1dff5331fb2598c617c6b1e12dd27246"
server_key_version: "encryptionkey@0"
I20260811 15:03:51.851294 28628 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:03:51.889915 28628 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:03:51.894420 28628 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:03:51.894657 28628 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:03:51.895362 28628 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:03:51.896315 28628 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:03:51.896389 28628 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:51.896463 28628 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:03:51.896515 28628 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:51.905937 28628 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.67:37021
I20260811 15:03:51.905999 28770 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.67:37021 every 8 connection(s)
I20260811 15:03:51.907032 28628 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
I20260811 15:03:51.910092 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 28628
Aug 11 15:03:51 dist-test-slave-8n49 krb5kdc[27335](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460631, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.236.67@KRBTEST.COM for oryx/127.19.236.125@KRBTEST.COM
Aug 11 15:03:51 dist-test-slave-8n49 krb5kdc[27335](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460631, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.236.67@KRBTEST.COM for oryx/127.19.236.124@KRBTEST.COM
Aug 11 15:03:51 dist-test-slave-8n49 krb5kdc[27335](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460631, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.236.67@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM
I20260811 15:03:51.925889 28784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:51.912638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47014 (local address 127.19.236.124:39963)
0811 15:03:51.913313 (+ 675us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:51.913318 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:51.913690 (+ 372us) server_negotiation.cc:407] Connection header received
0811 15:03:51.913736 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:51.913740 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:51.913792 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:51.913878 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:51.916017 (+ 2139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.916800 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.917984 (+ 1184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.918327 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.918439 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:51.920321 (+ 1882us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:51.920325 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:51.920328 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:51.920356 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:51.923131 (+ 2775us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:51.923876 (+ 745us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:51.923880 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:51.923882 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:51.924007 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:51.924347 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:51.924352 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:51.924354 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:51.924643 (+ 289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:51.924779 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:51.925515 (+ 736us) server_negotiation.cc:299] Negotiation successful
0811 15:03:51.925659 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":597,"thread_start_us":96,"threads_started":1}
I20260811 15:03:51.926687 28199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:51.909073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.67:41831 (local address 127.19.236.125:40287)
0811 15:03:51.909243 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:51.909248 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:51.910400 (+ 1152us) server_negotiation.cc:407] Connection header received
0811 15:03:51.911816 (+ 1416us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:51.911819 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:51.911868 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:51.911977 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:51.913966 (+ 1989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.914783 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.916475 (+ 1692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.916852 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.916928 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:51.921564 (+ 4636us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:51.921571 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:51.921574 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:51.921609 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:51.923863 (+ 2254us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:51.924642 (+ 779us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:51.924649 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:51.924651 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:51.924743 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:51.925197 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:51.925203 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:51.925207 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:51.925453 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:51.925549 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:51.926374 (+ 825us) server_negotiation.cc:299] Negotiation successful
0811 15:03:51.926502 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 15:03:51.927563 28475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:51.909774 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.67:33477 (local address 127.19.236.124:39963)
0811 15:03:51.909908 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:51.909913 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:51.912224 (+ 2311us) server_negotiation.cc:407] Connection header received
0811 15:03:51.912363 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:51.912378 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:51.912433 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:51.912512 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:51.913947 (+ 1435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.914783 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.917202 (+ 2419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.917574 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.917660 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:51.921245 (+ 3585us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:51.921251 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:51.921254 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:51.921280 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:51.925074 (+ 3794us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:51.925563 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:51.925566 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:51.925567 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:51.925645 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:51.925933 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:51.925939 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:51.925943 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:51.926149 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:51.926237 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:51.927295 (+ 1058us) server_negotiation.cc:299] Negotiation successful
0811 15:03:51.927416 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 15:03:51.928458 28777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:51.909580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.125:40287 (local address 127.19.236.67:41831)
0811 15:03:51.910235 (+ 655us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:51.910295 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:51.911578 (+ 1283us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:51.912171 (+ 593us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:51.912178 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:51.912787 (+ 609us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:51.913796 (+ 1009us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:51.913803 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.914986 (+ 1183us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.914989 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:51.916342 (+ 1353us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:51.916353 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.917329 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.917333 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:51.917533 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:51.918235 (+ 702us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:03:51.918257 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:51.921391 (+ 3134us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:51.924029 (+ 2638us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:51.924038 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:51.924062 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:51.924482 (+ 420us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:51.924867 (+ 385us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:51.924870 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:51.924873 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:51.925081 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:51.925634 (+ 553us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:51.925642 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:51.926047 (+ 405us) client_negotiation.cc:769] Sending connection context
0811 15:03:51.926857 (+ 810us) client_negotiation.cc:240] Negotiation successful
0811 15:03:51.927294 (+ 437us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":407,"mutex_wait_us":230,"spinlock_wait_cycles":2304,"thread_start_us":131,"threads_started":1}
I20260811 15:03:51.928794 28778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:51.909580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.124:39963 (local address 127.19.236.67:33477)
0811 15:03:51.912117 (+ 2537us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:51.912131 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:51.912257 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:51.912662 (+ 405us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:51.912665 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:51.912869 (+ 204us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:51.913775 (+ 906us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:51.913797 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.914938 (+ 1141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.914940 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:51.916346 (+ 1406us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:51.916357 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.917832 (+ 1475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.917838 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:51.917959 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:51.919160 (+ 1201us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:03:51.919181 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:51.921042 (+ 1861us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:51.925189 (+ 4147us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:51.925193 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:51.925195 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:51.925444 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:51.925748 (+ 304us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:51.925751 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:51.925754 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:51.925832 (+ 78us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:51.926863 (+ 1031us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:51.926866 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:51.926977 (+ 111us) client_negotiation.cc:769] Sending connection context
0811 15:03:51.927079 (+ 102us) client_negotiation.cc:240] Negotiation successful
0811 15:03:51.928060 (+ 981us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2443,"mutex_wait_us":1381,"spinlock_wait_cycles":18688,"thread_start_us":149,"threads_started":1}
I20260811 15:03:51.929422 28776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:51.910678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:45445 (local address 127.19.236.67:51629)
0811 15:03:51.912171 (+ 1493us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:51.912186 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:51.912318 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:51.912783 (+ 465us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:51.912788 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:51.913014 (+ 226us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:51.913834 (+ 820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:51.913847 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.914839 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.914842 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:51.917046 (+ 2204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:51.917056 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.918810 (+ 1754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.918814 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:51.918918 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:51.919759 (+ 841us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:03:51.919775 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:51.921757 (+ 1982us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:51.926289 (+ 4532us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:51.926293 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:51.926296 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:51.926545 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:51.927766 (+ 1221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:51.927769 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:51.927771 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:51.927859 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:51.928376 (+ 517us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:51.928379 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:51.928469 (+ 90us) client_negotiation.cc:769] Sending connection context
0811 15:03:51.929086 (+ 617us) client_negotiation.cc:240] Negotiation successful
0811 15:03:51.929243 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1430,"mutex_wait_us":1320,"thread_start_us":98,"threads_started":1}
I20260811 15:03:51.929883 28771 heartbeater.cc:347] Connected to a master server at 127.19.236.124:39963
I20260811 15:03:51.930186 27431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:51.910817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.67:51629 (local address 127.19.236.126:45445)
0811 15:03:51.910949 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:51.910954 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:51.912257 (+ 1303us) server_negotiation.cc:407] Connection header received
0811 15:03:51.912472 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:51.912478 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:51.912535 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:51.912621 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:51.913988 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.914646 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.918202 (+ 3556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.918570 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.918646 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:51.921903 (+ 3257us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:51.921907 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:51.921909 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:51.921932 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:51.924248 (+ 2316us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:51.926663 (+ 2415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:51.926667 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:51.926668 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:51.926753 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:51.927998 (+ 1245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:51.928003 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:51.928008 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:51.928235 (+ 227us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:51.928331 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:51.929894 (+ 1563us) server_negotiation.cc:299] Negotiation successful
0811 15:03:51.930063 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":56}
I20260811 15:03:51.930183 28771 heartbeater.cc:464] Registering TS with master...
I20260811 15:03:51.930738 28786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:51.913585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43542 (local address 127.19.236.126:45445)
0811 15:03:51.914347 (+ 762us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:51.914351 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:51.916499 (+ 2148us) server_negotiation.cc:407] Connection header received
0811 15:03:51.916695 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:51.916698 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:51.916744 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:51.916800 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:51.917757 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.919521 (+ 1764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.921269 (+ 1748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.921661 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.921744 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:51.925035 (+ 3291us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:51.925039 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:51.925042 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:51.925067 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:51.926858 (+ 1791us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:51.929264 (+ 2406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:51.929268 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:51.929270 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:51.929365 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:51.929700 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:51.929704 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:51.929705 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:51.929939 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:51.930067 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:51.930442 (+ 375us) server_negotiation.cc:299] Negotiation successful
0811 15:03:51.930587 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":35,"server-negotiator.queue_time_us":690,"thread_start_us":96,"threads_started":1}
I20260811 15:03:51.930811 28771 heartbeater.cc:511] Master 127.19.236.124:39963 requested a full tablet report, sending...
I20260811 15:03:51.931126 28772 heartbeater.cc:347] Connected to a master server at 127.19.236.126:45445
I20260811 15:03:51.931247 28772 heartbeater.cc:464] Registering TS with master...
I20260811 15:03:51.931433 28774 heartbeater.cc:347] Connected to a master server at 127.19.236.125:40287
I20260811 15:03:51.931527 28774 heartbeater.cc:464] Registering TS with master...
I20260811 15:03:51.931439 28772 heartbeater.cc:511] Master 127.19.236.126:45445 requested a full tablet report, sending...
I20260811 15:03:51.931676 28774 heartbeater.cc:511] Master 127.19.236.125:40287 requested a full tablet report, sending...
I20260811 15:03:51.932359 27385 ts_manager.cc:194] Re-registered known tserver with Master: df8cbef0d8594cbaa3c9f32b33b38654 (127.19.236.67:37021)
I20260811 15:03:51.932490 28267 ts_manager.cc:194] Registered new tserver with Master: df8cbef0d8594cbaa3c9f32b33b38654 (127.19.236.67:37021)
I20260811 15:03:51.933092 28061 ts_manager.cc:194] Registered new tserver with Master: df8cbef0d8594cbaa3c9f32b33b38654 (127.19.236.67:37021)
I20260811 15:03:51.933396 27385 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.19.236.67@KRBTEST.COM'} at 127.19.236.67:51629
I20260811 15:03:51.934473 27385 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43542:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 15:03:51.938136 27385 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 15:03:51.941654 28794 sys_catalog.cc:455] T 00000000000000000000000000000000 P dfa4f7cc43ed43e1bb70ce239a69cd99 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "dfa4f7cc43ed43e1bb70ce239a69cd99" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "dfa4f7cc43ed43e1bb70ce239a69cd99" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 45445 } } peers { permanent_uuid: "a46978a611c144cdb5359f623cd44007" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 40287 } attrs { promote: false } } peers { permanent_uuid: "d6f7d38fca23431e8a90efc41b9d67d9" member_type: NON_VOTER last_known_addr { host: "127.19.236.124" port: 39963 } attrs { promote: true } } }
I20260811 15:03:51.942020 28794 sys_catalog.cc:458] T 00000000000000000000000000000000 P dfa4f7cc43ed43e1bb70ce239a69cd99 [sys.catalog]: This master's current role is: LEADER
I20260811 15:03:51.944227 28788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:51.915741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50848 (local address 127.19.236.125:40287)
0811 15:03:51.916259 (+ 518us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:51.916264 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:51.922887 (+ 6623us) server_negotiation.cc:407] Connection header received
0811 15:03:51.922937 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:51.922940 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:51.922994 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:51.923089 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:51.927356 (+ 4267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.928130 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.931392 (+ 3262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.933868 (+ 2476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.933950 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:51.938675 (+ 4725us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:51.938678 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:51.938680 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:51.938707 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:51.940521 (+ 1814us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:51.941088 (+ 567us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:51.941095 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:51.941100 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:51.941211 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:51.941531 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:51.941534 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:51.941535 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:51.941781 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:51.943856 (+ 2075us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:51.943943 (+ 87us) server_negotiation.cc:299] Negotiation successful
0811 15:03:51.944086 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":445,"thread_start_us":95,"threads_started":1}
I20260811 15:03:51.945699 28794 raft_consensus.cc:1050] T 00000000000000000000000000000000 P dfa4f7cc43ed43e1bb70ce239a69cd99: attempting to promote NON_VOTER d6f7d38fca23431e8a90efc41b9d67d9 to VOTER
I20260811 15:03:51.946061 28794 consensus_queue.cc:237] T 00000000000000000000000000000000 P dfa4f7cc43ed43e1bb70ce239a69cd99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "dfa4f7cc43ed43e1bb70ce239a69cd99" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 45445 } } peers { permanent_uuid: "a46978a611c144cdb5359f623cd44007" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 40287 } attrs { promote: false } } peers { permanent_uuid: "d6f7d38fca23431e8a90efc41b9d67d9" member_type: VOTER last_known_addr { host: "127.19.236.124" port: 39963 } attrs { promote: false } }
I20260811 15:03:51.947220 28072 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a46978a611c144cdb5359f623cd44007 [term 1 FOLLOWER]: Refusing update from remote peer dfa4f7cc43ed43e1bb70ce239a69cd99: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260811 15:03:51.947436 28280 raft_consensus.cc:1261] T 00000000000000000000000000000000 P d6f7d38fca23431e8a90efc41b9d67d9 [term 1 LEARNER]: Refusing update from remote peer dfa4f7cc43ed43e1bb70ce239a69cd99: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260811 15:03:51.947682 28792 consensus_queue.cc:1035] T 00000000000000000000000000000000 P dfa4f7cc43ed43e1bb70ce239a69cd99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46978a611c144cdb5359f623cd44007" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 40287 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260811 15:03:51.947806 28015 consensus_queue.cc:1035] T 00000000000000000000000000000000 P dfa4f7cc43ed43e1bb70ce239a69cd99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6f7d38fca23431e8a90efc41b9d67d9" member_type: VOTER last_known_addr { host: "127.19.236.124" port: 39963 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260811 15:03:51.949925 28015 raft_consensus.cc:2932] T 00000000000000000000000000000000 P dfa4f7cc43ed43e1bb70ce239a69cd99 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 7 to 9, d6f7d38fca23431e8a90efc41b9d67d9 (127.19.236.124) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "dfa4f7cc43ed43e1bb70ce239a69cd99" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 45445 } } peers { permanent_uuid: "a46978a611c144cdb5359f623cd44007" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 40287 } attrs { promote: false } } peers { permanent_uuid: "d6f7d38fca23431e8a90efc41b9d67d9" member_type: VOTER last_known_addr { host: "127.19.236.124" port: 39963 } attrs { promote: false } } }
I20260811 15:03:51.950480 28280 raft_consensus.cc:2932] T 00000000000000000000000000000000 P d6f7d38fca23431e8a90efc41b9d67d9 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, d6f7d38fca23431e8a90efc41b9d67d9 (127.19.236.124) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "dfa4f7cc43ed43e1bb70ce239a69cd99" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 45445 } } peers { permanent_uuid: "a46978a611c144cdb5359f623cd44007" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 40287 } attrs { promote: false } } peers { permanent_uuid: "d6f7d38fca23431e8a90efc41b9d67d9" member_type: VOTER last_known_addr { host: "127.19.236.124" port: 39963 } attrs { promote: false } } }
I20260811 15:03:51.950668 28072 raft_consensus.cc:2932] T 00000000000000000000000000000000 P a46978a611c144cdb5359f623cd44007 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, d6f7d38fca23431e8a90efc41b9d67d9 (127.19.236.124) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "dfa4f7cc43ed43e1bb70ce239a69cd99" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 45445 } } peers { permanent_uuid: "a46978a611c144cdb5359f623cd44007" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 40287 } attrs { promote: false } } peers { permanent_uuid: "d6f7d38fca23431e8a90efc41b9d67d9" member_type: VOTER last_known_addr { host: "127.19.236.124" port: 39963 } attrs { promote: false } } }
I20260811 15:03:51.951558 28015 sys_catalog.cc:455] T 00000000000000000000000000000000 P dfa4f7cc43ed43e1bb70ce239a69cd99 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "dfa4f7cc43ed43e1bb70ce239a69cd99" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "dfa4f7cc43ed43e1bb70ce239a69cd99" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 45445 } } peers { permanent_uuid: "a46978a611c144cdb5359f623cd44007" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 40287 } attrs { promote: false } } peers { permanent_uuid: "d6f7d38fca23431e8a90efc41b9d67d9" member_type: VOTER last_known_addr { host: "127.19.236.124" port: 39963 } attrs { promote: false } } }
I20260811 15:03:51.951666 28015 sys_catalog.cc:458] T 00000000000000000000000000000000 P dfa4f7cc43ed43e1bb70ce239a69cd99 [sys.catalog]: This master's current role is: LEADER
I20260811 15:03:51.951632 28794 sys_catalog.cc:455] T 00000000000000000000000000000000 P dfa4f7cc43ed43e1bb70ce239a69cd99 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "dfa4f7cc43ed43e1bb70ce239a69cd99" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "dfa4f7cc43ed43e1bb70ce239a69cd99" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 45445 } } peers { permanent_uuid: "a46978a611c144cdb5359f623cd44007" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 40287 } attrs { promote: false } } peers { permanent_uuid: "d6f7d38fca23431e8a90efc41b9d67d9" member_type: VOTER last_known_addr { host: "127.19.236.124" port: 39963 } attrs { promote: false } } }
I20260811 15:03:51.951738 28794 sys_catalog.cc:458] T 00000000000000000000000000000000 P dfa4f7cc43ed43e1bb70ce239a69cd99 [sys.catalog]: This master's current role is: LEADER
I20260811 15:03:51.951785 28015 sys_catalog.cc:455] T 00000000000000000000000000000000 P dfa4f7cc43ed43e1bb70ce239a69cd99 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "dfa4f7cc43ed43e1bb70ce239a69cd99" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "dfa4f7cc43ed43e1bb70ce239a69cd99" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 45445 } } peers { permanent_uuid: "a46978a611c144cdb5359f623cd44007" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 40287 } attrs { promote: false } } peers { permanent_uuid: "d6f7d38fca23431e8a90efc41b9d67d9" member_type: VOTER last_known_addr { host: "127.19.236.124" port: 39963 } attrs { promote: false } } }
I20260811 15:03:51.951869 28015 sys_catalog.cc:458] T 00000000000000000000000000000000 P dfa4f7cc43ed43e1bb70ce239a69cd99 [sys.catalog]: This master's current role is: LEADER
I20260811 15:03:51.952647 28316 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6f7d38fca23431e8a90efc41b9d67d9 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "dfa4f7cc43ed43e1bb70ce239a69cd99" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "dfa4f7cc43ed43e1bb70ce239a69cd99" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 45445 } } peers { permanent_uuid: "a46978a611c144cdb5359f623cd44007" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 40287 } attrs { promote: false } } peers { permanent_uuid: "d6f7d38fca23431e8a90efc41b9d67d9" member_type: VOTER last_known_addr { host: "127.19.236.124" port: 39963 } attrs { promote: false } } }
I20260811 15:03:51.952768 28316 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6f7d38fca23431e8a90efc41b9d67d9 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 15:03:51.952888 28803 sys_catalog.cc:455] T 00000000000000000000000000000000 P a46978a611c144cdb5359f623cd44007 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "dfa4f7cc43ed43e1bb70ce239a69cd99" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "dfa4f7cc43ed43e1bb70ce239a69cd99" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 45445 } } peers { permanent_uuid: "a46978a611c144cdb5359f623cd44007" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 40287 } attrs { promote: false } } peers { permanent_uuid: "d6f7d38fca23431e8a90efc41b9d67d9" member_type: VOTER last_known_addr { host: "127.19.236.124" port: 39963 } attrs { promote: false } } }
I20260811 15:03:51.953068 28803 sys_catalog.cc:458] T 00000000000000000000000000000000 P a46978a611c144cdb5359f623cd44007 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 15:03:51.961998 28011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:51.955650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.67:37021 (local address 127.0.0.1:49300)
0811 15:03:51.955810 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:51.955826 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:51.955909 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:51.958057 (+ 2148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:51.958060 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:51.958078 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:03:51.958159 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:51.958164 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.959505 (+ 1341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.959509 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:51.960740 (+ 1231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:51.960751 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.961582 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.961586 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:51.961672 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:51.961696 (+ 24us) client_negotiation.cc:769] Sending connection context
0811 15:03:51.961757 (+ 61us) client_negotiation.cc:240] Negotiation successful
0811 15:03:51.961832 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":84,"mutex_wait_us":45}
I20260811 15:03:51.962317 28806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:51.956268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49300 (local address 127.19.236.67:37021)
0811 15:03:51.957605 (+ 1337us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:51.957617 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:51.957641 (+ 24us) server_negotiation.cc:407] Connection header received
0811 15:03:51.957723 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:51.957727 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:51.957924 (+ 197us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:51.958085 (+ 161us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:03:51.958272 (+ 187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.959369 (+ 1097us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.960885 (+ 1516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.961449 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.961572 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:51.961753 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:51.961807 (+ 54us) server_negotiation.cc:299] Negotiation successful
0811 15:03:51.961899 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1235,"thread_start_us":136,"threads_started":1}
I20260811 15:03:51.962411 28804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:51.956423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.65:32827 (local address 127.0.0.1:44964)
0811 15:03:51.957121 (+ 698us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:51.957133 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:51.957212 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:51.957874 (+ 662us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:51.957877 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:51.957894 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:03:51.958008 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:51.958017 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.959433 (+ 1416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.959437 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:51.960749 (+ 1312us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:51.960755 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.961917 (+ 1162us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.961921 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:51.962075 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:51.962102 (+ 27us) client_negotiation.cc:769] Sending connection context
0811 15:03:51.962182 (+ 80us) client_negotiation.cc:240] Negotiation successful
0811 15:03:51.962250 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":635,"mutex_wait_us":165,"thread_start_us":132,"threads_started":1}
I20260811 15:03:51.962600 28807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:51.955981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.66:36551 (local address 127.0.0.1:57300)
0811 15:03:51.956803 (+ 822us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:51.956816 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:51.956923 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:51.957506 (+ 583us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:51.957509 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:51.957528 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:03:51.957658 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:51.957665 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.959033 (+ 1368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.959037 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:51.960586 (+ 1549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:51.960599 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.961917 (+ 1318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.961921 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:51.962297 (+ 376us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:51.962320 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 15:03:51.962387 (+ 67us) client_negotiation.cc:240] Negotiation successful
0811 15:03:51.962461 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":750,"mutex_wait_us":178,"thread_start_us":156,"threads_started":1}
I20260811 15:03:51.962821 28808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:51.956858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44964 (local address 127.19.236.65:32827)
0811 15:03:51.957297 (+ 439us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:51.957315 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:51.957337 (+ 22us) server_negotiation.cc:407] Connection header received
0811 15:03:51.957466 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:51.957474 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:51.957721 (+ 247us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:51.957870 (+ 149us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:03:51.958144 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.959305 (+ 1161us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.960867 (+ 1562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.961601 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.961708 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:51.961848 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:51.962585 (+ 737us) server_negotiation.cc:299] Negotiation successful
0811 15:03:51.962696 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":354,"thread_start_us":140,"threads_started":1}
I20260811 15:03:51.963004 28805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:51.956158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57300 (local address 127.19.236.66:36551)
0811 15:03:51.956535 (+ 377us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:51.956575 (+ 40us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:51.956922 (+ 347us) server_negotiation.cc:407] Connection header received
0811 15:03:51.957056 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:51.957063 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:51.957318 (+ 255us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:51.957827 (+ 509us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:03:51.957967 (+ 140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.958911 (+ 944us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.960722 (+ 1811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:51.961595 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:51.961708 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:51.961847 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:51.962751 (+ 904us) server_negotiation.cc:299] Negotiation successful
0811 15:03:51.962856 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":232,"thread_start_us":102,"threads_started":1}
I20260811 15:03:51.965675 28550 tablet_service.cc:1467] Processing CreateTablet for tablet c0cd431175d946ad873aa518a7c02f95 (DEFAULT_TABLE table=test-table [id=4970f5f0a6f44488b391d9eabc8f372c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:03:51.965729 28698 tablet_service.cc:1467] Processing CreateTablet for tablet c0cd431175d946ad873aa518a7c02f95 (DEFAULT_TABLE table=test-table [id=4970f5f0a6f44488b391d9eabc8f372c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:03:51.965783 28395 tablet_service.cc:1467] Processing CreateTablet for tablet c0cd431175d946ad873aa518a7c02f95 (DEFAULT_TABLE table=test-table [id=4970f5f0a6f44488b391d9eabc8f372c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:03:51.966727 28550 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c0cd431175d946ad873aa518a7c02f95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:03:51.966755 28698 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c0cd431175d946ad873aa518a7c02f95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:03:51.966755 28395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c0cd431175d946ad873aa518a7c02f95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:03:51.976723 28811 tablet_bootstrap.cc:492] T c0cd431175d946ad873aa518a7c02f95 P 55302221fdca40ec9f7bf6d725c0da72: Bootstrap starting.
I20260811 15:03:51.978003 28810 tablet_bootstrap.cc:492] T c0cd431175d946ad873aa518a7c02f95 P df8cbef0d8594cbaa3c9f32b33b38654: Bootstrap starting.
I20260811 15:03:51.979115 28811 tablet_bootstrap.cc:654] T c0cd431175d946ad873aa518a7c02f95 P 55302221fdca40ec9f7bf6d725c0da72: Neither blocks nor log segments found. Creating new log.
I20260811 15:03:51.979828 28810 tablet_bootstrap.cc:654] T c0cd431175d946ad873aa518a7c02f95 P df8cbef0d8594cbaa3c9f32b33b38654: Neither blocks nor log segments found. Creating new log.
I20260811 15:03:51.979988 28811 log.cc:824] T c0cd431175d946ad873aa518a7c02f95 P 55302221fdca40ec9f7bf6d725c0da72: Log is configured to *not* fsync() on all Append() calls
I20260811 15:03:51.980718 28810 log.cc:824] T c0cd431175d946ad873aa518a7c02f95 P df8cbef0d8594cbaa3c9f32b33b38654: Log is configured to *not* fsync() on all Append() calls
I20260811 15:03:51.981482 28809 tablet_bootstrap.cc:492] T c0cd431175d946ad873aa518a7c02f95 P f6c63cee7b22430ea73e77d9429091a3: Bootstrap starting.
I20260811 15:03:51.982316 28811 tablet_bootstrap.cc:492] T c0cd431175d946ad873aa518a7c02f95 P 55302221fdca40ec9f7bf6d725c0da72: No bootstrap required, opened a new log
I20260811 15:03:51.982542 28811 ts_tablet_manager.cc:1397] T c0cd431175d946ad873aa518a7c02f95 P 55302221fdca40ec9f7bf6d725c0da72: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260811 15:03:51.983724 28809 tablet_bootstrap.cc:654] T c0cd431175d946ad873aa518a7c02f95 P f6c63cee7b22430ea73e77d9429091a3: Neither blocks nor log segments found. Creating new log.
I20260811 15:03:51.984611 28809 log.cc:824] T c0cd431175d946ad873aa518a7c02f95 P f6c63cee7b22430ea73e77d9429091a3: Log is configured to *not* fsync() on all Append() calls
I20260811 15:03:51.986112 28810 tablet_bootstrap.cc:492] T c0cd431175d946ad873aa518a7c02f95 P df8cbef0d8594cbaa3c9f32b33b38654: No bootstrap required, opened a new log
I20260811 15:03:51.986325 28810 ts_tablet_manager.cc:1397] T c0cd431175d946ad873aa518a7c02f95 P df8cbef0d8594cbaa3c9f32b33b38654: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.003s
I20260811 15:03:51.986865 28809 tablet_bootstrap.cc:492] T c0cd431175d946ad873aa518a7c02f95 P f6c63cee7b22430ea73e77d9429091a3: No bootstrap required, opened a new log
I20260811 15:03:51.986827 28811 raft_consensus.cc:348] T c0cd431175d946ad873aa518a7c02f95 P 55302221fdca40ec9f7bf6d725c0da72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8cbef0d8594cbaa3c9f32b33b38654" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37021 } } peers { permanent_uuid: "f6c63cee7b22430ea73e77d9429091a3" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 36551 } } peers { permanent_uuid: "55302221fdca40ec9f7bf6d725c0da72" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 32827 } }
I20260811 15:03:51.987076 28809 ts_tablet_manager.cc:1397] T c0cd431175d946ad873aa518a7c02f95 P f6c63cee7b22430ea73e77d9429091a3: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260811 15:03:51.987160 28811 raft_consensus.cc:374] T c0cd431175d946ad873aa518a7c02f95 P 55302221fdca40ec9f7bf6d725c0da72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:03:51.987219 28811 raft_consensus.cc:729] T c0cd431175d946ad873aa518a7c02f95 P 55302221fdca40ec9f7bf6d725c0da72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55302221fdca40ec9f7bf6d725c0da72, State: Initialized, Role: FOLLOWER
I20260811 15:03:51.987699 28811 consensus_queue.cc:260] T c0cd431175d946ad873aa518a7c02f95 P 55302221fdca40ec9f7bf6d725c0da72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8cbef0d8594cbaa3c9f32b33b38654" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37021 } } peers { permanent_uuid: "f6c63cee7b22430ea73e77d9429091a3" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 36551 } } peers { permanent_uuid: "55302221fdca40ec9f7bf6d725c0da72" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 32827 } }
I20260811 15:03:51.988778 28811 ts_tablet_manager.cc:1428] T c0cd431175d946ad873aa518a7c02f95 P 55302221fdca40ec9f7bf6d725c0da72: Time spent starting tablet: real 0.006s user 0.008s sys 0.000s
I20260811 15:03:51.989032 28472 heartbeater.cc:503] Master 127.19.236.126:45445 was elected leader, sending a full tablet report...
I20260811 15:03:51.991614 28810 raft_consensus.cc:348] T c0cd431175d946ad873aa518a7c02f95 P df8cbef0d8594cbaa3c9f32b33b38654 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8cbef0d8594cbaa3c9f32b33b38654" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37021 } } peers { permanent_uuid: "f6c63cee7b22430ea73e77d9429091a3" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 36551 } } peers { permanent_uuid: "55302221fdca40ec9f7bf6d725c0da72" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 32827 } }
I20260811 15:03:51.991909 28810 raft_consensus.cc:374] T c0cd431175d946ad873aa518a7c02f95 P df8cbef0d8594cbaa3c9f32b33b38654 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:03:51.991966 28810 raft_consensus.cc:729] T c0cd431175d946ad873aa518a7c02f95 P df8cbef0d8594cbaa3c9f32b33b38654 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df8cbef0d8594cbaa3c9f32b33b38654, State: Initialized, Role: FOLLOWER
I20260811 15:03:51.992230 28809 raft_consensus.cc:348] T c0cd431175d946ad873aa518a7c02f95 P f6c63cee7b22430ea73e77d9429091a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8cbef0d8594cbaa3c9f32b33b38654" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37021 } } peers { permanent_uuid: "f6c63cee7b22430ea73e77d9429091a3" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 36551 } } peers { permanent_uuid: "55302221fdca40ec9f7bf6d725c0da72" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 32827 } }
I20260811 15:03:51.992498 28809 raft_consensus.cc:374] T c0cd431175d946ad873aa518a7c02f95 P f6c63cee7b22430ea73e77d9429091a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:03:51.992587 28809 raft_consensus.cc:729] T c0cd431175d946ad873aa518a7c02f95 P f6c63cee7b22430ea73e77d9429091a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c63cee7b22430ea73e77d9429091a3, State: Initialized, Role: FOLLOWER
I20260811 15:03:51.992507 28810 consensus_queue.cc:260] T c0cd431175d946ad873aa518a7c02f95 P df8cbef0d8594cbaa3c9f32b33b38654 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8cbef0d8594cbaa3c9f32b33b38654" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37021 } } peers { permanent_uuid: "f6c63cee7b22430ea73e77d9429091a3" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 36551 } } peers { permanent_uuid: "55302221fdca40ec9f7bf6d725c0da72" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 32827 } }
I20260811 15:03:51.993062 28809 consensus_queue.cc:260] T c0cd431175d946ad873aa518a7c02f95 P f6c63cee7b22430ea73e77d9429091a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8cbef0d8594cbaa3c9f32b33b38654" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37021 } } peers { permanent_uuid: "f6c63cee7b22430ea73e77d9429091a3" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 36551 } } peers { permanent_uuid: "55302221fdca40ec9f7bf6d725c0da72" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 32827 } }
I20260811 15:03:51.993649 28810 ts_tablet_manager.cc:1428] T c0cd431175d946ad873aa518a7c02f95 P df8cbef0d8594cbaa3c9f32b33b38654: Time spent starting tablet: real 0.007s user 0.007s sys 0.001s
I20260811 15:03:51.994042 28809 ts_tablet_manager.cc:1428] T c0cd431175d946ad873aa518a7c02f95 P f6c63cee7b22430ea73e77d9429091a3: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260811 15:03:51.995174 28772 heartbeater.cc:503] Master 127.19.236.126:45445 was elected leader, sending a full tablet report...
I20260811 15:03:51.995177 28621 heartbeater.cc:503] Master 127.19.236.126:45445 was elected leader, sending a full tablet report...
W20260811 15:03:52.159003 28775 tablet.cc:2369] T c0cd431175d946ad873aa518a7c02f95 P df8cbef0d8594cbaa3c9f32b33b38654: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 15:03:52.170799 28623 tablet.cc:2369] T c0cd431175d946ad873aa518a7c02f95 P f6c63cee7b22430ea73e77d9429091a3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 15:03:52.186877 28817 raft_consensus.cc:482] T c0cd431175d946ad873aa518a7c02f95 P df8cbef0d8594cbaa3c9f32b33b38654 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 15:03:52.187137 28817 raft_consensus.cc:504] T c0cd431175d946ad873aa518a7c02f95 P df8cbef0d8594cbaa3c9f32b33b38654 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8cbef0d8594cbaa3c9f32b33b38654" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37021 } } peers { permanent_uuid: "f6c63cee7b22430ea73e77d9429091a3" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 36551 } } peers { permanent_uuid: "55302221fdca40ec9f7bf6d725c0da72" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 32827 } }
W20260811 15:03:52.187623 28474 tablet.cc:2369] T c0cd431175d946ad873aa518a7c02f95 P 55302221fdca40ec9f7bf6d725c0da72: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 15:03:52.188644 28817 leader_election.cc:288] T c0cd431175d946ad873aa518a7c02f95 P df8cbef0d8594cbaa3c9f32b33b38654 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f6c63cee7b22430ea73e77d9429091a3 (127.19.236.66:36551), 55302221fdca40ec9f7bf6d725c0da72 (127.19.236.65:32827)
I20260811 15:03:52.192410 28808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:52.189029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.67:54117 (local address 127.19.236.65:32827)
0811 15:03:52.189156 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:52.189161 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:52.189178 (+ 17us) server_negotiation.cc:407] Connection header received
0811 15:03:52.189344 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:52.189349 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:52.189395 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:52.189479 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:03:52.189753 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:52.190364 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:52.191408 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:52.191794 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:52.191922 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:52.191977 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:52.192198 (+ 221us) server_negotiation.cc:299] Negotiation successful
0811 15:03:52.192266 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 15:03:52.192428 28777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:52.188931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.65:32827 (local address 127.19.236.67:54117)
0811 15:03:52.189089 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:52.189106 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:52.189220 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:52.189491 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:52.189493 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:52.189509 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:03:52.189645 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:52.189650 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:52.190479 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:52.190484 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:52.191280 (+ 796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:52.191289 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:52.191918 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:52.191921 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:52.192052 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:52.192091 (+ 39us) client_negotiation.cc:769] Sending connection context
0811 15:03:52.192180 (+ 89us) client_negotiation.cc:240] Negotiation successful
0811 15:03:52.192256 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":61,"mutex_wait_us":23}
I20260811 15:03:52.192596 28778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:52.188934 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.66:36551 (local address 127.19.236.67:56101)
0811 15:03:52.189202 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:52.189213 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:52.189321 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:52.189598 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:52.189601 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:52.189617 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:03:52.189742 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:52.189747 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:52.190593 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:52.190598 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:52.191339 (+ 741us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:52.191347 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:52.192017 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:52.192021 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:52.192178 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:52.192196 (+ 18us) client_negotiation.cc:769] Sending connection context
0811 15:03:52.192283 (+ 87us) client_negotiation.cc:240] Negotiation successful
0811 15:03:52.192353 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":197,"mutex_wait_us":151}
I20260811 15:03:52.193699 28805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:52.188996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.67:56101 (local address 127.19.236.66:36551)
0811 15:03:52.189126 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:52.189132 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:52.189281 (+ 149us) server_negotiation.cc:407] Connection header received
0811 15:03:52.189433 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:52.189436 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:52.189494 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:52.189575 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:03:52.189850 (+ 275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:52.190480 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:52.191473 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:52.191868 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:52.192017 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:52.192077 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:52.192301 (+ 224us) server_negotiation.cc:299] Negotiation successful
0811 15:03:52.192382 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 15:03:52.193616 28418 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c0cd431175d946ad873aa518a7c02f95" candidate_uuid: "df8cbef0d8594cbaa3c9f32b33b38654" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55302221fdca40ec9f7bf6d725c0da72" is_pre_election: true
I20260811 15:03:52.193979 28418 raft_consensus.cc:2454] T c0cd431175d946ad873aa518a7c02f95 P 55302221fdca40ec9f7bf6d725c0da72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df8cbef0d8594cbaa3c9f32b33b38654 in term 0.
I20260811 15:03:52.194322 28570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c0cd431175d946ad873aa518a7c02f95" candidate_uuid: "df8cbef0d8594cbaa3c9f32b33b38654" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c63cee7b22430ea73e77d9429091a3" is_pre_election: true
I20260811 15:03:52.194463 28649 leader_election.cc:302] T c0cd431175d946ad873aa518a7c02f95 P df8cbef0d8594cbaa3c9f32b33b38654 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55302221fdca40ec9f7bf6d725c0da72, df8cbef0d8594cbaa3c9f32b33b38654; no voters:
I20260811 15:03:52.194644 28570 raft_consensus.cc:2454] T c0cd431175d946ad873aa518a7c02f95 P f6c63cee7b22430ea73e77d9429091a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df8cbef0d8594cbaa3c9f32b33b38654 in term 0.
I20260811 15:03:52.194798 28817 raft_consensus.cc:2781] T c0cd431175d946ad873aa518a7c02f95 P df8cbef0d8594cbaa3c9f32b33b38654 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 15:03:52.194936 28817 raft_consensus.cc:482] T c0cd431175d946ad873aa518a7c02f95 P df8cbef0d8594cbaa3c9f32b33b38654 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 15:03:52.195009 28817 raft_consensus.cc:3037] T c0cd431175d946ad873aa518a7c02f95 P df8cbef0d8594cbaa3c9f32b33b38654 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:03:52.196187 28817 raft_consensus.cc:504] T c0cd431175d946ad873aa518a7c02f95 P df8cbef0d8594cbaa3c9f32b33b38654 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8cbef0d8594cbaa3c9f32b33b38654" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37021 } } peers { permanent_uuid: "f6c63cee7b22430ea73e77d9429091a3" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 36551 } } peers { permanent_uuid: "55302221fdca40ec9f7bf6d725c0da72" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 32827 } }
I20260811 15:03:52.196589 28817 leader_election.cc:288] T c0cd431175d946ad873aa518a7c02f95 P df8cbef0d8594cbaa3c9f32b33b38654 [CANDIDATE]: Term 1 election: Requested vote from peers f6c63cee7b22430ea73e77d9429091a3 (127.19.236.66:36551), 55302221fdca40ec9f7bf6d725c0da72 (127.19.236.65:32827)
I20260811 15:03:52.196980 28570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c0cd431175d946ad873aa518a7c02f95" candidate_uuid: "df8cbef0d8594cbaa3c9f32b33b38654" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6c63cee7b22430ea73e77d9429091a3"
I20260811 15:03:52.197100 28418 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c0cd431175d946ad873aa518a7c02f95" candidate_uuid: "df8cbef0d8594cbaa3c9f32b33b38654" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55302221fdca40ec9f7bf6d725c0da72"
I20260811 15:03:52.197132 28570 raft_consensus.cc:3037] T c0cd431175d946ad873aa518a7c02f95 P f6c63cee7b22430ea73e77d9429091a3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:03:52.197228 28418 raft_consensus.cc:3037] T c0cd431175d946ad873aa518a7c02f95 P 55302221fdca40ec9f7bf6d725c0da72 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:03:52.198451 28418 raft_consensus.cc:2454] T c0cd431175d946ad873aa518a7c02f95 P 55302221fdca40ec9f7bf6d725c0da72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df8cbef0d8594cbaa3c9f32b33b38654 in term 1.
I20260811 15:03:52.198451 28570 raft_consensus.cc:2454] T c0cd431175d946ad873aa518a7c02f95 P f6c63cee7b22430ea73e77d9429091a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df8cbef0d8594cbaa3c9f32b33b38654 in term 1.
I20260811 15:03:52.198760 28647 leader_election.cc:302] T c0cd431175d946ad873aa518a7c02f95 P df8cbef0d8594cbaa3c9f32b33b38654 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: df8cbef0d8594cbaa3c9f32b33b38654, f6c63cee7b22430ea73e77d9429091a3; no voters:
I20260811 15:03:52.198953 28817 raft_consensus.cc:2781] T c0cd431175d946ad873aa518a7c02f95 P df8cbef0d8594cbaa3c9f32b33b38654 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:03:52.199198 28817 raft_consensus.cc:686] T c0cd431175d946ad873aa518a7c02f95 P df8cbef0d8594cbaa3c9f32b33b38654 [term 1 LEADER]: Becoming Leader. State: Replica: df8cbef0d8594cbaa3c9f32b33b38654, State: Running, Role: LEADER
I20260811 15:03:52.199571 28817 consensus_queue.cc:237] T c0cd431175d946ad873aa518a7c02f95 P df8cbef0d8594cbaa3c9f32b33b38654 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8cbef0d8594cbaa3c9f32b33b38654" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37021 } } peers { permanent_uuid: "f6c63cee7b22430ea73e77d9429091a3" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 36551 } } peers { permanent_uuid: "55302221fdca40ec9f7bf6d725c0da72" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 32827 } }
I20260811 15:03:52.203125 27384 catalog_manager.cc:5495] T c0cd431175d946ad873aa518a7c02f95 P df8cbef0d8594cbaa3c9f32b33b38654 reported cstate change: term changed from 0 to 1, leader changed from <none> to df8cbef0d8594cbaa3c9f32b33b38654 (127.19.236.67). New cstate: current_term: 1 leader_uuid: "df8cbef0d8594cbaa3c9f32b33b38654" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8cbef0d8594cbaa3c9f32b33b38654" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37021 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6c63cee7b22430ea73e77d9429091a3" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 36551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55302221fdca40ec9f7bf6d725c0da72" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 32827 } health_report { overall_health: UNKNOWN } } }
I20260811 15:03:52.263969 28806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:52.259890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49308 (local address 127.19.236.67:37021)
0811 15:03:52.260053 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:52.260057 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:52.260099 (+ 42us) server_negotiation.cc:407] Connection header received
0811 15:03:52.260403 (+ 304us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:52.260407 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:52.260483 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:52.260681 (+ 198us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 15:03:52.261061 (+ 380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:52.261591 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:52.262444 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:52.262655 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:52.262734 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:52.263122 (+ 388us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 15:03:52.263582 (+ 460us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 15:03:52.263684 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:52.263771 (+ 87us) server_negotiation.cc:299] Negotiation successful
0811 15:03:52.263826 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 15:03:52.270614 28418 raft_consensus.cc:1261] T c0cd431175d946ad873aa518a7c02f95 P 55302221fdca40ec9f7bf6d725c0da72 [term 1 FOLLOWER]: Refusing update from remote peer df8cbef0d8594cbaa3c9f32b33b38654: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:03:52.270643 28570 raft_consensus.cc:1261] T c0cd431175d946ad873aa518a7c02f95 P f6c63cee7b22430ea73e77d9429091a3 [term 1 FOLLOWER]: Refusing update from remote peer df8cbef0d8594cbaa3c9f32b33b38654: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:03:52.271363 28819 consensus_queue.cc:1035] T c0cd431175d946ad873aa518a7c02f95 P df8cbef0d8594cbaa3c9f32b33b38654 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6c63cee7b22430ea73e77d9429091a3" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 36551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:03:52.271582 28817 consensus_queue.cc:1035] T c0cd431175d946ad873aa518a7c02f95 P df8cbef0d8594cbaa3c9f32b33b38654 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55302221fdca40ec9f7bf6d725c0da72" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 32827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:03:52.280469 28822 mvcc.cc:205] Tried to move back new op lower bound from 7317342749771747328 to 7317342749492056064. Current Snapshot: MvccSnapshot[applied={T|T < 7317342749771747328}]
I20260811 15:03:52.284101 28823 mvcc.cc:205] Tried to move back new op lower bound from 7317342749771747328 to 7317342749492056064. Current Snapshot: MvccSnapshot[applied={T|T < 7317342749771747328}]
I20260811 15:03:52.286096 28824 mvcc.cc:205] Tried to move back new op lower bound from 7317342749771747328 to 7317342749492056064. Current Snapshot: MvccSnapshot[applied={T|T < 7317342749771747328}]
I20260811 15:03:52.289925 27384 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43542:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 15:03:52.290071 27384 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43542:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 15:03:52.295958 27384 catalog_manager.cc:5782] T 00000000000000000000000000000000 P dfa4f7cc43ed43e1bb70ce239a69cd99: Sending DeleteTablet for 3 replicas of tablet c0cd431175d946ad873aa518a7c02f95
I20260811 15:03:52.296883 28550 tablet_service.cc:1514] Processing DeleteTablet for tablet c0cd431175d946ad873aa518a7c02f95 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:03:52 UTC) from {username='oryx', principal='oryx/127.19.236.126@KRBTEST.COM'} at 127.0.0.1:57300
I20260811 15:03:52.296878 28395 tablet_service.cc:1514] Processing DeleteTablet for tablet c0cd431175d946ad873aa518a7c02f95 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:03:52 UTC) from {username='oryx', principal='oryx/127.19.236.126@KRBTEST.COM'} at 127.0.0.1:44964
I20260811 15:03:52.297464 28835 tablet_replica.cc:330] T c0cd431175d946ad873aa518a7c02f95 P 55302221fdca40ec9f7bf6d725c0da72: stopping tablet replica
I20260811 15:03:52.297567 28834 tablet_replica.cc:330] T c0cd431175d946ad873aa518a7c02f95 P f6c63cee7b22430ea73e77d9429091a3: stopping tablet replica
I20260811 15:03:52.297823 28835 raft_consensus.cc:2229] T c0cd431175d946ad873aa518a7c02f95 P 55302221fdca40ec9f7bf6d725c0da72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 15:03:52.297823 28834 raft_consensus.cc:2229] T c0cd431175d946ad873aa518a7c02f95 P f6c63cee7b22430ea73e77d9429091a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 15:03:52.298084 28834 raft_consensus.cc:2258] T c0cd431175d946ad873aa518a7c02f95 P f6c63cee7b22430ea73e77d9429091a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:03:52.298149 28835 raft_consensus.cc:2258] T c0cd431175d946ad873aa518a7c02f95 P 55302221fdca40ec9f7bf6d725c0da72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:03:52.299938 28698 tablet_service.cc:1514] Processing DeleteTablet for tablet c0cd431175d946ad873aa518a7c02f95 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:03:52 UTC) from {username='oryx', principal='oryx/127.19.236.126@KRBTEST.COM'} at 127.0.0.1:49300
I20260811 15:03:52.300102 28835 ts_tablet_manager.cc:1905] T c0cd431175d946ad873aa518a7c02f95 P 55302221fdca40ec9f7bf6d725c0da72: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 15:03:52.300165 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 27349
I20260811 15:03:52.305981 28834 ts_tablet_manager.cc:1905] T c0cd431175d946ad873aa518a7c02f95 P f6c63cee7b22430ea73e77d9429091a3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 15:03:52.310688 28835 ts_tablet_manager.cc:1918] T c0cd431175d946ad873aa518a7c02f95 P 55302221fdca40ec9f7bf6d725c0da72: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 15:03:52.310828 28835 log.cc:1196] T c0cd431175d946ad873aa518a7c02f95 P 55302221fdca40ec9f7bf6d725c0da72: Deleting WAL directory at /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-0/wal/wals/c0cd431175d946ad873aa518a7c02f95
I20260811 15:03:52.311273 28837 tablet_replica.cc:330] T c0cd431175d946ad873aa518a7c02f95 P df8cbef0d8594cbaa3c9f32b33b38654: stopping tablet replica
I20260811 15:03:52.311648 28837 raft_consensus.cc:2229] T c0cd431175d946ad873aa518a7c02f95 P df8cbef0d8594cbaa3c9f32b33b38654 [term 1 LEADER]: Raft consensus shutting down.
I20260811 15:03:52.312119 28837 raft_consensus.cc:2258] T c0cd431175d946ad873aa518a7c02f95 P df8cbef0d8594cbaa3c9f32b33b38654 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:03:52.312148 28834 ts_tablet_manager.cc:1918] T c0cd431175d946ad873aa518a7c02f95 P f6c63cee7b22430ea73e77d9429091a3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 15:03:52.312253 28834 log.cc:1196] T c0cd431175d946ad873aa518a7c02f95 P f6c63cee7b22430ea73e77d9429091a3: Deleting WAL directory at /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-1/wal/wals/c0cd431175d946ad873aa518a7c02f95
I20260811 15:03:52.312685 28834 ts_tablet_manager.cc:1939] T c0cd431175d946ad873aa518a7c02f95 P f6c63cee7b22430ea73e77d9429091a3: Deleting consensus metadata
I20260811 15:03:52.313514 28835 ts_tablet_manager.cc:1939] T c0cd431175d946ad873aa518a7c02f95 P 55302221fdca40ec9f7bf6d725c0da72: Deleting consensus metadata
I20260811 15:03:52.314503 28788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:52.299127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50858 (local address 127.19.236.125:40287)
0811 15:03:52.299294 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:52.299299 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:52.299315 (+ 16us) server_negotiation.cc:407] Connection header received
0811 15:03:52.299356 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:52.299359 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:52.299423 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:52.299503 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:52.303981 (+ 4478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:52.304844 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:52.306108 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:52.306466 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:52.306555 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:52.308537 (+ 1982us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:52.308542 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:52.308545 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:52.308607 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:52.310500 (+ 1893us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:52.312483 (+ 1983us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:52.312488 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:52.312490 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:52.312617 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:52.312983 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:52.312986 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:52.312988 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:52.313222 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:52.313327 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:52.314184 (+ 857us) server_negotiation.cc:299] Negotiation successful
0811 15:03:52.314328 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
W20260811 15:03:52.314762 28344 connection.cc:441] server connection from 127.0.0.1:44964 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44964 (request call id 1) could send its response
W20260811 15:03:52.315671 28499 connection.cc:441] server connection from 127.0.0.1:57300 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:57300 (request call id 1) could send its response
I20260811 15:03:52.317636 28837 ts_tablet_manager.cc:1905] T c0cd431175d946ad873aa518a7c02f95 P df8cbef0d8594cbaa3c9f32b33b38654: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 15:03:52.320796 28837 ts_tablet_manager.cc:1918] T c0cd431175d946ad873aa518a7c02f95 P df8cbef0d8594cbaa3c9f32b33b38654: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 15:03:52.320959 28837 log.cc:1196] T c0cd431175d946ad873aa518a7c02f95 P df8cbef0d8594cbaa3c9f32b33b38654: Deleting WAL directory at /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-2/wal/wals/c0cd431175d946ad873aa518a7c02f95
I20260811 15:03:52.321342 28837 ts_tablet_manager.cc:1939] T c0cd431175d946ad873aa518a7c02f95 P df8cbef0d8594cbaa3c9f32b33b38654: Deleting consensus metadata
W20260811 15:03:52.322403 28647 connection.cc:441] server connection from 127.0.0.1:49300 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49300 (request call id 1) could send its response
I20260811 15:03:52.326030 28475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:52.299251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47030 (local address 127.19.236.124:39963)
0811 15:03:52.299362 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:52.299367 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:52.316057 (+ 16690us) server_negotiation.cc:407] Connection header received
0811 15:03:52.316174 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:52.316180 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:52.316241 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:52.316319 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:52.317273 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:52.318045 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:52.319386 (+ 1341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:52.319720 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:52.319792 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:52.321630 (+ 1838us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:52.321633 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:52.321636 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:52.321666 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:52.323694 (+ 2028us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:52.324150 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:52.324153 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:52.324155 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:52.324246 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:52.324610 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:52.324615 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:52.324620 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:52.324874 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:52.325038 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:52.325717 (+ 679us) server_negotiation.cc:299] Negotiation successful
0811 15:03:52.325850 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 15:03:52.327562 28788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:52.316890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50860 (local address 127.19.236.125:40287)
0811 15:03:52.317004 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:52.317008 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:52.317725 (+ 717us) server_negotiation.cc:407] Connection header received
0811 15:03:52.317878 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:52.317881 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:52.317922 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:52.317965 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:52.319630 (+ 1665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:52.320337 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:52.321768 (+ 1431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:52.322144 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:52.322229 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:52.323933 (+ 1704us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:52.323937 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:52.323939 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:52.323965 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:52.325723 (+ 1758us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:52.326241 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:52.326245 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:52.326247 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:52.326332 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:52.326660 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:52.326664 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:52.326665 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:52.326865 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:52.326965 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:52.327348 (+ 383us) server_negotiation.cc:299] Negotiation successful
0811 15:03:52.327452 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 15:03:52.334167 28784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:52.324969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47046 (local address 127.19.236.124:39963)
0811 15:03:52.325083 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:52.325087 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:52.325266 (+ 179us) server_negotiation.cc:407] Connection header received
0811 15:03:52.325378 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:52.325381 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:52.325428 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:52.325504 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:52.326641 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:52.327424 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:52.328915 (+ 1491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:52.329149 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:52.329229 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:52.330730 (+ 1501us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:52.330733 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:52.330735 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:52.330756 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:52.332252 (+ 1496us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:52.332806 (+ 554us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:52.332813 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:52.332818 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:52.332917 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:52.333214 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:52.333217 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:52.333219 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:52.333413 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:52.333563 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:52.333821 (+ 258us) server_negotiation.cc:299] Negotiation successful
0811 15:03:52.333966 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 15:03:53.287564 28844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:53.287094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:45445 (local address 127.19.236.66:52471)
0811 15:03:53.287357 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:53.287469 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:45445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":93,"threads_started":1}
W20260811 15:03:53.287905 28621 heartbeater.cc:644] Failed to heartbeat to 127.19.236.126:45445 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.19.236.126:45445: connect: Connection refused (error 111)
I20260811 15:03:53.288322 28845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:53.287927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:45445 (local address 127.19.236.67:43091)
0811 15:03:53.288178 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:53.288248 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:45445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":87,"threads_started":1}
W20260811 15:03:53.288596 28772 heartbeater.cc:644] Failed to heartbeat to 127.19.236.126:45445 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.19.236.126:45445: connect: Connection refused (error 111)
I20260811 15:03:53.290318 28846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:53.289957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:45445 (local address 127.19.236.65:53837)
0811 15:03:53.290171 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:53.290242 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:45445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":62,"threads_started":1}
W20260811 15:03:53.290618 28472 heartbeater.cc:644] Failed to heartbeat to 127.19.236.126:45445 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.19.236.126:45445: connect: Connection refused (error 111)
I20260811 15:03:53.795671 28847 raft_consensus.cc:482] T 00000000000000000000000000000000 P d6f7d38fca23431e8a90efc41b9d67d9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dfa4f7cc43ed43e1bb70ce239a69cd99)
I20260811 15:03:53.795886 28848 raft_consensus.cc:482] T 00000000000000000000000000000000 P a46978a611c144cdb5359f623cd44007 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dfa4f7cc43ed43e1bb70ce239a69cd99)
I20260811 15:03:53.795934 28847 raft_consensus.cc:504] T 00000000000000000000000000000000 P d6f7d38fca23431e8a90efc41b9d67d9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "dfa4f7cc43ed43e1bb70ce239a69cd99" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 45445 } } peers { permanent_uuid: "a46978a611c144cdb5359f623cd44007" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 40287 } attrs { promote: false } } peers { permanent_uuid: "d6f7d38fca23431e8a90efc41b9d67d9" member_type: VOTER last_known_addr { host: "127.19.236.124" port: 39963 } attrs { promote: false } }
I20260811 15:03:53.796078 28848 raft_consensus.cc:504] T 00000000000000000000000000000000 P a46978a611c144cdb5359f623cd44007 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "dfa4f7cc43ed43e1bb70ce239a69cd99" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 45445 } } peers { permanent_uuid: "a46978a611c144cdb5359f623cd44007" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 40287 } attrs { promote: false } } peers { permanent_uuid: "d6f7d38fca23431e8a90efc41b9d67d9" member_type: VOTER last_known_addr { host: "127.19.236.124" port: 39963 } attrs { promote: false } }
I20260811 15:03:53.797155 28847 leader_election.cc:288] T 00000000000000000000000000000000 P d6f7d38fca23431e8a90efc41b9d67d9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dfa4f7cc43ed43e1bb70ce239a69cd99 (127.19.236.126:45445), a46978a611c144cdb5359f623cd44007 (127.19.236.125:40287)
I20260811 15:03:53.797161 28848 leader_election.cc:288] T 00000000000000000000000000000000 P a46978a611c144cdb5359f623cd44007 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dfa4f7cc43ed43e1bb70ce239a69cd99 (127.19.236.126:45445), d6f7d38fca23431e8a90efc41b9d67d9 (127.19.236.124:39963)
I20260811 15:03:53.797983 28849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:53.797319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:45445 (local address 127.0.0.1:44024)
0811 15:03:53.797767 (+ 448us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:53.797861 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:45445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":378,"thread_start_us":90,"threads_started":1}
W20260811 15:03:53.798192 28253 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.236.126:45445: connect: Connection refused (error 111)
I20260811 15:03:53.798339 28854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:53.797911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:45445 (local address 127.0.0.1:44022)
0811 15:03:53.798163 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:53.798235 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:45445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":57,"threads_started":1}
W20260811 15:03:53.798496 28046 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.236.126:45445: connect: Connection refused (error 111)
I20260811 15:03:53.799283 28852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:53.798994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:45445 (local address 127.0.0.1:44044)
0811 15:03:53.799146 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:53.799197 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:45445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
W20260811 15:03:53.799381 28253 leader_election.cc:334] T 00000000000000000000000000000000 P d6f7d38fca23431e8a90efc41b9d67d9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer dfa4f7cc43ed43e1bb70ce239a69cd99 (127.19.236.126:45445): Network error: Client connection negotiation failed: client connection to 127.19.236.126:45445: connect: Connection refused (error 111)
I20260811 15:03:53.799427 28854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:53.799184 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:45445 (local address 127.0.0.1:44048)
0811 15:03:53.799319 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:53.799366 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:45445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
W20260811 15:03:53.799547 28046 leader_election.cc:334] T 00000000000000000000000000000000 P a46978a611c144cdb5359f623cd44007 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer dfa4f7cc43ed43e1bb70ce239a69cd99 (127.19.236.126:45445): Network error: Client connection negotiation failed: client connection to 127.19.236.126:45445: connect: Connection refused (error 111)
I20260811 15:03:53.802603 28849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:53.797711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.125:40287 (local address 127.0.0.1:50876)
0811 15:03:53.798147 (+ 436us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:53.798160 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:53.798262 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:53.798557 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:53.798560 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:53.798625 (+ 65us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:03:53.798759 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:53.798769 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:53.799826 (+ 1057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:53.799830 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:53.801168 (+ 1338us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:53.801180 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:53.802122 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:53.802126 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:53.802236 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:53.802262 (+ 26us) client_negotiation.cc:769] Sending connection context
0811 15:03:53.802353 (+ 91us) client_negotiation.cc:240] Negotiation successful
0811 15:03:53.802427 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":383,"thread_start_us":67,"threads_started":1}
I20260811 15:03:53.802596 28850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:53.797352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.124:39963 (local address 127.0.0.1:47062)
0811 15:03:53.797641 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:53.797660 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:53.797776 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:53.798794 (+ 1018us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:53.798800 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:53.798822 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:03:53.798922 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:53.798928 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:53.799953 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:53.799956 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:53.801177 (+ 1221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:53.801187 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:53.802122 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:53.802126 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:53.802236 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:53.802262 (+ 26us) client_negotiation.cc:769] Sending connection context
0811 15:03:53.802353 (+ 91us) client_negotiation.cc:240] Negotiation successful
0811 15:03:53.802427 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":67,"threads_started":1}
I20260811 15:03:53.802608 28853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:53.797736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50876 (local address 127.19.236.125:40287)
0811 15:03:53.797998 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:53.798002 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:53.798231 (+ 229us) server_negotiation.cc:407] Connection header received
0811 15:03:53.798389 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:53.798404 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:53.798455 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:53.798541 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:03:53.798881 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:53.799709 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:53.801331 (+ 1622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:53.801962 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:53.802094 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:53.802146 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:53.802397 (+ 251us) server_negotiation.cc:299] Negotiation successful
0811 15:03:53.802467 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":201,"thread_start_us":95,"threads_started":1}
I20260811 15:03:53.802609 28851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:53.797545 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47062 (local address 127.19.236.124:39963)
0811 15:03:53.797973 (+ 428us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:53.797978 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:53.797991 (+ 13us) server_negotiation.cc:407] Connection header received
0811 15:03:53.798602 (+ 611us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:53.798607 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:53.798660 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:53.799031 (+ 371us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:03:53.799121 (+ 90us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:53.799840 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:53.801331 (+ 1491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:53.801962 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:53.802094 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:53.802146 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:53.802384 (+ 238us) server_negotiation.cc:299] Negotiation successful
0811 15:03:53.802463 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":361,"spinlock_wait_cycles":768,"thread_start_us":59,"threads_started":1}
I20260811 15:03:53.803386 28280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a46978a611c144cdb5359f623cd44007" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "d6f7d38fca23431e8a90efc41b9d67d9" is_pre_election: true
I20260811 15:03:53.803632 28280 raft_consensus.cc:2454] T 00000000000000000000000000000000 P d6f7d38fca23431e8a90efc41b9d67d9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46978a611c144cdb5359f623cd44007 in term 1.
I20260811 15:03:53.803700 28072 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d6f7d38fca23431e8a90efc41b9d67d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "a46978a611c144cdb5359f623cd44007" is_pre_election: true
I20260811 15:03:53.803932 28072 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a46978a611c144cdb5359f623cd44007 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6f7d38fca23431e8a90efc41b9d67d9 in term 1.
I20260811 15:03:53.804101 28045 leader_election.cc:302] T 00000000000000000000000000000000 P a46978a611c144cdb5359f623cd44007 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46978a611c144cdb5359f623cd44007, d6f7d38fca23431e8a90efc41b9d67d9; no voters: dfa4f7cc43ed43e1bb70ce239a69cd99
I20260811 15:03:53.804369 28253 leader_election.cc:302] T 00000000000000000000000000000000 P d6f7d38fca23431e8a90efc41b9d67d9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46978a611c144cdb5359f623cd44007, d6f7d38fca23431e8a90efc41b9d67d9; no voters: dfa4f7cc43ed43e1bb70ce239a69cd99
I20260811 15:03:53.804396 28848 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a46978a611c144cdb5359f623cd44007 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 15:03:53.804464 28848 raft_consensus.cc:482] T 00000000000000000000000000000000 P a46978a611c144cdb5359f623cd44007 [term 1 FOLLOWER]: Starting leader election (detected failure of leader dfa4f7cc43ed43e1bb70ce239a69cd99)
I20260811 15:03:53.804512 28848 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a46978a611c144cdb5359f623cd44007 [term 1 FOLLOWER]: Advancing to term 2
I20260811 15:03:53.804629 28847 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d6f7d38fca23431e8a90efc41b9d67d9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 15:03:53.804715 28847 raft_consensus.cc:482] T 00000000000000000000000000000000 P d6f7d38fca23431e8a90efc41b9d67d9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader dfa4f7cc43ed43e1bb70ce239a69cd99)
I20260811 15:03:53.804769 28847 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d6f7d38fca23431e8a90efc41b9d67d9 [term 1 FOLLOWER]: Advancing to term 2
I20260811 15:03:53.805804 28848 raft_consensus.cc:504] T 00000000000000000000000000000000 P a46978a611c144cdb5359f623cd44007 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "dfa4f7cc43ed43e1bb70ce239a69cd99" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 45445 } } peers { permanent_uuid: "a46978a611c144cdb5359f623cd44007" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 40287 } attrs { promote: false } } peers { permanent_uuid: "d6f7d38fca23431e8a90efc41b9d67d9" member_type: VOTER last_known_addr { host: "127.19.236.124" port: 39963 } attrs { promote: false } }
I20260811 15:03:53.806046 28847 raft_consensus.cc:504] T 00000000000000000000000000000000 P d6f7d38fca23431e8a90efc41b9d67d9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "dfa4f7cc43ed43e1bb70ce239a69cd99" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 45445 } } peers { permanent_uuid: "a46978a611c144cdb5359f623cd44007" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 40287 } attrs { promote: false } } peers { permanent_uuid: "d6f7d38fca23431e8a90efc41b9d67d9" member_type: VOTER last_known_addr { host: "127.19.236.124" port: 39963 } attrs { promote: false } }
I20260811 15:03:53.806242 28848 leader_election.cc:288] T 00000000000000000000000000000000 P a46978a611c144cdb5359f623cd44007 [CANDIDATE]: Term 2 election: Requested vote from peers dfa4f7cc43ed43e1bb70ce239a69cd99 (127.19.236.126:45445), d6f7d38fca23431e8a90efc41b9d67d9 (127.19.236.124:39963)
I20260811 15:03:53.806453 28847 leader_election.cc:288] T 00000000000000000000000000000000 P d6f7d38fca23431e8a90efc41b9d67d9 [CANDIDATE]: Term 2 election: Requested vote from peers dfa4f7cc43ed43e1bb70ce239a69cd99 (127.19.236.126:45445), a46978a611c144cdb5359f623cd44007 (127.19.236.125:40287)
I20260811 15:03:53.806754 28850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:53.806375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:45445 (local address 127.0.0.1:44056)
0811 15:03:53.806541 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:53.806684 (+ 143us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:45445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99}
I20260811 15:03:53.807260 28280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a46978a611c144cdb5359f623cd44007" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "d6f7d38fca23431e8a90efc41b9d67d9"
I20260811 15:03:53.807339 28072 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d6f7d38fca23431e8a90efc41b9d67d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "a46978a611c144cdb5359f623cd44007"
I20260811 15:03:53.807453 28280 raft_consensus.cc:2379] T 00000000000000000000000000000000 P d6f7d38fca23431e8a90efc41b9d67d9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a46978a611c144cdb5359f623cd44007 in current term 2: Already voted for candidate d6f7d38fca23431e8a90efc41b9d67d9 in this term.
I20260811 15:03:53.807487 28850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:53.807234 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:45445 (local address 127.0.0.1:44066)
0811 15:03:53.807354 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:53.807409 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:45445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260811 15:03:53.807524 28072 raft_consensus.cc:2379] T 00000000000000000000000000000000 P a46978a611c144cdb5359f623cd44007 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d6f7d38fca23431e8a90efc41b9d67d9 in current term 2: Already voted for candidate a46978a611c144cdb5359f623cd44007 in this term.
W20260811 15:03:53.807631 28046 leader_election.cc:334] T 00000000000000000000000000000000 P a46978a611c144cdb5359f623cd44007 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer dfa4f7cc43ed43e1bb70ce239a69cd99 (127.19.236.126:45445): Network error: Client connection negotiation failed: client connection to 127.19.236.126:45445: connect: Connection refused (error 111)
I20260811 15:03:53.807255 28849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:53.807033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:45445 (local address 127.0.0.1:44062)
0811 15:03:53.807129 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:53.807185 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:45445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260811 15:03:53.807818 28045 leader_election.cc:302] T 00000000000000000000000000000000 P a46978a611c144cdb5359f623cd44007 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46978a611c144cdb5359f623cd44007; no voters: d6f7d38fca23431e8a90efc41b9d67d9, dfa4f7cc43ed43e1bb70ce239a69cd99
I20260811 15:03:53.808077 28848 raft_consensus.cc:2726] T 00000000000000000000000000000000 P a46978a611c144cdb5359f623cd44007 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260811 15:03:53.808431 28849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:53.808149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:45445 (local address 127.0.0.1:44082)
0811 15:03:53.808280 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:53.808341 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:45445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260811 15:03:53.808544 28253 leader_election.cc:334] T 00000000000000000000000000000000 P d6f7d38fca23431e8a90efc41b9d67d9 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer dfa4f7cc43ed43e1bb70ce239a69cd99 (127.19.236.126:45445): Network error: Client connection negotiation failed: client connection to 127.19.236.126:45445: connect: Connection refused (error 111)
I20260811 15:03:53.808648 28253 leader_election.cc:302] T 00000000000000000000000000000000 P d6f7d38fca23431e8a90efc41b9d67d9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d6f7d38fca23431e8a90efc41b9d67d9; no voters: a46978a611c144cdb5359f623cd44007, dfa4f7cc43ed43e1bb70ce239a69cd99
I20260811 15:03:53.808775 28847 raft_consensus.cc:2726] T 00000000000000000000000000000000 P d6f7d38fca23431e8a90efc41b9d67d9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260811 15:03:54.289100 28857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:54.288513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:45445 (local address 127.19.236.66:33107)
0811 15:03:54.288897 (+ 384us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:54.288987 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:45445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":289,"thread_start_us":151,"threads_started":1}
I20260811 15:03:54.289608 28858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:54.289122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:45445 (local address 127.19.236.67:44459)
0811 15:03:54.289468 (+ 346us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:54.289522 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:45445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":263,"thread_start_us":85,"threads_started":1}
I20260811 15:03:54.291581 28859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:54.291180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:45445 (local address 127.19.236.65:56089)
0811 15:03:54.291434 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:54.291501 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:45445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":73,"threads_started":1}
I20260811 15:03:55.290330 28860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:55.289812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:45445 (local address 127.19.236.66:55973)
0811 15:03:55.290131 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:55.290207 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:45445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":97,"threads_started":1}
I20260811 15:03:55.290669 28861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:55.290252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:45445 (local address 127.19.236.67:57569)
0811 15:03:55.290513 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:55.290576 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:45445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":81,"threads_started":1}
I20260811 15:03:55.292644 28862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:55.292241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:45445 (local address 127.19.236.65:44367)
0811 15:03:55.292460 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:55.292510 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:45445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":62,"threads_started":1}
I20260811 15:03:55.479859 28864 raft_consensus.cc:482] T 00000000000000000000000000000000 P a46978a611c144cdb5359f623cd44007 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 15:03:55.480057 28864 raft_consensus.cc:504] T 00000000000000000000000000000000 P a46978a611c144cdb5359f623cd44007 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "dfa4f7cc43ed43e1bb70ce239a69cd99" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 45445 } } peers { permanent_uuid: "a46978a611c144cdb5359f623cd44007" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 40287 } attrs { promote: false } } peers { permanent_uuid: "d6f7d38fca23431e8a90efc41b9d67d9" member_type: VOTER last_known_addr { host: "127.19.236.124" port: 39963 } attrs { promote: false } }
I20260811 15:03:55.480643 28864 leader_election.cc:288] T 00000000000000000000000000000000 P a46978a611c144cdb5359f623cd44007 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dfa4f7cc43ed43e1bb70ce239a69cd99 (127.19.236.126:45445), d6f7d38fca23431e8a90efc41b9d67d9 (127.19.236.124:39963)
I20260811 15:03:55.481212 28865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:55.480815 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:45445 (local address 127.0.0.1:44266)
0811 15:03:55.481040 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:55.481115 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:45445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":59,"threads_started":1}
I20260811 15:03:55.481199 28280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a46978a611c144cdb5359f623cd44007" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "d6f7d38fca23431e8a90efc41b9d67d9" is_pre_election: true
I20260811 15:03:55.481359 28280 raft_consensus.cc:2454] T 00000000000000000000000000000000 P d6f7d38fca23431e8a90efc41b9d67d9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46978a611c144cdb5359f623cd44007 in term 2.
I20260811 15:03:55.481705 28045 leader_election.cc:302] T 00000000000000000000000000000000 P a46978a611c144cdb5359f623cd44007 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46978a611c144cdb5359f623cd44007, d6f7d38fca23431e8a90efc41b9d67d9; no voters:
I20260811 15:03:55.481899 28864 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a46978a611c144cdb5359f623cd44007 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260811 15:03:55.481987 28864 raft_consensus.cc:482] T 00000000000000000000000000000000 P a46978a611c144cdb5359f623cd44007 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 15:03:55.482030 28864 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a46978a611c144cdb5359f623cd44007 [term 2 FOLLOWER]: Advancing to term 3
I20260811 15:03:55.482188 28865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:55.481937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:45445 (local address 127.0.0.1:44280)
0811 15:03:55.482062 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:55.482125 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:45445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260811 15:03:55.482334 28046 leader_election.cc:334] T 00000000000000000000000000000000 P a46978a611c144cdb5359f623cd44007 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer dfa4f7cc43ed43e1bb70ce239a69cd99 (127.19.236.126:45445): Network error: Client connection negotiation failed: client connection to 127.19.236.126:45445: connect: Connection refused (error 111)
I20260811 15:03:55.483251 28864 raft_consensus.cc:504] T 00000000000000000000000000000000 P a46978a611c144cdb5359f623cd44007 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "dfa4f7cc43ed43e1bb70ce239a69cd99" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 45445 } } peers { permanent_uuid: "a46978a611c144cdb5359f623cd44007" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 40287 } attrs { promote: false } } peers { permanent_uuid: "d6f7d38fca23431e8a90efc41b9d67d9" member_type: VOTER last_known_addr { host: "127.19.236.124" port: 39963 } attrs { promote: false } }
I20260811 15:03:55.483618 28864 leader_election.cc:288] T 00000000000000000000000000000000 P a46978a611c144cdb5359f623cd44007 [CANDIDATE]: Term 3 election: Requested vote from peers dfa4f7cc43ed43e1bb70ce239a69cd99 (127.19.236.126:45445), d6f7d38fca23431e8a90efc41b9d67d9 (127.19.236.124:39963)
I20260811 15:03:55.484028 28865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:55.483721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:45445 (local address 127.0.0.1:44298)
0811 15:03:55.483903 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:55.483956 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:45445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84}
I20260811 15:03:55.484678 28280 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a46978a611c144cdb5359f623cd44007" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "d6f7d38fca23431e8a90efc41b9d67d9"
I20260811 15:03:55.484800 28865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:55.484596 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:45445 (local address 127.0.0.1:44310)
0811 15:03:55.484680 (+ 84us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:55.484734 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:45445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
I20260811 15:03:55.484804 28280 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d6f7d38fca23431e8a90efc41b9d67d9 [term 2 FOLLOWER]: Advancing to term 3
W20260811 15:03:55.484905 28046 leader_election.cc:334] T 00000000000000000000000000000000 P a46978a611c144cdb5359f623cd44007 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer dfa4f7cc43ed43e1bb70ce239a69cd99 (127.19.236.126:45445): Network error: Client connection negotiation failed: client connection to 127.19.236.126:45445: connect: Connection refused (error 111)
I20260811 15:03:55.485855 28280 raft_consensus.cc:2454] T 00000000000000000000000000000000 P d6f7d38fca23431e8a90efc41b9d67d9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46978a611c144cdb5359f623cd44007 in term 3.
I20260811 15:03:55.486123 28045 leader_election.cc:302] T 00000000000000000000000000000000 P a46978a611c144cdb5359f623cd44007 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46978a611c144cdb5359f623cd44007, d6f7d38fca23431e8a90efc41b9d67d9; no voters: dfa4f7cc43ed43e1bb70ce239a69cd99
I20260811 15:03:55.486431 28864 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a46978a611c144cdb5359f623cd44007 [term 3 FOLLOWER]: Leader election won for term 3
I20260811 15:03:55.486645 28864 raft_consensus.cc:686] T 00000000000000000000000000000000 P a46978a611c144cdb5359f623cd44007 [term 3 LEADER]: Becoming Leader. State: Replica: a46978a611c144cdb5359f623cd44007, State: Running, Role: LEADER
I20260811 15:03:55.486948 28864 consensus_queue.cc:237] T 00000000000000000000000000000000 P a46978a611c144cdb5359f623cd44007 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "dfa4f7cc43ed43e1bb70ce239a69cd99" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 45445 } } peers { permanent_uuid: "a46978a611c144cdb5359f623cd44007" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 40287 } attrs { promote: false } } peers { permanent_uuid: "d6f7d38fca23431e8a90efc41b9d67d9" member_type: VOTER last_known_addr { host: "127.19.236.124" port: 39963 } attrs { promote: false } }
I20260811 15:03:55.488065 28867 sys_catalog.cc:455] T 00000000000000000000000000000000 P a46978a611c144cdb5359f623cd44007 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a46978a611c144cdb5359f623cd44007. Latest consensus state: current_term: 3 leader_uuid: "a46978a611c144cdb5359f623cd44007" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "dfa4f7cc43ed43e1bb70ce239a69cd99" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 45445 } } peers { permanent_uuid: "a46978a611c144cdb5359f623cd44007" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 40287 } attrs { promote: false } } peers { permanent_uuid: "d6f7d38fca23431e8a90efc41b9d67d9" member_type: VOTER last_known_addr { host: "127.19.236.124" port: 39963 } attrs { promote: false } } }
I20260811 15:03:55.488193 28867 sys_catalog.cc:458] T 00000000000000000000000000000000 P a46978a611c144cdb5359f623cd44007 [sys.catalog]: This master's current role is: LEADER
I20260811 15:03:55.488543 28869 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:03:55.490846 28869 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:03:55.491287 28869 catalog_manager.cc:1259] Loaded cluster ID: 2f2396d66c644234b32f65149aa17925
I20260811 15:03:55.491336 28869 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:03:55.491909 28869 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:03:55.492326 28869 catalog_manager.cc:5879] T 00000000000000000000000000000000 P a46978a611c144cdb5359f623cd44007: Loaded TSK: 0
I20260811 15:03:55.493114 28869 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 15:03:55.571696 28060 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50860:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 15:03:55.575336 28060 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 15:03:55.578620 28865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:55.578308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:45445 (local address 127.0.0.1:44328)
0811 15:03:55.578451 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:55.578534 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:45445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260811 15:03:55.578751 28280 raft_consensus.cc:1261] T 00000000000000000000000000000000 P d6f7d38fca23431e8a90efc41b9d67d9 [term 3 FOLLOWER]: Refusing update from remote peer a46978a611c144cdb5359f623cd44007: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 3 index: 14. (index mismatch)
I20260811 15:03:55.579377 28865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:55.579159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:45445 (local address 127.0.0.1:44340)
0811 15:03:55.579255 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:55.579315 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:45445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260811 15:03:55.579288 28867 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a46978a611c144cdb5359f623cd44007 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6f7d38fca23431e8a90efc41b9d67d9" member_type: VOTER last_known_addr { host: "127.19.236.124" port: 39963 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260811 15:03:55.579571 28046 consensus_peers.cc:487] T 00000000000000000000000000000000 P a46978a611c144cdb5359f623cd44007 -> Peer dfa4f7cc43ed43e1bb70ce239a69cd99 (127.19.236.126:45445): Couldn't send request to peer dfa4f7cc43ed43e1bb70ce239a69cd99. Status: Network error: Client connection negotiation failed: client connection to 127.19.236.126:45445: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 15:03:55.581019 28871 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6f7d38fca23431e8a90efc41b9d67d9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a46978a611c144cdb5359f623cd44007. Latest consensus state: current_term: 3 leader_uuid: "a46978a611c144cdb5359f623cd44007" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "dfa4f7cc43ed43e1bb70ce239a69cd99" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 45445 } } peers { permanent_uuid: "a46978a611c144cdb5359f623cd44007" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 40287 } attrs { promote: false } } peers { permanent_uuid: "d6f7d38fca23431e8a90efc41b9d67d9" member_type: VOTER last_known_addr { host: "127.19.236.124" port: 39963 } attrs { promote: false } } }
I20260811 15:03:55.581161 28871 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6f7d38fca23431e8a90efc41b9d67d9 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 15:03:55.582247 28867 sys_catalog.cc:455] T 00000000000000000000000000000000 P a46978a611c144cdb5359f623cd44007 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "a46978a611c144cdb5359f623cd44007" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "dfa4f7cc43ed43e1bb70ce239a69cd99" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 45445 } } peers { permanent_uuid: "a46978a611c144cdb5359f623cd44007" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 40287 } attrs { promote: false } } peers { permanent_uuid: "d6f7d38fca23431e8a90efc41b9d67d9" member_type: VOTER last_known_addr { host: "127.19.236.124" port: 39963 } attrs { promote: false } } }
I20260811 15:03:55.582387 28867 sys_catalog.cc:458] T 00000000000000000000000000000000 P a46978a611c144cdb5359f623cd44007 [sys.catalog]: This master's current role is: LEADER
I20260811 15:03:55.582564 28871 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6f7d38fca23431e8a90efc41b9d67d9 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "a46978a611c144cdb5359f623cd44007" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "dfa4f7cc43ed43e1bb70ce239a69cd99" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 45445 } } peers { permanent_uuid: "a46978a611c144cdb5359f623cd44007" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 40287 } attrs { promote: false } } peers { permanent_uuid: "d6f7d38fca23431e8a90efc41b9d67d9" member_type: VOTER last_known_addr { host: "127.19.236.124" port: 39963 } attrs { promote: false } } }
I20260811 15:03:55.582723 28871 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6f7d38fca23431e8a90efc41b9d67d9 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 15:03:55.593741 28865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:55.588680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.65:32827 (local address 127.0.0.1:44978)
0811 15:03:55.588927 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:55.588943 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:55.589031 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:55.590168 (+ 1137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:55.590171 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:55.590186 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:03:55.590276 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:55.590282 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:55.591351 (+ 1069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:55.591355 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:55.592538 (+ 1183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:55.592593 (+ 55us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:55.593287 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:55.593291 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:55.593376 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:55.593405 (+ 29us) client_negotiation.cc:769] Sending connection context
0811 15:03:55.593478 (+ 73us) client_negotiation.cc:240] Negotiation successful
0811 15:03:55.593550 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":174,"mutex_wait_us":91}
I20260811 15:03:55.593847 28882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:55.589358 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57304 (local address 127.19.236.66:36551)
0811 15:03:55.589700 (+ 342us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:55.589705 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:55.589717 (+ 12us) server_negotiation.cc:407] Connection header received
0811 15:03:55.589770 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:55.589772 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:55.589810 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:55.589915 (+ 105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:03:55.590304 (+ 389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:55.590916 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:55.592332 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:55.593001 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:55.593103 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:55.593168 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:55.593627 (+ 459us) server_negotiation.cc:299] Negotiation successful
0811 15:03:55.593718 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":259,"thread_start_us":87,"threads_started":1}
I20260811 15:03:55.593868 28877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:55.588783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44978 (local address 127.19.236.65:32827)
0811 15:03:55.589954 (+ 1171us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:55.589958 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:55.589976 (+ 18us) server_negotiation.cc:407] Connection header received
0811 15:03:55.590019 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:55.590021 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:55.590059 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:55.590158 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:03:55.590393 (+ 235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:55.591186 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:55.592706 (+ 1520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:55.593173 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:55.593270 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:55.593350 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:55.593656 (+ 306us) server_negotiation.cc:299] Negotiation successful
0811 15:03:55.593731 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1110,"thread_start_us":81,"threads_started":1}
I20260811 15:03:55.594013 28883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:55.589706 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49320 (local address 127.19.236.67:37021)
0811 15:03:55.589984 (+ 278us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:55.589989 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:55.590003 (+ 14us) server_negotiation.cc:407] Connection header received
0811 15:03:55.590057 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:55.590060 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:55.590104 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:55.590183 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:03:55.590514 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:55.591261 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:55.592771 (+ 1510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:55.593373 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:55.593490 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:55.593552 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:55.593794 (+ 242us) server_negotiation.cc:299] Negotiation successful
0811 15:03:55.593875 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":195,"thread_start_us":84,"threads_started":1}
I20260811 15:03:55.594274 28881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:55.589325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.67:37021 (local address 127.0.0.1:49320)
0811 15:03:55.589567 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:55.589582 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:55.589667 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:55.590304 (+ 637us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:55.590307 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:55.590321 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:03:55.590399 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:55.590404 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:55.591377 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:55.591380 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:55.592639 (+ 1259us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:55.592649 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:55.593475 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:55.593479 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:55.593559 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:55.593587 (+ 28us) client_negotiation.cc:769] Sending connection context
0811 15:03:55.593660 (+ 73us) client_negotiation.cc:240] Negotiation successful
0811 15:03:55.593722 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":181,"mutex_wait_us":4,"thread_start_us":110,"threads_started":1}
I20260811 15:03:55.593570 28878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:55.588993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.66:36551 (local address 127.0.0.1:57304)
0811 15:03:55.589499 (+ 506us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:55.589515 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:55.589608 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:55.590040 (+ 432us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:55.590043 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:55.590060 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:03:55.590176 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:55.590183 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:55.591031 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:55.591036 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:55.592190 (+ 1154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:55.592200 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:55.593125 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:55.593128 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:55.593226 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:55.593259 (+ 33us) client_negotiation.cc:769] Sending connection context
0811 15:03:55.593328 (+ 69us) client_negotiation.cc:240] Negotiation successful
0811 15:03:55.593404 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":443,"mutex_wait_us":2,"thread_start_us":90,"threads_started":1}
I20260811 15:03:55.594591 28395 tablet_service.cc:1467] Processing CreateTablet for tablet e5b9051341564b429c8d73c8ce209dfd (DEFAULT_TABLE table=test-table [id=6a1749252fa54ea5bbb942bc15c3df0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:03:55.594805 28698 tablet_service.cc:1467] Processing CreateTablet for tablet e5b9051341564b429c8d73c8ce209dfd (DEFAULT_TABLE table=test-table [id=6a1749252fa54ea5bbb942bc15c3df0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:03:55.594904 28395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e5b9051341564b429c8d73c8ce209dfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:03:55.595069 28698 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e5b9051341564b429c8d73c8ce209dfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:03:55.595201 28550 tablet_service.cc:1467] Processing CreateTablet for tablet e5b9051341564b429c8d73c8ce209dfd (DEFAULT_TABLE table=test-table [id=6a1749252fa54ea5bbb942bc15c3df0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:03:55.595418 28550 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e5b9051341564b429c8d73c8ce209dfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:03:55.597561 28884 tablet_bootstrap.cc:492] T e5b9051341564b429c8d73c8ce209dfd P df8cbef0d8594cbaa3c9f32b33b38654: Bootstrap starting.
I20260811 15:03:55.598088 28886 tablet_bootstrap.cc:492] T e5b9051341564b429c8d73c8ce209dfd P f6c63cee7b22430ea73e77d9429091a3: Bootstrap starting.
I20260811 15:03:55.598614 28884 tablet_bootstrap.cc:654] T e5b9051341564b429c8d73c8ce209dfd P df8cbef0d8594cbaa3c9f32b33b38654: Neither blocks nor log segments found. Creating new log.
I20260811 15:03:55.599040 28886 tablet_bootstrap.cc:654] T e5b9051341564b429c8d73c8ce209dfd P f6c63cee7b22430ea73e77d9429091a3: Neither blocks nor log segments found. Creating new log.
I20260811 15:03:55.599265 28885 tablet_bootstrap.cc:492] T e5b9051341564b429c8d73c8ce209dfd P 55302221fdca40ec9f7bf6d725c0da72: Bootstrap starting.
I20260811 15:03:55.599900 28884 tablet_bootstrap.cc:492] T e5b9051341564b429c8d73c8ce209dfd P df8cbef0d8594cbaa3c9f32b33b38654: No bootstrap required, opened a new log
I20260811 15:03:55.600003 28884 ts_tablet_manager.cc:1397] T e5b9051341564b429c8d73c8ce209dfd P df8cbef0d8594cbaa3c9f32b33b38654: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 15:03:55.600168 28885 tablet_bootstrap.cc:654] T e5b9051341564b429c8d73c8ce209dfd P 55302221fdca40ec9f7bf6d725c0da72: Neither blocks nor log segments found. Creating new log.
I20260811 15:03:55.600358 28886 tablet_bootstrap.cc:492] T e5b9051341564b429c8d73c8ce209dfd P f6c63cee7b22430ea73e77d9429091a3: No bootstrap required, opened a new log
I20260811 15:03:55.600451 28886 ts_tablet_manager.cc:1397] T e5b9051341564b429c8d73c8ce209dfd P f6c63cee7b22430ea73e77d9429091a3: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 15:03:55.600497 28884 raft_consensus.cc:348] T e5b9051341564b429c8d73c8ce209dfd P df8cbef0d8594cbaa3c9f32b33b38654 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55302221fdca40ec9f7bf6d725c0da72" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 32827 } } peers { permanent_uuid: "f6c63cee7b22430ea73e77d9429091a3" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 36551 } } peers { permanent_uuid: "df8cbef0d8594cbaa3c9f32b33b38654" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37021 } }
I20260811 15:03:55.600643 28884 raft_consensus.cc:374] T e5b9051341564b429c8d73c8ce209dfd P df8cbef0d8594cbaa3c9f32b33b38654 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:03:55.600714 28884 raft_consensus.cc:729] T e5b9051341564b429c8d73c8ce209dfd P df8cbef0d8594cbaa3c9f32b33b38654 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df8cbef0d8594cbaa3c9f32b33b38654, State: Initialized, Role: FOLLOWER
I20260811 15:03:55.600859 28884 consensus_queue.cc:260] T e5b9051341564b429c8d73c8ce209dfd P df8cbef0d8594cbaa3c9f32b33b38654 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55302221fdca40ec9f7bf6d725c0da72" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 32827 } } peers { permanent_uuid: "f6c63cee7b22430ea73e77d9429091a3" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 36551 } } peers { permanent_uuid: "df8cbef0d8594cbaa3c9f32b33b38654" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37021 } }
I20260811 15:03:55.600970 28886 raft_consensus.cc:348] T e5b9051341564b429c8d73c8ce209dfd P f6c63cee7b22430ea73e77d9429091a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55302221fdca40ec9f7bf6d725c0da72" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 32827 } } peers { permanent_uuid: "f6c63cee7b22430ea73e77d9429091a3" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 36551 } } peers { permanent_uuid: "df8cbef0d8594cbaa3c9f32b33b38654" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37021 } }
I20260811 15:03:55.601109 28886 raft_consensus.cc:374] T e5b9051341564b429c8d73c8ce209dfd P f6c63cee7b22430ea73e77d9429091a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:03:55.601176 28886 raft_consensus.cc:729] T e5b9051341564b429c8d73c8ce209dfd P f6c63cee7b22430ea73e77d9429091a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6c63cee7b22430ea73e77d9429091a3, State: Initialized, Role: FOLLOWER
I20260811 15:03:55.601315 28886 consensus_queue.cc:260] T e5b9051341564b429c8d73c8ce209dfd P f6c63cee7b22430ea73e77d9429091a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55302221fdca40ec9f7bf6d725c0da72" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 32827 } } peers { permanent_uuid: "f6c63cee7b22430ea73e77d9429091a3" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 36551 } } peers { permanent_uuid: "df8cbef0d8594cbaa3c9f32b33b38654" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37021 } }
I20260811 15:03:55.601549 28884 ts_tablet_manager.cc:1428] T e5b9051341564b429c8d73c8ce209dfd P df8cbef0d8594cbaa3c9f32b33b38654: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260811 15:03:55.601876 28861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:55.601635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:45445 (local address 127.19.236.67:59455)
0811 15:03:55.601743 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:55.601803 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:45445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260811 15:03:55.602167 28886 ts_tablet_manager.cc:1428] T e5b9051341564b429c8d73c8ce209dfd P f6c63cee7b22430ea73e77d9429091a3: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260811 15:03:55.603507 28885 tablet_bootstrap.cc:492] T e5b9051341564b429c8d73c8ce209dfd P 55302221fdca40ec9f7bf6d725c0da72: No bootstrap required, opened a new log
I20260811 15:03:55.603636 28885 ts_tablet_manager.cc:1397] T e5b9051341564b429c8d73c8ce209dfd P 55302221fdca40ec9f7bf6d725c0da72: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260811 15:03:55.604080 28885 raft_consensus.cc:348] T e5b9051341564b429c8d73c8ce209dfd P 55302221fdca40ec9f7bf6d725c0da72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55302221fdca40ec9f7bf6d725c0da72" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 32827 } } peers { permanent_uuid: "f6c63cee7b22430ea73e77d9429091a3" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 36551 } } peers { permanent_uuid: "df8cbef0d8594cbaa3c9f32b33b38654" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37021 } }
I20260811 15:03:55.604216 28885 raft_consensus.cc:374] T e5b9051341564b429c8d73c8ce209dfd P 55302221fdca40ec9f7bf6d725c0da72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:03:55.604275 28885 raft_consensus.cc:729] T e5b9051341564b429c8d73c8ce209dfd P 55302221fdca40ec9f7bf6d725c0da72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55302221fdca40ec9f7bf6d725c0da72, State: Initialized, Role: FOLLOWER
I20260811 15:03:55.604411 28885 consensus_queue.cc:260] T e5b9051341564b429c8d73c8ce209dfd P 55302221fdca40ec9f7bf6d725c0da72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55302221fdca40ec9f7bf6d725c0da72" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 32827 } } peers { permanent_uuid: "f6c63cee7b22430ea73e77d9429091a3" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 36551 } } peers { permanent_uuid: "df8cbef0d8594cbaa3c9f32b33b38654" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37021 } }
I20260811 15:03:55.604861 28885 ts_tablet_manager.cc:1428] T e5b9051341564b429c8d73c8ce209dfd P 55302221fdca40ec9f7bf6d725c0da72: Time spent starting tablet: real 0.001s user 0.000s sys 0.002s
I20260811 15:03:55.605105 28861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:55.602363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:45445 (local address 127.19.236.67:43227)
0811 15:03:55.604959 (+ 2596us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:55.605032 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:45445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2511}
I20260811 15:03:55.605633 28862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:55.605381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:45445 (local address 127.19.236.65:50227)
0811 15:03:55.605505 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:55.605566 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:45445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260811 15:03:55.605656 28622 heartbeater.cc:503] Master 127.19.236.125:40287 was elected leader, sending a full tablet report...
I20260811 15:03:55.605739 28860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:55.605381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:45445 (local address 127.19.236.66:45977)
0811 15:03:55.605615 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:55.605670 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:45445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":164}
I20260811 15:03:55.607678 28473 heartbeater.cc:503] Master 127.19.236.125:40287 was elected leader, sending a full tablet report...
I20260811 15:03:55.608086 28862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:55.607827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:45445 (local address 127.19.236.65:45133)
0811 15:03:55.607961 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:55.608017 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:45445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260811 15:03:55.625123 28892 raft_consensus.cc:482] T e5b9051341564b429c8d73c8ce209dfd P f6c63cee7b22430ea73e77d9429091a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 15:03:55.625316 28892 raft_consensus.cc:504] T e5b9051341564b429c8d73c8ce209dfd P f6c63cee7b22430ea73e77d9429091a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55302221fdca40ec9f7bf6d725c0da72" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 32827 } } peers { permanent_uuid: "f6c63cee7b22430ea73e77d9429091a3" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 36551 } } peers { permanent_uuid: "df8cbef0d8594cbaa3c9f32b33b38654" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37021 } }
I20260811 15:03:55.626515 28892 leader_election.cc:288] T e5b9051341564b429c8d73c8ce209dfd P f6c63cee7b22430ea73e77d9429091a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 55302221fdca40ec9f7bf6d725c0da72 (127.19.236.65:32827), df8cbef0d8594cbaa3c9f32b33b38654 (127.19.236.67:37021)
I20260811 15:03:55.630805 28877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:55.626945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.66:35881 (local address 127.19.236.65:32827)
0811 15:03:55.627102 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:55.627107 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:55.627127 (+ 20us) server_negotiation.cc:407] Connection header received
0811 15:03:55.627217 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:55.627222 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:55.627281 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:55.627360 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:03:55.627670 (+ 310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:55.628196 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:55.629785 (+ 1589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:55.630211 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:55.630340 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:55.630402 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:55.630615 (+ 213us) server_negotiation.cc:299] Negotiation successful
0811 15:03:55.630691 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 15:03:55.630805 28860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:55.626810 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.65:32827 (local address 127.19.236.66:35881)
0811 15:03:55.626962 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:55.626980 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:55.627108 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:55.627393 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:55.627396 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:55.627413 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:03:55.627554 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:55.627560 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:55.628309 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:55.628313 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:55.629660 (+ 1347us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:55.629670 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:55.630356 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:55.630360 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:55.630473 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:55.630502 (+ 29us) client_negotiation.cc:769] Sending connection context
0811 15:03:55.630587 (+ 85us) client_negotiation.cc:240] Negotiation successful
0811 15:03:55.630665 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":56,"mutex_wait_us":56}
I20260811 15:03:55.631024 28894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:55.627085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.67:37021 (local address 127.19.236.66:39569)
0811 15:03:55.627395 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:55.627409 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:55.627560 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:55.627825 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:55.627828 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:55.627845 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:03:55.627962 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:55.627967 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:55.628763 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:55.628767 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:55.629836 (+ 1069us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:55.629845 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:55.630491 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:55.630494 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:55.630594 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:55.630615 (+ 21us) client_negotiation.cc:769] Sending connection context
0811 15:03:55.630705 (+ 90us) client_negotiation.cc:240] Negotiation successful
0811 15:03:55.630777 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":252,"mutex_wait_us":40,"thread_start_us":148,"threads_started":1}
I20260811 15:03:55.631049 28883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:55.627270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.66:39569 (local address 127.19.236.67:37021)
0811 15:03:55.627396 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:55.627402 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:55.627516 (+ 114us) server_negotiation.cc:407] Connection header received
0811 15:03:55.627674 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:55.627677 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:55.627725 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:55.627803 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:03:55.628068 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:55.628643 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:55.629963 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:55.630366 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:55.630494 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:55.630545 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:55.630734 (+ 189us) server_negotiation.cc:299] Negotiation successful
0811 15:03:55.630809 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 15:03:55.631381 28418 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5b9051341564b429c8d73c8ce209dfd" candidate_uuid: "f6c63cee7b22430ea73e77d9429091a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55302221fdca40ec9f7bf6d725c0da72" is_pre_election: true
I20260811 15:03:55.631560 28418 raft_consensus.cc:2454] T e5b9051341564b429c8d73c8ce209dfd P 55302221fdca40ec9f7bf6d725c0da72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6c63cee7b22430ea73e77d9429091a3 in term 0.
I20260811 15:03:55.631739 28720 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5b9051341564b429c8d73c8ce209dfd" candidate_uuid: "f6c63cee7b22430ea73e77d9429091a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8cbef0d8594cbaa3c9f32b33b38654" is_pre_election: true
I20260811 15:03:55.631944 28500 leader_election.cc:302] T e5b9051341564b429c8d73c8ce209dfd P f6c63cee7b22430ea73e77d9429091a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55302221fdca40ec9f7bf6d725c0da72, f6c63cee7b22430ea73e77d9429091a3; no voters:
I20260811 15:03:55.632014 28720 raft_consensus.cc:2454] T e5b9051341564b429c8d73c8ce209dfd P df8cbef0d8594cbaa3c9f32b33b38654 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6c63cee7b22430ea73e77d9429091a3 in term 0.
I20260811 15:03:55.632207 28892 raft_consensus.cc:2781] T e5b9051341564b429c8d73c8ce209dfd P f6c63cee7b22430ea73e77d9429091a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 15:03:55.632292 28892 raft_consensus.cc:482] T e5b9051341564b429c8d73c8ce209dfd P f6c63cee7b22430ea73e77d9429091a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 15:03:55.632381 28892 raft_consensus.cc:3037] T e5b9051341564b429c8d73c8ce209dfd P f6c63cee7b22430ea73e77d9429091a3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:03:55.633514 28892 raft_consensus.cc:504] T e5b9051341564b429c8d73c8ce209dfd P f6c63cee7b22430ea73e77d9429091a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55302221fdca40ec9f7bf6d725c0da72" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 32827 } } peers { permanent_uuid: "f6c63cee7b22430ea73e77d9429091a3" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 36551 } } peers { permanent_uuid: "df8cbef0d8594cbaa3c9f32b33b38654" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37021 } }
I20260811 15:03:55.633877 28892 leader_election.cc:288] T e5b9051341564b429c8d73c8ce209dfd P f6c63cee7b22430ea73e77d9429091a3 [CANDIDATE]: Term 1 election: Requested vote from peers 55302221fdca40ec9f7bf6d725c0da72 (127.19.236.65:32827), df8cbef0d8594cbaa3c9f32b33b38654 (127.19.236.67:37021)
I20260811 15:03:55.634310 28418 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5b9051341564b429c8d73c8ce209dfd" candidate_uuid: "f6c63cee7b22430ea73e77d9429091a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55302221fdca40ec9f7bf6d725c0da72"
I20260811 15:03:55.634424 28418 raft_consensus.cc:3037] T e5b9051341564b429c8d73c8ce209dfd P 55302221fdca40ec9f7bf6d725c0da72 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:03:55.634413 28720 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5b9051341564b429c8d73c8ce209dfd" candidate_uuid: "f6c63cee7b22430ea73e77d9429091a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8cbef0d8594cbaa3c9f32b33b38654"
I20260811 15:03:55.634533 28720 raft_consensus.cc:3037] T e5b9051341564b429c8d73c8ce209dfd P df8cbef0d8594cbaa3c9f32b33b38654 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:03:55.635470 28418 raft_consensus.cc:2454] T e5b9051341564b429c8d73c8ce209dfd P 55302221fdca40ec9f7bf6d725c0da72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6c63cee7b22430ea73e77d9429091a3 in term 1.
I20260811 15:03:55.635679 28720 raft_consensus.cc:2454] T e5b9051341564b429c8d73c8ce209dfd P df8cbef0d8594cbaa3c9f32b33b38654 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6c63cee7b22430ea73e77d9429091a3 in term 1.
I20260811 15:03:55.635741 28500 leader_election.cc:302] T e5b9051341564b429c8d73c8ce209dfd P f6c63cee7b22430ea73e77d9429091a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55302221fdca40ec9f7bf6d725c0da72, f6c63cee7b22430ea73e77d9429091a3; no voters:
I20260811 15:03:55.635926 28892 raft_consensus.cc:2781] T e5b9051341564b429c8d73c8ce209dfd P f6c63cee7b22430ea73e77d9429091a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:03:55.636160 28892 raft_consensus.cc:686] T e5b9051341564b429c8d73c8ce209dfd P f6c63cee7b22430ea73e77d9429091a3 [term 1 LEADER]: Becoming Leader. State: Replica: f6c63cee7b22430ea73e77d9429091a3, State: Running, Role: LEADER
I20260811 15:03:55.636421 28892 consensus_queue.cc:237] T e5b9051341564b429c8d73c8ce209dfd P f6c63cee7b22430ea73e77d9429091a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55302221fdca40ec9f7bf6d725c0da72" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 32827 } } peers { permanent_uuid: "f6c63cee7b22430ea73e77d9429091a3" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 36551 } } peers { permanent_uuid: "df8cbef0d8594cbaa3c9f32b33b38654" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37021 } }
I20260811 15:03:55.636981 28894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:55.636700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:45445 (local address 127.19.236.66:36993)
0811 15:03:55.636851 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:55.636913 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:45445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260811 15:03:55.639030 28061 catalog_manager.cc:5495] T e5b9051341564b429c8d73c8ce209dfd P f6c63cee7b22430ea73e77d9429091a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to f6c63cee7b22430ea73e77d9429091a3 (127.19.236.66). New cstate: current_term: 1 leader_uuid: "f6c63cee7b22430ea73e77d9429091a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55302221fdca40ec9f7bf6d725c0da72" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 32827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6c63cee7b22430ea73e77d9429091a3" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 36551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df8cbef0d8594cbaa3c9f32b33b38654" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37021 } health_report { overall_health: UNKNOWN } } }
I20260811 15:03:55.661486 28882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:55.657829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57318 (local address 127.19.236.66:36551)
0811 15:03:55.657995 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:55.657999 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:55.658043 (+ 44us) server_negotiation.cc:407] Connection header received
0811 15:03:55.658131 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:55.658133 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:55.658192 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:55.658302 (+ 110us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 15:03:55.658524 (+ 222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:55.659038 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:55.659888 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:55.660129 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:55.660228 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:55.660493 (+ 265us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 15:03:55.661058 (+ 565us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 15:03:55.661158 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:55.661284 (+ 126us) server_negotiation.cc:299] Negotiation successful
0811 15:03:55.661342 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260811 15:03:55.664724 28418 raft_consensus.cc:1261] T e5b9051341564b429c8d73c8ce209dfd P 55302221fdca40ec9f7bf6d725c0da72 [term 1 FOLLOWER]: Refusing update from remote peer f6c63cee7b22430ea73e77d9429091a3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:03:55.664840 28720 raft_consensus.cc:1261] T e5b9051341564b429c8d73c8ce209dfd P df8cbef0d8594cbaa3c9f32b33b38654 [term 1 FOLLOWER]: Refusing update from remote peer f6c63cee7b22430ea73e77d9429091a3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:03:55.665279 28892 consensus_queue.cc:1035] T e5b9051341564b429c8d73c8ce209dfd P f6c63cee7b22430ea73e77d9429091a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55302221fdca40ec9f7bf6d725c0da72" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 32827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:03:55.665472 28895 consensus_queue.cc:1035] T e5b9051341564b429c8d73c8ce209dfd P f6c63cee7b22430ea73e77d9429091a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8cbef0d8594cbaa3c9f32b33b38654" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:03:55.667775 28862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:55.667471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:45445 (local address 127.19.236.65:44133)
0811 15:03:55.667628 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:55.667696 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:45445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260811 15:03:55.668537 28774 heartbeater.cc:503] Master 127.19.236.125:40287 was elected leader, sending a full tablet report...
I20260811 15:03:55.669601 28861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:55.669146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:45445 (local address 127.19.236.67:40795)
0811 15:03:55.669468 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:55.669526 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:45445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":249}
I20260811 15:03:55.672277 28894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:55.671535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:45445 (local address 127.19.236.66:54909)
0811 15:03:55.672131 (+ 596us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:55.672196 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:45445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":516}
I20260811 15:03:55.673653 28861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:55.671666 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:45445 (local address 127.19.236.67:38425)
0811 15:03:55.673522 (+ 1856us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:55.673580 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:45445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1765}
I20260811 15:03:55.674714 28862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:55.673522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:45445 (local address 127.19.236.65:36403)
0811 15:03:55.674589 (+ 1067us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:55.674642 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:45445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":998}
I20260811 15:03:55.686218 28060 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50860:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 15:03:55.686414 28060 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50860:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 15:03:55.690639 28060 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a46978a611c144cdb5359f623cd44007: Sending DeleteTablet for 3 replicas of tablet e5b9051341564b429c8d73c8ce209dfd
I20260811 15:03:55.691605 28550 tablet_service.cc:1514] Processing DeleteTablet for tablet e5b9051341564b429c8d73c8ce209dfd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:03:55 UTC) from {username='oryx', principal='oryx/127.19.236.125@KRBTEST.COM'} at 127.0.0.1:57304
I20260811 15:03:55.691854 28698 tablet_service.cc:1514] Processing DeleteTablet for tablet e5b9051341564b429c8d73c8ce209dfd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:03:55 UTC) from {username='oryx', principal='oryx/127.19.236.125@KRBTEST.COM'} at 127.0.0.1:49320
I20260811 15:03:55.692106 28395 tablet_service.cc:1514] Processing DeleteTablet for tablet e5b9051341564b429c8d73c8ce209dfd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:03:55 UTC) from {username='oryx', principal='oryx/127.19.236.125@KRBTEST.COM'} at 127.0.0.1:44978
I20260811 15:03:55.692303 28908 tablet_replica.cc:330] T e5b9051341564b429c8d73c8ce209dfd P df8cbef0d8594cbaa3c9f32b33b38654: stopping tablet replica
I20260811 15:03:55.692489 28908 raft_consensus.cc:2229] T e5b9051341564b429c8d73c8ce209dfd P df8cbef0d8594cbaa3c9f32b33b38654 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 15:03:55.692683 28908 raft_consensus.cc:2258] T e5b9051341564b429c8d73c8ce209dfd P df8cbef0d8594cbaa3c9f32b33b38654 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:03:55.692679 28909 tablet_replica.cc:330] T e5b9051341564b429c8d73c8ce209dfd P 55302221fdca40ec9f7bf6d725c0da72: stopping tablet replica
I20260811 15:03:55.692811 28909 raft_consensus.cc:2229] T e5b9051341564b429c8d73c8ce209dfd P 55302221fdca40ec9f7bf6d725c0da72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 15:03:55.693018 28909 raft_consensus.cc:2258] T e5b9051341564b429c8d73c8ce209dfd P 55302221fdca40ec9f7bf6d725c0da72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:03:55.693065 28907 tablet_replica.cc:330] T e5b9051341564b429c8d73c8ce209dfd P f6c63cee7b22430ea73e77d9429091a3: stopping tablet replica
I20260811 15:03:55.693150 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 28225
I20260811 15:03:55.696534 28907 raft_consensus.cc:2229] T e5b9051341564b429c8d73c8ce209dfd P f6c63cee7b22430ea73e77d9429091a3 [term 1 LEADER]: Raft consensus shutting down.
I20260811 15:03:55.697042 28908 ts_tablet_manager.cc:1905] T e5b9051341564b429c8d73c8ce209dfd P df8cbef0d8594cbaa3c9f32b33b38654: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 15:03:55.697098 28907 raft_consensus.cc:2258] T e5b9051341564b429c8d73c8ce209dfd P f6c63cee7b22430ea73e77d9429091a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:03:55.698165 28907 ts_tablet_manager.cc:1905] T e5b9051341564b429c8d73c8ce209dfd P f6c63cee7b22430ea73e77d9429091a3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 15:03:55.702067 28907 ts_tablet_manager.cc:1918] T e5b9051341564b429c8d73c8ce209dfd P f6c63cee7b22430ea73e77d9429091a3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 15:03:55.702220 28907 log.cc:1196] T e5b9051341564b429c8d73c8ce209dfd P f6c63cee7b22430ea73e77d9429091a3: Deleting WAL directory at /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-1/wal/wals/e5b9051341564b429c8d73c8ce209dfd
I20260811 15:03:55.702667 28907 ts_tablet_manager.cc:1939] T e5b9051341564b429c8d73c8ce209dfd P f6c63cee7b22430ea73e77d9429091a3: Deleting consensus metadata
I20260811 15:03:55.703691 28044 catalog_manager.cc:4841] TS f6c63cee7b22430ea73e77d9429091a3 (127.19.236.66:36551): tablet e5b9051341564b429c8d73c8ce209dfd (table test-table [id=6a1749252fa54ea5bbb942bc15c3df0d]) successfully deleted
I20260811 15:03:55.704118 28908 ts_tablet_manager.cc:1918] T e5b9051341564b429c8d73c8ce209dfd P df8cbef0d8594cbaa3c9f32b33b38654: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 15:03:55.704205 28908 log.cc:1196] T e5b9051341564b429c8d73c8ce209dfd P df8cbef0d8594cbaa3c9f32b33b38654: Deleting WAL directory at /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786460596631409-20401-0/minicluster-data/ts-2/wal/wals/e5b9051341564b429c8d73c8ce209dfd
I20260811 15:03:55.704485 28908 ts_tablet_manager.cc:1939] T e5b9051341564b429c8d73c8ce209dfd P df8cbef0d8594cbaa3c9f32b33b38654: Deleting consensus metadata
I20260811 15:03:55.705286 28046 catalog_manager.cc:4841] TS df8cbef0d8594cbaa3c9f32b33b38654 (127.19.236.67:37021): tablet e5b9051341564b429c8d73c8ce209dfd (table test-table [id=6a1749252fa54ea5bbb942bc15c3df0d]) successfully deleted
I20260811 15:03:55.707417 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 28479
I20260811 15:03:55.707441 28878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:55.707120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.65:32827 (local address 127.0.0.1:44990)
0811 15:03:55.707294 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:55.707362 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.65:32827: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260811 15:03:55.709833 28046 catalog_manager.cc:4584] TS 55302221fdca40ec9f7bf6d725c0da72 (127.19.236.65:32827): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet e5b9051341564b429c8d73c8ce209dfd: Network error: Client connection negotiation failed: client connection to 127.19.236.65:32827: connect: Connection refused (error 111)
I20260811 15:03:55.716428 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 28628
I20260811 15:03:55.727874 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 27912
I20260811 15:03:55.736467 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 28023
2026-08-11T15:03:55Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (7431 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 15:03:55 dist-test-slave-8n49 krb5kdc[28912](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 15:03:55 dist-test-slave-8n49 krb5kdc[28912](info): set up 2 sockets
Aug 11 15:03:55 dist-test-slave-8n49 krb5kdc[28912](info): commencing operation
krb5kdc: starting...
W20260811 15:03:56.870527 20401 mini_kdc.cc:121] Time spent starting KDC: real 1.107s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/krb5kdc/test-user.keytab.
Aug 11 15:03:56 dist-test-slave-8n49 krb5kdc[28912](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460636, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T15:03:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T15:03:56Z Disabled control of system clock
WARNING: no policy specified for oryx/127.19.236.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.19.236.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.19.236.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/krb5kdc/oryx_127.19.236.126.keytab.
Entry for principal oryx/127.19.236.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/krb5kdc/oryx_127.19.236.126.keytab.
I20260811 15:03:57.001009 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:35361
--webserver_interface=127.19.236.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/krb5kdc/oryx_127.19.236.126.keytab
--principal=oryx/127.19.236.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:38587
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.236.126:35361
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:03:57.117753 28928 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:03:57.118043 28928 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:03:57.118091 28928 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:03:57.122177 28928 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:03:57.122246 28928 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 15:03:57.122263 28928 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:03:57.122283 28928 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:03:57.122299 28928 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:03:57.122364 28928 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:03:57.127914 28928 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:38587
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.236.126:35361
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/krb5kdc/oryx_127.19.236.126.keytab
--principal=oryx/127.19.236.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:35361
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.236.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28928
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:03:57.129246 28928 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:03:57.130371 28928 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:03:57.139355 28934 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:57.139374 28938 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:57.139449 28928 server_base.cc:1034] running on GCE node
W20260811 15:03:57.139424 28936 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:57.140255 28928 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:03:57.141589 28928 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:03:57.142796 28928 hybrid_clock.cc:648] HybridClock initialized: now 1786460637142779 us; error 32 us; skew 500 ppm
Aug 11 15:03:57 dist-test-slave-8n49 krb5kdc[28912](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460637, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.236.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:03:57.146111 28928 init.cc:377] Logged in from keytab as oryx/127.19.236.126@KRBTEST.COM (short username oryx)
I20260811 15:03:57.147116 28928 webserver.cc:460] Webserver started at http://127.19.236.126:32845/ using document root <none> and password file <none>
I20260811 15:03:57.147804 28928 fs_manager.cc:359] Metadata directory not provided
I20260811 15:03:57.147904 28928 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:03:57.148177 28928 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:03:57.150624 28928 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/minicluster-data/master-0/data/instance:
uuid: "310341f977fe4f90ad0e21aa6f2495d7"
format_stamp: "Formatted at 2026-08-11 15:03:57 on dist-test-slave-8n49"
server_key: "0357f1d4297a94c0e31e4cb1e2aee3b5"
server_key_iv: "8b4a7de441c35ccf2693eaed2317e0f6"
server_key_version: "encryptionkey@0"
I20260811 15:03:57.151310 28928 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/minicluster-data/master-0/wal/instance:
uuid: "310341f977fe4f90ad0e21aa6f2495d7"
format_stamp: "Formatted at 2026-08-11 15:03:57 on dist-test-slave-8n49"
server_key: "0357f1d4297a94c0e31e4cb1e2aee3b5"
server_key_iv: "8b4a7de441c35ccf2693eaed2317e0f6"
server_key_version: "encryptionkey@0"
I20260811 15:03:57.155725 28928 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260811 15:03:57.158573 28947 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:57.159876 28928 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 15:03:57.160060 28928 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/minicluster-data/master-0/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/minicluster-data/master-0/wal
uuid: "310341f977fe4f90ad0e21aa6f2495d7"
format_stamp: "Formatted at 2026-08-11 15:03:57 on dist-test-slave-8n49"
server_key: "0357f1d4297a94c0e31e4cb1e2aee3b5"
server_key_iv: "8b4a7de441c35ccf2693eaed2317e0f6"
server_key_version: "encryptionkey@0"
I20260811 15:03:57.160198 28928 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:03:57.178261 28928 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:03:57.181514 28928 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:03:57.181741 28928 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:03:57.190507 28928 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.126:35361
I20260811 15:03:57.190528 29016 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.126:35361 every 8 connection(s)
I20260811 15:03:57.191571 28928 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
I20260811 15:03:57.194602 29017 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:03:57.198643 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 28928
I20260811 15:03:57.198800 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/minicluster-data/master-0/wal/instance
I20260811 15:03:57.199112 20401 external_mini_cluster.cc:1428] Setting key 297ddbfe0350beeac934669bc884c99f
I20260811 15:03:57.200644 29017 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 310341f977fe4f90ad0e21aa6f2495d7: Bootstrap starting.
I20260811 15:03:57.203061 29017 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 310341f977fe4f90ad0e21aa6f2495d7: Neither blocks nor log segments found. Creating new log.
I20260811 15:03:57.203943 29017 log.cc:824] T 00000000000000000000000000000000 P 310341f977fe4f90ad0e21aa6f2495d7: Log is configured to *not* fsync() on all Append() calls
I20260811 15:03:57.205945 29017 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 310341f977fe4f90ad0e21aa6f2495d7: No bootstrap required, opened a new log
Aug 11 15:03:57 dist-test-slave-8n49 krb5kdc[28912](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460636, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM
I20260811 15:03:57.210412 29017 raft_consensus.cc:348] T 00000000000000000000000000000000 P 310341f977fe4f90ad0e21aa6f2495d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "310341f977fe4f90ad0e21aa6f2495d7" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 35361 } }
I20260811 15:03:57.210744 29017 raft_consensus.cc:374] T 00000000000000000000000000000000 P 310341f977fe4f90ad0e21aa6f2495d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:03:57.210800 29017 raft_consensus.cc:729] T 00000000000000000000000000000000 P 310341f977fe4f90ad0e21aa6f2495d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 310341f977fe4f90ad0e21aa6f2495d7, State: Initialized, Role: FOLLOWER
I20260811 15:03:57.211347 29017 consensus_queue.cc:260] T 00000000000000000000000000000000 P 310341f977fe4f90ad0e21aa6f2495d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "310341f977fe4f90ad0e21aa6f2495d7" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 35361 } }
I20260811 15:03:57.211501 29017 raft_consensus.cc:388] T 00000000000000000000000000000000 P 310341f977fe4f90ad0e21aa6f2495d7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 15:03:57.211596 29017 raft_consensus.cc:482] T 00000000000000000000000000000000 P 310341f977fe4f90ad0e21aa6f2495d7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 15:03:57.211705 29017 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 310341f977fe4f90ad0e21aa6f2495d7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:03:57.213004 29017 raft_consensus.cc:504] T 00000000000000000000000000000000 P 310341f977fe4f90ad0e21aa6f2495d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "310341f977fe4f90ad0e21aa6f2495d7" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 35361 } }
I20260811 15:03:57.213418 29017 leader_election.cc:302] T 00000000000000000000000000000000 P 310341f977fe4f90ad0e21aa6f2495d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 310341f977fe4f90ad0e21aa6f2495d7; no voters:
I20260811 15:03:57.213805 29017 leader_election.cc:288] T 00000000000000000000000000000000 P 310341f977fe4f90ad0e21aa6f2495d7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 15:03:57.213949 29023 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 310341f977fe4f90ad0e21aa6f2495d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:03:57.214212 29023 raft_consensus.cc:686] T 00000000000000000000000000000000 P 310341f977fe4f90ad0e21aa6f2495d7 [term 1 LEADER]: Becoming Leader. State: Replica: 310341f977fe4f90ad0e21aa6f2495d7, State: Running, Role: LEADER
I20260811 15:03:57.214596 29023 consensus_queue.cc:237] T 00000000000000000000000000000000 P 310341f977fe4f90ad0e21aa6f2495d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "310341f977fe4f90ad0e21aa6f2495d7" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 35361 } }
I20260811 15:03:57.214761 29020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:57.200695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56330 (local address 127.19.236.126:35361)
0811 15:03:57.201214 (+ 519us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:57.201230 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:57.201267 (+ 37us) server_negotiation.cc:407] Connection header received
0811 15:03:57.201925 (+ 658us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:57.201941 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:57.202281 (+ 340us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:57.202569 (+ 288us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:57.203574 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:57.204712 (+ 1138us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:57.205577 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:57.206096 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:57.206283 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:57.209139 (+ 2856us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:57.209146 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:57.209165 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:57.209201 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:57.211212 (+ 2011us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:57.211814 (+ 602us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:57.211820 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:57.211826 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:57.211984 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:57.212291 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:57.212294 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:57.212296 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:57.212898 (+ 602us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:57.213134 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:57.213434 (+ 300us) server_negotiation.cc:299] Negotiation successful
0811 15:03:57.213771 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":345,"thread_start_us":153,"threads_started":1}
I20260811 15:03:57.215170 29017 sys_catalog.cc:564] T 00000000000000000000000000000000 P 310341f977fe4f90ad0e21aa6f2495d7 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:03:57.218150 29025 sys_catalog.cc:455] T 00000000000000000000000000000000 P 310341f977fe4f90ad0e21aa6f2495d7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "310341f977fe4f90ad0e21aa6f2495d7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "310341f977fe4f90ad0e21aa6f2495d7" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 35361 } } }
I20260811 15:03:57.218295 29025 sys_catalog.cc:458] T 00000000000000000000000000000000 P 310341f977fe4f90ad0e21aa6f2495d7 [sys.catalog]: This master's current role is: LEADER
I20260811 15:03:57.218755 29026 sys_catalog.cc:455] T 00000000000000000000000000000000 P 310341f977fe4f90ad0e21aa6f2495d7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 310341f977fe4f90ad0e21aa6f2495d7. Latest consensus state: current_term: 1 leader_uuid: "310341f977fe4f90ad0e21aa6f2495d7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "310341f977fe4f90ad0e21aa6f2495d7" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 35361 } } }
I20260811 15:03:57.218854 29026 sys_catalog.cc:458] T 00000000000000000000000000000000 P 310341f977fe4f90ad0e21aa6f2495d7 [sys.catalog]: This master's current role is: LEADER
W20260811 15:03:57.220407 29038 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 310341f977fe4f90ad0e21aa6f2495d7: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 15:03:57.220498 29038 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 15:03:57.220600 29041 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:03:57.221498 29041 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:03:57.227171 29041 catalog_manager.cc:1347] Generated new cluster ID: 3bb2fcbea47b4a5ba13359fde39dce58
I20260811 15:03:57.227244 29041 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:03:57.237052 29041 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 15:03:57.238221 29041 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:03:57.249547 29041 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 310341f977fe4f90ad0e21aa6f2495d7: Generated new TSK 0
I20260811 15:03:57.250350 29041 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.19.236.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.19.236.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.19.236.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/krb5kdc/oryx_127.19.236.65.keytab.
Entry for principal oryx/127.19.236.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/krb5kdc/oryx_127.19.236.65.keytab.
I20260811 15:03:57.288002 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.65:0
--local_ip_for_outbound_sockets=127.19.236.65
--webserver_interface=127.19.236.65
--webserver_port=0
--tserver_master_addrs=127.19.236.126:35361
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/krb5kdc/oryx_127.19.236.65.keytab
--principal=oryx/127.19.236.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:38587
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:03:57.410351 29047 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:03:57.410686 29047 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:03:57.410769 29047 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:03:57.414991 29047 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:03:57.415093 29047 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:03:57.415166 29047 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 15:03:57.415253 29047 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.65
I20260811 15:03:57.421098 29047 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:38587
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/krb5kdc/oryx_127.19.236.65.keytab
--principal=oryx/127.19.236.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.236.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.19.236.126:35361
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29047
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.65
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:03:57.422263 29047 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:03:57.423357 29047 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:03:57.433513 29054 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:57.433696 29047 server_base.cc:1034] running on GCE node
W20260811 15:03:57.433909 29056 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:57.433995 29053 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:57.434434 29047 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:03:57.435037 29047 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:03:57.436204 29047 hybrid_clock.cc:648] HybridClock initialized: now 1786460637436188 us; error 28 us; skew 500 ppm
Aug 11 15:03:57 dist-test-slave-8n49 krb5kdc[28912](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460637, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.236.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:03:57.439182 29047 init.cc:377] Logged in from keytab as oryx/127.19.236.65@KRBTEST.COM (short username oryx)
I20260811 15:03:57.440099 29047 webserver.cc:460] Webserver started at http://127.19.236.65:35925/ using document root <none> and password file <none>
I20260811 15:03:57.440728 29047 fs_manager.cc:359] Metadata directory not provided
I20260811 15:03:57.440801 29047 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:03:57.440994 29047 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:03:57.443123 29047 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/minicluster-data/ts-0/data/instance:
uuid: "c55114e7834d47eb830087dff4cf5242"
format_stamp: "Formatted at 2026-08-11 15:03:57 on dist-test-slave-8n49"
server_key: "3148848b39cb3e70f7a97c0780c9bc95"
server_key_iv: "dce56dbb57c68dc9abff0c69d7db5858"
server_key_version: "encryptionkey@0"
I20260811 15:03:57.443662 29047 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/minicluster-data/ts-0/wal/instance:
uuid: "c55114e7834d47eb830087dff4cf5242"
format_stamp: "Formatted at 2026-08-11 15:03:57 on dist-test-slave-8n49"
server_key: "3148848b39cb3e70f7a97c0780c9bc95"
server_key_iv: "dce56dbb57c68dc9abff0c69d7db5858"
server_key_version: "encryptionkey@0"
I20260811 15:03:57.447552 29047 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260811 15:03:57.450098 29064 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:57.451385 29047 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20260811 15:03:57.451542 29047 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/minicluster-data/ts-0/wal
uuid: "c55114e7834d47eb830087dff4cf5242"
format_stamp: "Formatted at 2026-08-11 15:03:57 on dist-test-slave-8n49"
server_key: "3148848b39cb3e70f7a97c0780c9bc95"
server_key_iv: "dce56dbb57c68dc9abff0c69d7db5858"
server_key_version: "encryptionkey@0"
I20260811 15:03:57.451668 29047 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:03:57.481997 29047 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:03:57.485462 29047 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:03:57.485694 29047 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:03:57.487272 29047 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:03:57.487354 29047 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:57.487438 29047 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:03:57.487483 29047 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 15:03:57 dist-test-slave-8n49 krb5kdc[28912](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460637, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.236.65@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM
I20260811 15:03:57.499128 29047 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.65:39839
I20260811 15:03:57.499197 29188 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.65:39839 every 8 connection(s)
I20260811 15:03:57.500219 29047 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
I20260811 15:03:57.500860 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 29047
I20260811 15:03:57.501014 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/minicluster-data/ts-0/wal/instance
I20260811 15:03:57.501374 20401 external_mini_cluster.cc:1428] Setting key 1b62aea113e1145add83562daae396bf
I20260811 15:03:57.504732 29020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:57.488410 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.65:39639 (local address 127.19.236.126:35361)
0811 15:03:57.488608 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:57.488620 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:57.489687 (+ 1067us) server_negotiation.cc:407] Connection header received
0811 15:03:57.491238 (+ 1551us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:57.491242 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:57.491309 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:57.491431 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:57.493253 (+ 1822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:57.494160 (+ 907us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:57.496164 (+ 2004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:57.496405 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:57.496496 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:57.499914 (+ 3418us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:57.499918 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:57.499921 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:57.499957 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:57.501742 (+ 1785us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:57.502507 (+ 765us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:57.502511 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:57.502512 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:57.502683 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:57.503181 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:57.503187 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:57.503189 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:57.503425 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:57.503547 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:57.504285 (+ 738us) server_negotiation.cc:299] Negotiation successful
0811 15:03:57.504440 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 15:03:57.505654 29074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:57.488942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:35361 (local address 127.19.236.65:39639)
0811 15:03:57.489500 (+ 558us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:57.489548 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:57.490862 (+ 1314us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:57.491673 (+ 811us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:57.491682 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:57.492215 (+ 533us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:57.493057 (+ 842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:57.493084 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:57.494308 (+ 1224us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:57.494313 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:57.496005 (+ 1692us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:57.496015 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:57.496617 (+ 602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:57.496623 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:57.496866 (+ 243us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:57.497674 (+ 808us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:03:57.497697 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:57.499681 (+ 1984us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:57.501852 (+ 2171us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:57.501858 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:57.501904 (+ 46us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:57.502372 (+ 468us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:57.502867 (+ 495us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:57.502871 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:57.502873 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:57.503057 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:57.503567 (+ 510us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:57.503576 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:57.503941 (+ 365us) client_negotiation.cc:769] Sending connection context
0811 15:03:57.504182 (+ 241us) client_negotiation.cc:240] Negotiation successful
0811 15:03:57.504568 (+ 386us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":340,"thread_start_us":149,"threads_started":1}
I20260811 15:03:57.507045 29189 heartbeater.cc:347] Connected to a master server at 127.19.236.126:35361
I20260811 15:03:57.507197 29189 heartbeater.cc:464] Registering TS with master...
I20260811 15:03:57.507812 29189 heartbeater.cc:511] Master 127.19.236.126:35361 requested a full tablet report, sending...
I20260811 15:03:57.509711 28965 ts_manager.cc:194] Registered new tserver with Master: c55114e7834d47eb830087dff4cf5242 (127.19.236.65:39839)
I20260811 15:03:57.511072 28965 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.19.236.65@KRBTEST.COM'} at 127.19.236.65:39639
WARNING: no policy specified for oryx/127.19.236.66@KRBTEST.COM; defaulting to no policy
I20260811 15:03:57.517952 29020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:57.509631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.65:50061 (local address 127.19.236.126:35361)
0811 15:03:57.509755 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:57.509760 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:57.510663 (+ 903us) server_negotiation.cc:407] Connection header received
0811 15:03:57.510759 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:57.510762 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:57.510806 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:57.510878 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:57.511308 (+ 430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:57.511931 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:57.512848 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:57.513078 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:57.513189 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:57.514329 (+ 1140us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:57.514333 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:57.514335 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:57.514359 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:57.516173 (+ 1814us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:57.516695 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:57.516701 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:57.516706 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:57.516801 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:57.517107 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:57.517110 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:57.517112 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:57.517294 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:57.517407 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:57.517676 (+ 269us) server_negotiation.cc:299] Negotiation successful
0811 15:03:57.517788 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 15:03:57.518057 29196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:57.509566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:35361 (local address 127.19.236.65:50061)
0811 15:03:57.510526 (+ 960us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:57.510539 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:57.510671 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:57.510906 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:57.510908 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:57.511087 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:57.511189 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:57.511194 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:57.512067 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:57.512069 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:57.512734 (+ 665us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:57.512743 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:57.513195 (+ 452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:57.513199 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:57.513290 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:57.513843 (+ 553us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:03:57.513855 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:57.514191 (+ 336us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:57.516288 (+ 2097us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:57.516290 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:57.516292 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:57.516519 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:57.516904 (+ 385us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:57.516907 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:57.516909 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:57.517006 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:57.517397 (+ 391us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:57.517400 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:57.517502 (+ 102us) client_negotiation.cc:769] Sending connection context
0811 15:03:57.517614 (+ 112us) client_negotiation.cc:240] Negotiation successful
0811 15:03:57.517764 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":860,"mutex_wait_us":1,"thread_start_us":116,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.19.236.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.19.236.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/krb5kdc/oryx_127.19.236.66.keytab.
Entry for principal oryx/127.19.236.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/krb5kdc/oryx_127.19.236.66.keytab.
I20260811 15:03:57.535724 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.66:0
--local_ip_for_outbound_sockets=127.19.236.66
--webserver_interface=127.19.236.66
--webserver_port=0
--tserver_master_addrs=127.19.236.126:35361
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/krb5kdc/oryx_127.19.236.66.keytab
--principal=oryx/127.19.236.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:38587
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:03:57.654582 29199 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:03:57.654973 29199 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:03:57.655071 29199 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:03:57.659698 29199 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:03:57.659801 29199 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:03:57.659881 29199 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 15:03:57.659966 29199 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.66
I20260811 15:03:57.665750 29199 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:38587
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/krb5kdc/oryx_127.19.236.66.keytab
--principal=oryx/127.19.236.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.236.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.19.236.126:35361
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29199
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.66
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:03:57.666951 29199 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:03:57.668332 29199 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:03:57.679237 29206 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:57.679307 29208 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:57.679307 29199 server_base.cc:1034] running on GCE node
W20260811 15:03:57.679358 29210 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:57.680137 29199 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:03:57.681352 29199 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:03:57.682677 29199 hybrid_clock.cc:648] HybridClock initialized: now 1786460637682593 us; error 59 us; skew 500 ppm
Aug 11 15:03:57 dist-test-slave-8n49 krb5kdc[28912](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460637, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.236.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:03:57.686569 29199 init.cc:377] Logged in from keytab as oryx/127.19.236.66@KRBTEST.COM (short username oryx)
I20260811 15:03:57.687615 29199 webserver.cc:460] Webserver started at http://127.19.236.66:41161/ using document root <none> and password file <none>
I20260811 15:03:57.688249 29199 fs_manager.cc:359] Metadata directory not provided
I20260811 15:03:57.688318 29199 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:03:57.688606 29199 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:03:57.690881 29199 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/minicluster-data/ts-1/data/instance:
uuid: "7986206b93f24bd09dc510b1f308ed19"
format_stamp: "Formatted at 2026-08-11 15:03:57 on dist-test-slave-8n49"
server_key: "1fe91c649c95b533a0e76e2e2a1833fa"
server_key_iv: "f8021a7d2d052980815d30f8208cfc4e"
server_key_version: "encryptionkey@0"
I20260811 15:03:57.691527 29199 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/minicluster-data/ts-1/wal/instance:
uuid: "7986206b93f24bd09dc510b1f308ed19"
format_stamp: "Formatted at 2026-08-11 15:03:57 on dist-test-slave-8n49"
server_key: "1fe91c649c95b533a0e76e2e2a1833fa"
server_key_iv: "f8021a7d2d052980815d30f8208cfc4e"
server_key_version: "encryptionkey@0"
I20260811 15:03:57.695739 29199 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260811 15:03:57.699031 29217 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:57.700876 29199 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 15:03:57.701042 29199 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/minicluster-data/ts-1/wal
uuid: "7986206b93f24bd09dc510b1f308ed19"
format_stamp: "Formatted at 2026-08-11 15:03:57 on dist-test-slave-8n49"
server_key: "1fe91c649c95b533a0e76e2e2a1833fa"
server_key_iv: "f8021a7d2d052980815d30f8208cfc4e"
server_key_version: "encryptionkey@0"
I20260811 15:03:57.701177 29199 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:03:57.716729 29199 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:03:57.720192 29199 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:03:57.720410 29199 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:03:57.721974 29199 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:03:57.722054 29199 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:57.722123 29199 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:03:57.722172 29199 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 15:03:57 dist-test-slave-8n49 krb5kdc[28912](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460637, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.236.66@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM
I20260811 15:03:57.733121 29199 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.66:32837
I20260811 15:03:57.733213 29347 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.66:32837 every 8 connection(s)
I20260811 15:03:57.734261 29199 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
I20260811 15:03:57.736802 29020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:57.722988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.66:51581 (local address 127.19.236.126:35361)
0811 15:03:57.723122 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:57.723126 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:57.724189 (+ 1063us) server_negotiation.cc:407] Connection header received
0811 15:03:57.725319 (+ 1130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:57.725326 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:57.725397 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:57.725507 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:57.727211 (+ 1704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:57.728125 (+ 914us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:57.729953 (+ 1828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:57.730208 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:57.730332 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:57.733177 (+ 2845us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:57.733180 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:57.733182 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:57.733233 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:57.734740 (+ 1507us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:57.735347 (+ 607us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:57.735350 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:57.735352 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:57.735436 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:57.735715 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:57.735717 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:57.735718 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:57.735898 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:57.735975 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:57.736487 (+ 512us) server_negotiation.cc:299] Negotiation successful
0811 15:03:57.736677 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 15:03:57.737599 29228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:57.723519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:35361 (local address 127.19.236.66:51581)
0811 15:03:57.724025 (+ 506us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:57.724069 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:57.725090 (+ 1021us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:57.725753 (+ 663us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:57.725764 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:57.726304 (+ 540us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:57.727023 (+ 719us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:57.727046 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:57.728277 (+ 1231us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:57.728281 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:57.729832 (+ 1551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:57.729846 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:57.730387 (+ 541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:57.730391 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:57.730623 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:57.731323 (+ 700us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:03:57.731343 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:57.732963 (+ 1620us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:57.734893 (+ 1930us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:57.734898 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:57.734914 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:57.735252 (+ 338us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:57.735502 (+ 250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:57.735504 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:57.735505 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:57.735624 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:57.735993 (+ 369us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:57.735998 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:57.736241 (+ 243us) client_negotiation.cc:769] Sending connection context
0811 15:03:57.736391 (+ 150us) client_negotiation.cc:240] Negotiation successful
0811 15:03:57.736714 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":305,"thread_start_us":131,"threads_started":1}
I20260811 15:03:57.738848 29348 heartbeater.cc:347] Connected to a master server at 127.19.236.126:35361
I20260811 15:03:57.739023 29348 heartbeater.cc:464] Registering TS with master...
I20260811 15:03:57.739532 29348 heartbeater.cc:511] Master 127.19.236.126:35361 requested a full tablet report, sending...
I20260811 15:03:57.740665 28964 ts_manager.cc:194] Registered new tserver with Master: 7986206b93f24bd09dc510b1f308ed19 (127.19.236.66:32837)
I20260811 15:03:57.741387 28964 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.19.236.66@KRBTEST.COM'} at 127.19.236.66:51581
I20260811 15:03:57.743781 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 29199
I20260811 15:03:57.743923 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/minicluster-data/ts-1/wal/instance
I20260811 15:03:57.744221 20401 external_mini_cluster.cc:1428] Setting key 35c3364eb6bf9f198acd4404003219d0
I20260811 15:03:57.749094 29356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:57.741311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:35361 (local address 127.19.236.66:58655)
0811 15:03:57.741639 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:57.741655 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:57.741784 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:57.742050 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:57.742053 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:57.742259 (+ 206us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:57.742352 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:57.742357 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:57.743117 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:57.743120 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:57.743705 (+ 585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:57.743713 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:57.744287 (+ 574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:57.744290 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:57.744404 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:57.744957 (+ 553us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:03:57.744969 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:57.745316 (+ 347us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:57.747269 (+ 1953us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:57.747273 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:57.747275 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:57.747487 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:57.747855 (+ 368us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:57.747858 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:57.747860 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:57.747955 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:57.748441 (+ 486us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:57.748444 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:57.748598 (+ 154us) client_negotiation.cc:769] Sending connection context
0811 15:03:57.748731 (+ 133us) client_negotiation.cc:240] Negotiation successful
0811 15:03:57.748901 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":127,"threads_started":1}
I20260811 15:03:57.749080 29020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:57.741388 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.66:58655 (local address 127.19.236.126:35361)
0811 15:03:57.741529 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:57.741533 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:57.741742 (+ 209us) server_negotiation.cc:407] Connection header received
0811 15:03:57.741910 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:57.741913 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:57.741950 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:57.742033 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:57.742476 (+ 443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:57.742983 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:57.743827 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:57.744161 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:57.744270 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:57.745468 (+ 1198us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:57.745473 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:57.745479 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:57.745508 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:57.747131 (+ 1623us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:57.747592 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:57.747596 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:57.747598 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:57.747742 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:57.748053 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:57.748056 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:57.748058 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:57.748328 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:57.748451 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:57.748794 (+ 343us) server_negotiation.cc:299] Negotiation successful
0811 15:03:57.748907 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
WARNING: no policy specified for oryx/127.19.236.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.19.236.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.19.236.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/krb5kdc/oryx_127.19.236.67.keytab.
Entry for principal oryx/127.19.236.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/krb5kdc/oryx_127.19.236.67.keytab.
I20260811 15:03:57.773914 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.67:0
--local_ip_for_outbound_sockets=127.19.236.67
--webserver_interface=127.19.236.67
--webserver_port=0
--tserver_master_addrs=127.19.236.126:35361
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/krb5kdc/oryx_127.19.236.67.keytab
--principal=oryx/127.19.236.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:38587
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:03:57.891003 29359 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:03:57.891324 29359 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:03:57.891405 29359 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:03:57.895668 29359 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:03:57.895766 29359 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:03:57.895841 29359 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 15:03:57.895934 29359 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.67
I20260811 15:03:57.901417 29359 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:38587
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/krb5kdc/oryx_127.19.236.67.keytab
--principal=oryx/127.19.236.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.236.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.19.236.126:35361
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29359
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.67
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:03:57.902596 29359 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:03:57.903679 29359 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:03:57.913910 29365 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:57.914040 29359 server_base.cc:1034] running on GCE node
W20260811 15:03:57.913923 29368 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:03:57.913867 29366 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:03:57.914572 29359 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:03:57.915300 29359 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:03:57.916477 29359 hybrid_clock.cc:648] HybridClock initialized: now 1786460637916457 us; error 33 us; skew 500 ppm
Aug 11 15:03:57 dist-test-slave-8n49 krb5kdc[28912](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460637, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.236.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:03:57.919409 29359 init.cc:377] Logged in from keytab as oryx/127.19.236.67@KRBTEST.COM (short username oryx)
I20260811 15:03:57.920373 29359 webserver.cc:460] Webserver started at http://127.19.236.67:41533/ using document root <none> and password file <none>
I20260811 15:03:57.920997 29359 fs_manager.cc:359] Metadata directory not provided
I20260811 15:03:57.921062 29359 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:03:57.921247 29359 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:03:57.923295 29359 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/minicluster-data/ts-2/data/instance:
uuid: "a3f975537fe340ce88bf33d4bdcb8884"
format_stamp: "Formatted at 2026-08-11 15:03:57 on dist-test-slave-8n49"
server_key: "18df6d563a6f810a27b26cf007a21049"
server_key_iv: "fc1fb9cb05c2eadba1262d10fd0f30a5"
server_key_version: "encryptionkey@0"
I20260811 15:03:57.923830 29359 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/minicluster-data/ts-2/wal/instance:
uuid: "a3f975537fe340ce88bf33d4bdcb8884"
format_stamp: "Formatted at 2026-08-11 15:03:57 on dist-test-slave-8n49"
server_key: "18df6d563a6f810a27b26cf007a21049"
server_key_iv: "fc1fb9cb05c2eadba1262d10fd0f30a5"
server_key_version: "encryptionkey@0"
I20260811 15:03:57.927707 29359 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260811 15:03:57.930219 29375 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:57.931512 29359 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 15:03:57.931655 29359 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/minicluster-data/ts-2/wal
uuid: "a3f975537fe340ce88bf33d4bdcb8884"
format_stamp: "Formatted at 2026-08-11 15:03:57 on dist-test-slave-8n49"
server_key: "18df6d563a6f810a27b26cf007a21049"
server_key_iv: "fc1fb9cb05c2eadba1262d10fd0f30a5"
server_key_version: "encryptionkey@0"
I20260811 15:03:57.931775 29359 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:03:57.960278 29359 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:03:57.964237 29359 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:03:57.964524 29359 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:03:57.966290 29359 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:03:57.966369 29359 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:03:57.966442 29359 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:03:57.966473 29359 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 15:03:57 dist-test-slave-8n49 krb5kdc[28912](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460637, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.236.67@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM
I20260811 15:03:57.977720 29359 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.67:45119
I20260811 15:03:57.977777 29498 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.67:45119 every 8 connection(s)
I20260811 15:03:57.978688 29359 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
I20260811 15:03:57.981838 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 29359
I20260811 15:03:57.981998 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/minicluster-data/ts-2/wal/instance
I20260811 15:03:57.982229 29020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:57.967151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.67:37893 (local address 127.19.236.126:35361)
0811 15:03:57.967336 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:57.967343 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:57.968197 (+ 854us) server_negotiation.cc:407] Connection header received
0811 15:03:57.969415 (+ 1218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:57.969421 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:57.969493 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:57.969559 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:57.971556 (+ 1997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:57.972474 (+ 918us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:57.974481 (+ 2007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:57.974723 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:57.974812 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:57.978196 (+ 3384us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:57.978200 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:57.978202 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:57.978238 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:57.979968 (+ 1730us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:57.980526 (+ 558us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:57.980529 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:57.980530 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:57.980673 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:57.981018 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:57.981021 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:57.981023 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:57.981243 (+ 220us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:57.981335 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:57.981875 (+ 540us) server_negotiation.cc:299] Negotiation successful
0811 15:03:57.982048 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 15:03:57.982373 20401 external_mini_cluster.cc:1428] Setting key 32f5477c1045ab200d9846da2d883a63
I20260811 15:03:57.983019 29386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:57.967556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:35361 (local address 127.19.236.67:37893)
0811 15:03:57.968021 (+ 465us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:57.968074 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:57.969145 (+ 1071us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:57.970005 (+ 860us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:57.970017 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:57.970537 (+ 520us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:57.971268 (+ 731us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:57.971292 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:57.972677 (+ 1385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:57.972681 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:57.974305 (+ 1624us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:57.974322 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:57.974911 (+ 589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:57.974917 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:57.975146 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:57.976028 (+ 882us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:03:57.976056 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:57.978010 (+ 1954us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:57.980100 (+ 2090us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:57.980108 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:57.980127 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:57.980428 (+ 301us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:57.980759 (+ 331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:57.980761 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:57.980762 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:57.980894 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:57.981343 (+ 449us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:57.981348 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:57.981603 (+ 255us) client_negotiation.cc:769] Sending connection context
0811 15:03:57.981759 (+ 156us) client_negotiation.cc:240] Negotiation successful
0811 15:03:57.982086 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":264,"thread_start_us":133,"threads_started":1}
I20260811 15:03:57.984351 29499 heartbeater.cc:347] Connected to a master server at 127.19.236.126:35361
I20260811 15:03:57.984503 29499 heartbeater.cc:464] Registering TS with master...
I20260811 15:03:57.985112 29499 heartbeater.cc:511] Master 127.19.236.126:35361 requested a full tablet report, sending...
I20260811 15:03:57.986254 28964 ts_manager.cc:194] Registered new tserver with Master: a3f975537fe340ce88bf33d4bdcb8884 (127.19.236.67:45119)
I20260811 15:03:57.986891 28964 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.19.236.67@KRBTEST.COM'} at 127.19.236.67:37893
I20260811 15:03:57.995692 29506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:57.986907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:35361 (local address 127.19.236.67:33649)
0811 15:03:57.987393 (+ 486us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:57.987408 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:57.987530 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:57.988848 (+ 1318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:57.988851 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:57.989058 (+ 207us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:57.989173 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:57.989178 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:57.990022 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:57.990025 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:57.990592 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:57.990600 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:57.991060 (+ 460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:57.991062 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:57.991133 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:57.991708 (+ 575us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:03:57.991720 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:57.992046 (+ 326us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:57.993983 (+ 1937us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:57.993990 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:57.993992 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:57.994194 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:57.994525 (+ 331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:57.994528 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:57.994529 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:57.994638 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:57.995093 (+ 455us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:57.995097 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:57.995200 (+ 103us) client_negotiation.cc:769] Sending connection context
0811 15:03:57.995312 (+ 112us) client_negotiation.cc:240] Negotiation successful
0811 15:03:57.995471 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":385,"thread_start_us":132,"threads_started":1}
I20260811 15:03:57.995683 29020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:57.986966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.67:33649 (local address 127.19.236.126:35361)
0811 15:03:57.987222 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:57.987226 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:57.987488 (+ 262us) server_negotiation.cc:407] Connection header received
0811 15:03:57.988665 (+ 1177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:57.988668 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:57.988718 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:57.988805 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:57.989306 (+ 501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:57.989854 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:57.990721 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:57.990948 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:57.991039 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:57.992191 (+ 1152us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:57.992194 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:57.992196 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:57.992219 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:57.993857 (+ 1638us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:57.994310 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:57.994314 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:57.994315 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:57.994404 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:57.994753 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:57.994757 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:57.994759 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:57.994962 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:57.995103 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:57.995395 (+ 292us) server_negotiation.cc:299] Negotiation successful
0811 15:03:57.995517 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":167}
I20260811 15:03:57.996909 20401 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 15:03:58 dist-test-slave-8n49 krb5kdc[28912](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460638, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 15:03:58 dist-test-slave-8n49 krb5kdc[28912](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 15:03:58 dist-test-slave-8n49 krb5kdc[28912](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
W20260811 15:03:58.023799 29020 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:03:58.017337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56332 (local address 127.19.236.126:35361)
0811 15:03:58.017480 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:58.017484 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:58.017496 (+ 12us) server_negotiation.cc:407] Connection header received
0811 15:03:58.017539 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:58.017542 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:58.017581 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:58.017680 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:58.018475 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:58.019029 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:58.019884 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:58.020114 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:58.020210 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:58.023665 (+ 3455us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56332: BlockingRecv error: recv got EOF from 127.0.0.1:56332 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Aug 11 15:03:58 dist-test-slave-8n49 krb5kdc[28912](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460638, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM
I20260811 15:03:58.033926 29020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:58.025357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56340 (local address 127.19.236.126:35361)
0811 15:03:58.025496 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:58.025500 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:58.025601 (+ 101us) server_negotiation.cc:407] Connection header received
0811 15:03:58.025724 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:58.025733 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:58.025776 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:58.025865 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:58.026481 (+ 616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:58.027098 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:58.027986 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:58.028214 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:58.028327 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:58.030790 (+ 2463us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:58.030795 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:58.030798 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:58.030830 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:58.032226 (+ 1396us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:58.032736 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:58.032738 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:58.032739 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:58.032818 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:58.033124 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:58.033127 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:58.033128 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:58.033342 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:58.033467 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:58.033677 (+ 210us) server_negotiation.cc:299] Negotiation successful
0811 15:03:58.033782 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 15:03:58.037268 28965 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56340:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 15:03:58.040621 28965 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 15:03:58.054960 29524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:58.049087 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49290 (local address 127.19.236.66:32837)
0811 15:03:58.049650 (+ 563us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:58.049665 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:58.049742 (+ 77us) server_negotiation.cc:407] Connection header received
0811 15:03:58.049965 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:58.049971 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:58.050188 (+ 217us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:58.050340 (+ 152us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:03:58.050839 (+ 499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:58.051983 (+ 1144us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:58.053671 (+ 1688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:58.054265 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:58.054399 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:58.054576 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:58.054699 (+ 123us) server_negotiation.cc:299] Negotiation successful
0811 15:03:58.054795 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":465,"thread_start_us":115,"threads_started":1}
I20260811 15:03:58.054949 29523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:58.048941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.66:32837 (local address 127.0.0.1:49290)
0811 15:03:58.049591 (+ 650us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:58.049644 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:58.049803 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:58.050519 (+ 716us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:58.050525 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:58.050555 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:03:58.050703 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:58.050710 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:58.052114 (+ 1404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:58.052121 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:58.053545 (+ 1424us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:58.053555 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:58.054405 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:58.054408 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:58.054515 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:58.054557 (+ 42us) client_negotiation.cc:769] Sending connection context
0811 15:03:58.054671 (+ 114us) client_negotiation.cc:240] Negotiation successful
0811 15:03:58.054795 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":449,"mutex_wait_us":104,"thread_start_us":89,"threads_started":1}
I20260811 15:03:58.055414 29525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:58.049084 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.65:39839 (local address 127.0.0.1:34464)
0811 15:03:58.050447 (+ 1363us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:58.050461 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:58.050539 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:58.051222 (+ 683us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:58.051225 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:58.051244 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:03:58.051327 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:58.051332 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:58.052855 (+ 1523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:58.052858 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:58.053960 (+ 1102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:58.053970 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:58.055013 (+ 1043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:58.055020 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:58.055133 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:58.055151 (+ 18us) client_negotiation.cc:769] Sending connection context
0811 15:03:58.055195 (+ 44us) client_negotiation.cc:240] Negotiation successful
0811 15:03:58.055255 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1300,"thread_start_us":117,"threads_started":1}
I20260811 15:03:58.055624 29526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:58.049649 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.67:45119 (local address 127.0.0.1:47390)
0811 15:03:58.050537 (+ 888us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:58.050551 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:58.050646 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:58.051100 (+ 454us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:58.051103 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:58.051122 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:03:58.051215 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:58.051224 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:58.052201 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:58.052205 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:58.053572 (+ 1367us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:58.053583 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:58.054833 (+ 1250us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:58.054837 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:58.054938 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:58.054975 (+ 37us) client_negotiation.cc:769] Sending connection context
0811 15:03:58.055041 (+ 66us) client_negotiation.cc:240] Negotiation successful
0811 15:03:58.055482 (+ 441us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":815,"mutex_wait_us":1,"thread_start_us":98,"threads_started":1}
I20260811 15:03:58.056023 29527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:58.049841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47390 (local address 127.19.236.67:45119)
0811 15:03:58.050388 (+ 547us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:58.050400 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:58.050746 (+ 346us) server_negotiation.cc:407] Connection header received
0811 15:03:58.050829 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:58.050833 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:58.050968 (+ 135us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:58.051121 (+ 153us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:03:58.051343 (+ 222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:58.052076 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:58.053714 (+ 1638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:58.054496 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:58.054611 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:58.054765 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:58.055796 (+ 1031us) server_negotiation.cc:299] Negotiation successful
0811 15:03:58.055888 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":445,"thread_start_us":119,"threads_started":1}
I20260811 15:03:58.058305 29428 tablet_service.cc:1467] Processing CreateTablet for tablet 0b28973ab83347369fd701df1d3578ca (DEFAULT_TABLE table=test-table [id=f6cb7da7cff94d6987201a43be52eb19]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:03:58.058301 29275 tablet_service.cc:1467] Processing CreateTablet for tablet 0b28973ab83347369fd701df1d3578ca (DEFAULT_TABLE table=test-table [id=f6cb7da7cff94d6987201a43be52eb19]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:03:58.058848 29529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:58.050076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34464 (local address 127.19.236.65:39839)
0811 15:03:58.050779 (+ 703us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:58.050785 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:58.050807 (+ 22us) server_negotiation.cc:407] Connection header received
0811 15:03:58.050879 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:58.050886 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:58.051071 (+ 185us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:58.051458 (+ 387us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:03:58.051587 (+ 129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:58.052722 (+ 1135us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:58.054122 (+ 1400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:58.054882 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:58.056371 (+ 1489us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:58.056506 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:58.056584 (+ 78us) server_negotiation.cc:299] Negotiation successful
0811 15:03:58.056672 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":593,"thread_start_us":110,"threads_started":1}
I20260811 15:03:58.059371 29275 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0b28973ab83347369fd701df1d3578ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:03:58.059383 29428 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0b28973ab83347369fd701df1d3578ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:03:58.061496 29117 tablet_service.cc:1467] Processing CreateTablet for tablet 0b28973ab83347369fd701df1d3578ca (DEFAULT_TABLE table=test-table [id=f6cb7da7cff94d6987201a43be52eb19]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:03:58.062546 29117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0b28973ab83347369fd701df1d3578ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:03:58.066857 29531 tablet_bootstrap.cc:492] T 0b28973ab83347369fd701df1d3578ca P 7986206b93f24bd09dc510b1f308ed19: Bootstrap starting.
I20260811 15:03:58.068334 29532 tablet_bootstrap.cc:492] T 0b28973ab83347369fd701df1d3578ca P a3f975537fe340ce88bf33d4bdcb8884: Bootstrap starting.
I20260811 15:03:58.069213 29531 tablet_bootstrap.cc:654] T 0b28973ab83347369fd701df1d3578ca P 7986206b93f24bd09dc510b1f308ed19: Neither blocks nor log segments found. Creating new log.
I20260811 15:03:58.069741 29533 tablet_bootstrap.cc:492] T 0b28973ab83347369fd701df1d3578ca P c55114e7834d47eb830087dff4cf5242: Bootstrap starting.
I20260811 15:03:58.070170 29531 log.cc:824] T 0b28973ab83347369fd701df1d3578ca P 7986206b93f24bd09dc510b1f308ed19: Log is configured to *not* fsync() on all Append() calls
I20260811 15:03:58.070648 29532 tablet_bootstrap.cc:654] T 0b28973ab83347369fd701df1d3578ca P a3f975537fe340ce88bf33d4bdcb8884: Neither blocks nor log segments found. Creating new log.
I20260811 15:03:58.071570 29532 log.cc:824] T 0b28973ab83347369fd701df1d3578ca P a3f975537fe340ce88bf33d4bdcb8884: Log is configured to *not* fsync() on all Append() calls
I20260811 15:03:58.071836 29533 tablet_bootstrap.cc:654] T 0b28973ab83347369fd701df1d3578ca P c55114e7834d47eb830087dff4cf5242: Neither blocks nor log segments found. Creating new log.
I20260811 15:03:58.072693 29533 log.cc:824] T 0b28973ab83347369fd701df1d3578ca P c55114e7834d47eb830087dff4cf5242: Log is configured to *not* fsync() on all Append() calls
I20260811 15:03:58.072746 29531 tablet_bootstrap.cc:492] T 0b28973ab83347369fd701df1d3578ca P 7986206b93f24bd09dc510b1f308ed19: No bootstrap required, opened a new log
I20260811 15:03:58.072928 29531 ts_tablet_manager.cc:1397] T 0b28973ab83347369fd701df1d3578ca P 7986206b93f24bd09dc510b1f308ed19: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260811 15:03:58.073633 29532 tablet_bootstrap.cc:492] T 0b28973ab83347369fd701df1d3578ca P a3f975537fe340ce88bf33d4bdcb8884: No bootstrap required, opened a new log
I20260811 15:03:58.073818 29532 ts_tablet_manager.cc:1397] T 0b28973ab83347369fd701df1d3578ca P a3f975537fe340ce88bf33d4bdcb8884: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260811 15:03:58.077028 29531 raft_consensus.cc:348] T 0b28973ab83347369fd701df1d3578ca P 7986206b93f24bd09dc510b1f308ed19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7986206b93f24bd09dc510b1f308ed19" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 32837 } } peers { permanent_uuid: "c55114e7834d47eb830087dff4cf5242" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 39839 } } peers { permanent_uuid: "a3f975537fe340ce88bf33d4bdcb8884" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 45119 } }
I20260811 15:03:58.077857 29531 raft_consensus.cc:374] T 0b28973ab83347369fd701df1d3578ca P 7986206b93f24bd09dc510b1f308ed19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:03:58.077682 29532 raft_consensus.cc:348] T 0b28973ab83347369fd701df1d3578ca P a3f975537fe340ce88bf33d4bdcb8884 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7986206b93f24bd09dc510b1f308ed19" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 32837 } } peers { permanent_uuid: "c55114e7834d47eb830087dff4cf5242" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 39839 } } peers { permanent_uuid: "a3f975537fe340ce88bf33d4bdcb8884" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 45119 } }
I20260811 15:03:58.077934 29532 raft_consensus.cc:374] T 0b28973ab83347369fd701df1d3578ca P a3f975537fe340ce88bf33d4bdcb8884 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:03:58.077960 29531 raft_consensus.cc:729] T 0b28973ab83347369fd701df1d3578ca P 7986206b93f24bd09dc510b1f308ed19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7986206b93f24bd09dc510b1f308ed19, State: Initialized, Role: FOLLOWER
I20260811 15:03:58.078011 29532 raft_consensus.cc:729] T 0b28973ab83347369fd701df1d3578ca P a3f975537fe340ce88bf33d4bdcb8884 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3f975537fe340ce88bf33d4bdcb8884, State: Initialized, Role: FOLLOWER
I20260811 15:03:58.078249 29533 tablet_bootstrap.cc:492] T 0b28973ab83347369fd701df1d3578ca P c55114e7834d47eb830087dff4cf5242: No bootstrap required, opened a new log
I20260811 15:03:58.078531 29533 ts_tablet_manager.cc:1397] T 0b28973ab83347369fd701df1d3578ca P c55114e7834d47eb830087dff4cf5242: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.005s
I20260811 15:03:58.078473 29532 consensus_queue.cc:260] T 0b28973ab83347369fd701df1d3578ca P a3f975537fe340ce88bf33d4bdcb8884 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7986206b93f24bd09dc510b1f308ed19" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 32837 } } peers { permanent_uuid: "c55114e7834d47eb830087dff4cf5242" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 39839 } } peers { permanent_uuid: "a3f975537fe340ce88bf33d4bdcb8884" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 45119 } }
I20260811 15:03:58.078473 29531 consensus_queue.cc:260] T 0b28973ab83347369fd701df1d3578ca P 7986206b93f24bd09dc510b1f308ed19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7986206b93f24bd09dc510b1f308ed19" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 32837 } } peers { permanent_uuid: "c55114e7834d47eb830087dff4cf5242" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 39839 } } peers { permanent_uuid: "a3f975537fe340ce88bf33d4bdcb8884" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 45119 } }
I20260811 15:03:58.079259 29499 heartbeater.cc:503] Master 127.19.236.126:35361 was elected leader, sending a full tablet report...
I20260811 15:03:58.079579 29531 ts_tablet_manager.cc:1428] T 0b28973ab83347369fd701df1d3578ca P 7986206b93f24bd09dc510b1f308ed19: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260811 15:03:58.080360 29348 heartbeater.cc:503] Master 127.19.236.126:35361 was elected leader, sending a full tablet report...
I20260811 15:03:58.081036 29532 ts_tablet_manager.cc:1428] T 0b28973ab83347369fd701df1d3578ca P a3f975537fe340ce88bf33d4bdcb8884: Time spent starting tablet: real 0.007s user 0.003s sys 0.003s
I20260811 15:03:58.082551 29533 raft_consensus.cc:348] T 0b28973ab83347369fd701df1d3578ca P c55114e7834d47eb830087dff4cf5242 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7986206b93f24bd09dc510b1f308ed19" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 32837 } } peers { permanent_uuid: "c55114e7834d47eb830087dff4cf5242" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 39839 } } peers { permanent_uuid: "a3f975537fe340ce88bf33d4bdcb8884" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 45119 } }
I20260811 15:03:58.082854 29533 raft_consensus.cc:374] T 0b28973ab83347369fd701df1d3578ca P c55114e7834d47eb830087dff4cf5242 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:03:58.082921 29533 raft_consensus.cc:729] T 0b28973ab83347369fd701df1d3578ca P c55114e7834d47eb830087dff4cf5242 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c55114e7834d47eb830087dff4cf5242, State: Initialized, Role: FOLLOWER
I20260811 15:03:58.083326 29533 consensus_queue.cc:260] T 0b28973ab83347369fd701df1d3578ca P c55114e7834d47eb830087dff4cf5242 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7986206b93f24bd09dc510b1f308ed19" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 32837 } } peers { permanent_uuid: "c55114e7834d47eb830087dff4cf5242" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 39839 } } peers { permanent_uuid: "a3f975537fe340ce88bf33d4bdcb8884" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 45119 } }
I20260811 15:03:58.083572 29538 raft_consensus.cc:482] T 0b28973ab83347369fd701df1d3578ca P a3f975537fe340ce88bf33d4bdcb8884 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 15:03:58.084008 29189 heartbeater.cc:503] Master 127.19.236.126:35361 was elected leader, sending a full tablet report...
I20260811 15:03:58.084399 29533 ts_tablet_manager.cc:1428] T 0b28973ab83347369fd701df1d3578ca P c55114e7834d47eb830087dff4cf5242: Time spent starting tablet: real 0.006s user 0.005s sys 0.001s
I20260811 15:03:58.083782 29538 raft_consensus.cc:504] T 0b28973ab83347369fd701df1d3578ca P a3f975537fe340ce88bf33d4bdcb8884 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7986206b93f24bd09dc510b1f308ed19" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 32837 } } peers { permanent_uuid: "c55114e7834d47eb830087dff4cf5242" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 39839 } } peers { permanent_uuid: "a3f975537fe340ce88bf33d4bdcb8884" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 45119 } }
I20260811 15:03:58.085760 29538 leader_election.cc:288] T 0b28973ab83347369fd701df1d3578ca P a3f975537fe340ce88bf33d4bdcb8884 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7986206b93f24bd09dc510b1f308ed19 (127.19.236.66:32837), c55114e7834d47eb830087dff4cf5242 (127.19.236.65:39839)
I20260811 15:03:58.089773 29524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:58.086096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.67:50781 (local address 127.19.236.66:32837)
0811 15:03:58.086363 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:58.086367 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:58.086381 (+ 14us) server_negotiation.cc:407] Connection header received
0811 15:03:58.086428 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:58.086431 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:58.086493 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:58.086565 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:03:58.086908 (+ 343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:58.087646 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:58.088821 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:58.089211 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:58.089339 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:58.089395 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:58.089593 (+ 198us) server_negotiation.cc:299] Negotiation successful
0811 15:03:58.089664 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":184}
I20260811 15:03:58.089773 29386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:58.085962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.66:32837 (local address 127.19.236.67:50781)
0811 15:03:58.086090 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:58.086107 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:58.086195 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:58.086688 (+ 493us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:58.086690 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:58.086705 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:03:58.086797 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:58.086801 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:58.087760 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:58.087763 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:58.088701 (+ 938us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:58.088711 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:58.089333 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:58.089337 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:58.089464 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:58.089482 (+ 18us) client_negotiation.cc:769] Sending connection context
0811 15:03:58.089566 (+ 84us) client_negotiation.cc:240] Negotiation successful
0811 15:03:58.089642 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
I20260811 15:03:58.090348 29299 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b28973ab83347369fd701df1d3578ca" candidate_uuid: "a3f975537fe340ce88bf33d4bdcb8884" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7986206b93f24bd09dc510b1f308ed19" is_pre_election: true
I20260811 15:03:58.090487 29540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:58.086023 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.65:39839 (local address 127.19.236.67:36365)
0811 15:03:58.086361 (+ 338us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:58.086377 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:58.086476 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:58.086754 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:58.086757 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:58.086775 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:03:58.086899 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:58.086906 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:58.087859 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:58.087863 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:58.089210 (+ 1347us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:58.089220 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:58.090003 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:58.090007 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:58.090132 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:58.090154 (+ 22us) client_negotiation.cc:769] Sending connection context
0811 15:03:58.090270 (+ 116us) client_negotiation.cc:240] Negotiation successful
0811 15:03:58.090335 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":142,"threads_started":1}
I20260811 15:03:58.090631 29529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:58.086434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.67:36365 (local address 127.19.236.65:39839)
0811 15:03:58.086561 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:58.086565 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:58.086577 (+ 12us) server_negotiation.cc:407] Connection header received
0811 15:03:58.086616 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:58.086618 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:58.086659 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:58.086741 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:03:58.087030 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:58.087702 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:58.089338 (+ 1636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:58.089752 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:58.089886 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:58.089943 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:58.090329 (+ 386us) server_negotiation.cc:299] Negotiation successful
0811 15:03:58.090399 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 15:03:58.090667 29299 raft_consensus.cc:2454] T 0b28973ab83347369fd701df1d3578ca P 7986206b93f24bd09dc510b1f308ed19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3f975537fe340ce88bf33d4bdcb8884 in term 0.
I20260811 15:03:58.091153 29142 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b28973ab83347369fd701df1d3578ca" candidate_uuid: "a3f975537fe340ce88bf33d4bdcb8884" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c55114e7834d47eb830087dff4cf5242" is_pre_election: true
I20260811 15:03:58.091185 29380 leader_election.cc:302] T 0b28973ab83347369fd701df1d3578ca P a3f975537fe340ce88bf33d4bdcb8884 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7986206b93f24bd09dc510b1f308ed19, a3f975537fe340ce88bf33d4bdcb8884; no voters:
I20260811 15:03:58.091403 29142 raft_consensus.cc:2454] T 0b28973ab83347369fd701df1d3578ca P c55114e7834d47eb830087dff4cf5242 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3f975537fe340ce88bf33d4bdcb8884 in term 0.
I20260811 15:03:58.091459 29538 raft_consensus.cc:2781] T 0b28973ab83347369fd701df1d3578ca P a3f975537fe340ce88bf33d4bdcb8884 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 15:03:58.091574 29538 raft_consensus.cc:482] T 0b28973ab83347369fd701df1d3578ca P a3f975537fe340ce88bf33d4bdcb8884 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 15:03:58.091622 29538 raft_consensus.cc:3037] T 0b28973ab83347369fd701df1d3578ca P a3f975537fe340ce88bf33d4bdcb8884 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:03:58.092769 29538 raft_consensus.cc:504] T 0b28973ab83347369fd701df1d3578ca P a3f975537fe340ce88bf33d4bdcb8884 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7986206b93f24bd09dc510b1f308ed19" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 32837 } } peers { permanent_uuid: "c55114e7834d47eb830087dff4cf5242" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 39839 } } peers { permanent_uuid: "a3f975537fe340ce88bf33d4bdcb8884" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 45119 } }
I20260811 15:03:58.093123 29538 leader_election.cc:288] T 0b28973ab83347369fd701df1d3578ca P a3f975537fe340ce88bf33d4bdcb8884 [CANDIDATE]: Term 1 election: Requested vote from peers 7986206b93f24bd09dc510b1f308ed19 (127.19.236.66:32837), c55114e7834d47eb830087dff4cf5242 (127.19.236.65:39839)
I20260811 15:03:58.093544 29299 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b28973ab83347369fd701df1d3578ca" candidate_uuid: "a3f975537fe340ce88bf33d4bdcb8884" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7986206b93f24bd09dc510b1f308ed19"
I20260811 15:03:58.093640 29142 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b28973ab83347369fd701df1d3578ca" candidate_uuid: "a3f975537fe340ce88bf33d4bdcb8884" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c55114e7834d47eb830087dff4cf5242"
I20260811 15:03:58.093684 29299 raft_consensus.cc:3037] T 0b28973ab83347369fd701df1d3578ca P 7986206b93f24bd09dc510b1f308ed19 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:03:58.093756 29142 raft_consensus.cc:3037] T 0b28973ab83347369fd701df1d3578ca P c55114e7834d47eb830087dff4cf5242 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:03:58.095052 29142 raft_consensus.cc:2454] T 0b28973ab83347369fd701df1d3578ca P c55114e7834d47eb830087dff4cf5242 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3f975537fe340ce88bf33d4bdcb8884 in term 1.
I20260811 15:03:58.095052 29299 raft_consensus.cc:2454] T 0b28973ab83347369fd701df1d3578ca P 7986206b93f24bd09dc510b1f308ed19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3f975537fe340ce88bf33d4bdcb8884 in term 1.
I20260811 15:03:58.095352 29379 leader_election.cc:302] T 0b28973ab83347369fd701df1d3578ca P a3f975537fe340ce88bf33d4bdcb8884 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a3f975537fe340ce88bf33d4bdcb8884, c55114e7834d47eb830087dff4cf5242; no voters:
I20260811 15:03:58.095536 29538 raft_consensus.cc:2781] T 0b28973ab83347369fd701df1d3578ca P a3f975537fe340ce88bf33d4bdcb8884 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:03:58.095767 29538 raft_consensus.cc:686] T 0b28973ab83347369fd701df1d3578ca P a3f975537fe340ce88bf33d4bdcb8884 [term 1 LEADER]: Becoming Leader. State: Replica: a3f975537fe340ce88bf33d4bdcb8884, State: Running, Role: LEADER
I20260811 15:03:58.096112 29538 consensus_queue.cc:237] T 0b28973ab83347369fd701df1d3578ca P a3f975537fe340ce88bf33d4bdcb8884 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7986206b93f24bd09dc510b1f308ed19" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 32837 } } peers { permanent_uuid: "c55114e7834d47eb830087dff4cf5242" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 39839 } } peers { permanent_uuid: "a3f975537fe340ce88bf33d4bdcb8884" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 45119 } }
I20260811 15:03:58.099620 28964 catalog_manager.cc:5495] T 0b28973ab83347369fd701df1d3578ca P a3f975537fe340ce88bf33d4bdcb8884 reported cstate change: term changed from 0 to 1, leader changed from <none> to a3f975537fe340ce88bf33d4bdcb8884 (127.19.236.67). New cstate: current_term: 1 leader_uuid: "a3f975537fe340ce88bf33d4bdcb8884" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7986206b93f24bd09dc510b1f308ed19" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 32837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c55114e7834d47eb830087dff4cf5242" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 39839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3f975537fe340ce88bf33d4bdcb8884" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 45119 } health_report { overall_health: HEALTHY } } }
I20260811 15:03:58.118597 29527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:58.114853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47400 (local address 127.19.236.67:45119)
0811 15:03:58.114998 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:58.115002 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:58.115018 (+ 16us) server_negotiation.cc:407] Connection header received
0811 15:03:58.115150 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:58.115152 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:58.115267 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:58.115354 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 15:03:58.115611 (+ 257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:58.116188 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:58.117178 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:58.117438 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:58.117529 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:58.117762 (+ 233us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 15:03:58.118186 (+ 424us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 15:03:58.118271 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:58.118334 (+ 63us) server_negotiation.cc:299] Negotiation successful
0811 15:03:58.118387 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 15:03:58.124931 29142 raft_consensus.cc:1261] T 0b28973ab83347369fd701df1d3578ca P c55114e7834d47eb830087dff4cf5242 [term 1 FOLLOWER]: Refusing update from remote peer a3f975537fe340ce88bf33d4bdcb8884: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:03:58.125154 29299 raft_consensus.cc:1261] T 0b28973ab83347369fd701df1d3578ca P 7986206b93f24bd09dc510b1f308ed19 [term 1 FOLLOWER]: Refusing update from remote peer a3f975537fe340ce88bf33d4bdcb8884: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:03:58.125819 29538 consensus_queue.cc:1035] T 0b28973ab83347369fd701df1d3578ca P a3f975537fe340ce88bf33d4bdcb8884 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c55114e7834d47eb830087dff4cf5242" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 39839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:03:58.126083 29541 consensus_queue.cc:1035] T 0b28973ab83347369fd701df1d3578ca P a3f975537fe340ce88bf33d4bdcb8884 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7986206b93f24bd09dc510b1f308ed19" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 32837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:03:58.133941 29545 mvcc.cc:205] Tried to move back new op lower bound from 7317342773751234560 to 7317342773644771328. Current Snapshot: MvccSnapshot[applied={T|T < 7317342773751234560}]
I20260811 15:03:58.136217 29546 mvcc.cc:205] Tried to move back new op lower bound from 7317342773751234560 to 7317342773644771328. Current Snapshot: MvccSnapshot[applied={T|T < 7317342773751234560}]
I20260811 15:03:58.144471 28965 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56340:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 15:03:58.144702 28965 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56340:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 15:03:58.147282 28965 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 310341f977fe4f90ad0e21aa6f2495d7: Sending DeleteTablet for 3 replicas of tablet 0b28973ab83347369fd701df1d3578ca
I20260811 15:03:58.148227 29117 tablet_service.cc:1514] Processing DeleteTablet for tablet 0b28973ab83347369fd701df1d3578ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:03:58 UTC) from {username='oryx', principal='oryx/127.19.236.126@KRBTEST.COM'} at 127.0.0.1:34464
I20260811 15:03:58.148830 29553 tablet_replica.cc:330] T 0b28973ab83347369fd701df1d3578ca P c55114e7834d47eb830087dff4cf5242: stopping tablet replica
I20260811 15:03:58.148855 29275 tablet_service.cc:1514] Processing DeleteTablet for tablet 0b28973ab83347369fd701df1d3578ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:03:58 UTC) from {username='oryx', principal='oryx/127.19.236.126@KRBTEST.COM'} at 127.0.0.1:49290
I20260811 15:03:58.148901 29428 tablet_service.cc:1514] Processing DeleteTablet for tablet 0b28973ab83347369fd701df1d3578ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:03:58 UTC) from {username='oryx', principal='oryx/127.19.236.126@KRBTEST.COM'} at 127.0.0.1:47390
I20260811 15:03:58.149259 29553 raft_consensus.cc:2229] T 0b28973ab83347369fd701df1d3578ca P c55114e7834d47eb830087dff4cf5242 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 15:03:58.149506 29554 tablet_replica.cc:330] T 0b28973ab83347369fd701df1d3578ca P 7986206b93f24bd09dc510b1f308ed19: stopping tablet replica
I20260811 15:03:58.149514 28965 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56340:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 15:03:58.149652 29553 raft_consensus.cc:2258] T 0b28973ab83347369fd701df1d3578ca P c55114e7834d47eb830087dff4cf5242 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:03:58.149744 29555 tablet_replica.cc:330] T 0b28973ab83347369fd701df1d3578ca P a3f975537fe340ce88bf33d4bdcb8884: stopping tablet replica
W20260811 15:03:58.149981 28965 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 15:03:58.150231 29554 raft_consensus.cc:2229] T 0b28973ab83347369fd701df1d3578ca P 7986206b93f24bd09dc510b1f308ed19 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 15:03:58.150532 29554 raft_consensus.cc:2258] T 0b28973ab83347369fd701df1d3578ca P 7986206b93f24bd09dc510b1f308ed19 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:03:58.150929 29555 raft_consensus.cc:2229] T 0b28973ab83347369fd701df1d3578ca P a3f975537fe340ce88bf33d4bdcb8884 [term 1 LEADER]: Raft consensus shutting down.
I20260811 15:03:58.151239 29553 ts_tablet_manager.cc:1905] T 0b28973ab83347369fd701df1d3578ca P c55114e7834d47eb830087dff4cf5242: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 15:03:58.151345 29555 raft_consensus.cc:2258] T 0b28973ab83347369fd701df1d3578ca P a3f975537fe340ce88bf33d4bdcb8884 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:03:58.154757 29553 ts_tablet_manager.cc:1918] T 0b28973ab83347369fd701df1d3578ca P c55114e7834d47eb830087dff4cf5242: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 15:03:58.154937 29553 log.cc:1196] T 0b28973ab83347369fd701df1d3578ca P c55114e7834d47eb830087dff4cf5242: Deleting WAL directory at /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/minicluster-data/ts-0/wal/wals/0b28973ab83347369fd701df1d3578ca
I20260811 15:03:58.155483 29553 ts_tablet_manager.cc:1939] T 0b28973ab83347369fd701df1d3578ca P c55114e7834d47eb830087dff4cf5242: Deleting consensus metadata
I20260811 15:03:58.155715 29117 tablet_service.cc:1467] Processing CreateTablet for tablet 80923b2c71f84dba9a8a92b777b3eb32 (DEFAULT_TABLE table=test-table [id=3ec31ce181404114a2129ce783ac5a53]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:03:58.155874 29428 tablet_service.cc:1467] Processing CreateTablet for tablet 80923b2c71f84dba9a8a92b777b3eb32 (DEFAULT_TABLE table=test-table [id=3ec31ce181404114a2129ce783ac5a53]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:03:58.156002 29117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 80923b2c71f84dba9a8a92b777b3eb32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:03:58.156117 29428 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 80923b2c71f84dba9a8a92b777b3eb32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:03:58.158349 29533 tablet_bootstrap.cc:492] T 80923b2c71f84dba9a8a92b777b3eb32 P c55114e7834d47eb830087dff4cf5242: Bootstrap starting.
I20260811 15:03:58.158602 28950 catalog_manager.cc:4841] TS c55114e7834d47eb830087dff4cf5242 (127.19.236.65:39839): tablet 0b28973ab83347369fd701df1d3578ca (table test-table [id=f6cb7da7cff94d6987201a43be52eb19]) successfully deleted
I20260811 15:03:58.158733 29532 tablet_bootstrap.cc:492] T 80923b2c71f84dba9a8a92b777b3eb32 P a3f975537fe340ce88bf33d4bdcb8884: Bootstrap starting.
I20260811 15:03:58.159330 29533 tablet_bootstrap.cc:654] T 80923b2c71f84dba9a8a92b777b3eb32 P c55114e7834d47eb830087dff4cf5242: Neither blocks nor log segments found. Creating new log.
I20260811 15:03:58.159525 29532 tablet_bootstrap.cc:654] T 80923b2c71f84dba9a8a92b777b3eb32 P a3f975537fe340ce88bf33d4bdcb8884: Neither blocks nor log segments found. Creating new log.
I20260811 15:03:58.160657 29533 tablet_bootstrap.cc:492] T 80923b2c71f84dba9a8a92b777b3eb32 P c55114e7834d47eb830087dff4cf5242: No bootstrap required, opened a new log
I20260811 15:03:58.160738 29533 ts_tablet_manager.cc:1397] T 80923b2c71f84dba9a8a92b777b3eb32 P c55114e7834d47eb830087dff4cf5242: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 15:03:58.160794 29275 tablet_service.cc:1467] Processing CreateTablet for tablet 80923b2c71f84dba9a8a92b777b3eb32 (DEFAULT_TABLE table=test-table [id=3ec31ce181404114a2129ce783ac5a53]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:03:58.161087 29275 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 80923b2c71f84dba9a8a92b777b3eb32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:03:58.161334 29533 raft_consensus.cc:348] T 80923b2c71f84dba9a8a92b777b3eb32 P c55114e7834d47eb830087dff4cf5242 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c55114e7834d47eb830087dff4cf5242" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 39839 } } peers { permanent_uuid: "7986206b93f24bd09dc510b1f308ed19" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 32837 } } peers { permanent_uuid: "a3f975537fe340ce88bf33d4bdcb8884" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 45119 } }
I20260811 15:03:58.161444 29533 raft_consensus.cc:374] T 80923b2c71f84dba9a8a92b777b3eb32 P c55114e7834d47eb830087dff4cf5242 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:03:58.161486 29533 raft_consensus.cc:729] T 80923b2c71f84dba9a8a92b777b3eb32 P c55114e7834d47eb830087dff4cf5242 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c55114e7834d47eb830087dff4cf5242, State: Initialized, Role: FOLLOWER
I20260811 15:03:58.161916 29555 ts_tablet_manager.cc:1905] T 0b28973ab83347369fd701df1d3578ca P a3f975537fe340ce88bf33d4bdcb8884: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 15:03:58.162081 29533 consensus_queue.cc:260] T 80923b2c71f84dba9a8a92b777b3eb32 P c55114e7834d47eb830087dff4cf5242 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c55114e7834d47eb830087dff4cf5242" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 39839 } } peers { permanent_uuid: "7986206b93f24bd09dc510b1f308ed19" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 32837 } } peers { permanent_uuid: "a3f975537fe340ce88bf33d4bdcb8884" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 45119 } }
I20260811 15:03:58.163759 29531 tablet_bootstrap.cc:492] T 80923b2c71f84dba9a8a92b777b3eb32 P 7986206b93f24bd09dc510b1f308ed19: Bootstrap starting.
I20260811 15:03:58.164096 29554 ts_tablet_manager.cc:1905] T 0b28973ab83347369fd701df1d3578ca P 7986206b93f24bd09dc510b1f308ed19: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 15:03:58.164798 29531 tablet_bootstrap.cc:654] T 80923b2c71f84dba9a8a92b777b3eb32 P 7986206b93f24bd09dc510b1f308ed19: Neither blocks nor log segments found. Creating new log.
I20260811 15:03:58.165901 29533 ts_tablet_manager.cc:1428] T 80923b2c71f84dba9a8a92b777b3eb32 P c55114e7834d47eb830087dff4cf5242: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20260811 15:03:58.166149 29555 ts_tablet_manager.cc:1918] T 0b28973ab83347369fd701df1d3578ca P a3f975537fe340ce88bf33d4bdcb8884: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 15:03:58.166280 29555 log.cc:1196] T 0b28973ab83347369fd701df1d3578ca P a3f975537fe340ce88bf33d4bdcb8884: Deleting WAL directory at /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/minicluster-data/ts-2/wal/wals/0b28973ab83347369fd701df1d3578ca
I20260811 15:03:58.166606 29532 tablet_bootstrap.cc:492] T 80923b2c71f84dba9a8a92b777b3eb32 P a3f975537fe340ce88bf33d4bdcb8884: No bootstrap required, opened a new log
I20260811 15:03:58.166635 29555 ts_tablet_manager.cc:1939] T 0b28973ab83347369fd701df1d3578ca P a3f975537fe340ce88bf33d4bdcb8884: Deleting consensus metadata
I20260811 15:03:58.166699 29532 ts_tablet_manager.cc:1397] T 80923b2c71f84dba9a8a92b777b3eb32 P a3f975537fe340ce88bf33d4bdcb8884: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.001s
I20260811 15:03:58.167160 29532 raft_consensus.cc:348] T 80923b2c71f84dba9a8a92b777b3eb32 P a3f975537fe340ce88bf33d4bdcb8884 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c55114e7834d47eb830087dff4cf5242" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 39839 } } peers { permanent_uuid: "7986206b93f24bd09dc510b1f308ed19" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 32837 } } peers { permanent_uuid: "a3f975537fe340ce88bf33d4bdcb8884" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 45119 } }
I20260811 15:03:58.167270 29532 raft_consensus.cc:374] T 80923b2c71f84dba9a8a92b777b3eb32 P a3f975537fe340ce88bf33d4bdcb8884 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:03:58.167303 29532 raft_consensus.cc:729] T 80923b2c71f84dba9a8a92b777b3eb32 P a3f975537fe340ce88bf33d4bdcb8884 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3f975537fe340ce88bf33d4bdcb8884, State: Initialized, Role: FOLLOWER
I20260811 15:03:58.167438 29532 consensus_queue.cc:260] T 80923b2c71f84dba9a8a92b777b3eb32 P a3f975537fe340ce88bf33d4bdcb8884 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c55114e7834d47eb830087dff4cf5242" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 39839 } } peers { permanent_uuid: "7986206b93f24bd09dc510b1f308ed19" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 32837 } } peers { permanent_uuid: "a3f975537fe340ce88bf33d4bdcb8884" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 45119 } }
I20260811 15:03:58.167682 29532 ts_tablet_manager.cc:1428] T 80923b2c71f84dba9a8a92b777b3eb32 P a3f975537fe340ce88bf33d4bdcb8884: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 15:03:58.167863 28950 catalog_manager.cc:4841] TS a3f975537fe340ce88bf33d4bdcb8884 (127.19.236.67:45119): tablet 0b28973ab83347369fd701df1d3578ca (table test-table [id=f6cb7da7cff94d6987201a43be52eb19]) successfully deleted
I20260811 15:03:58.168246 29531 tablet_bootstrap.cc:492] T 80923b2c71f84dba9a8a92b777b3eb32 P 7986206b93f24bd09dc510b1f308ed19: No bootstrap required, opened a new log
I20260811 15:03:58.168342 29531 ts_tablet_manager.cc:1397] T 80923b2c71f84dba9a8a92b777b3eb32 P 7986206b93f24bd09dc510b1f308ed19: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260811 15:03:58.168808 29531 raft_consensus.cc:348] T 80923b2c71f84dba9a8a92b777b3eb32 P 7986206b93f24bd09dc510b1f308ed19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c55114e7834d47eb830087dff4cf5242" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 39839 } } peers { permanent_uuid: "7986206b93f24bd09dc510b1f308ed19" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 32837 } } peers { permanent_uuid: "a3f975537fe340ce88bf33d4bdcb8884" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 45119 } }
I20260811 15:03:58.168911 29531 raft_consensus.cc:374] T 80923b2c71f84dba9a8a92b777b3eb32 P 7986206b93f24bd09dc510b1f308ed19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:03:58.168941 29531 raft_consensus.cc:729] T 80923b2c71f84dba9a8a92b777b3eb32 P 7986206b93f24bd09dc510b1f308ed19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7986206b93f24bd09dc510b1f308ed19, State: Initialized, Role: FOLLOWER
I20260811 15:03:58.169059 29531 consensus_queue.cc:260] T 80923b2c71f84dba9a8a92b777b3eb32 P 7986206b93f24bd09dc510b1f308ed19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c55114e7834d47eb830087dff4cf5242" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 39839 } } peers { permanent_uuid: "7986206b93f24bd09dc510b1f308ed19" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 32837 } } peers { permanent_uuid: "a3f975537fe340ce88bf33d4bdcb8884" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 45119 } }
I20260811 15:03:58.169322 29531 ts_tablet_manager.cc:1428] T 80923b2c71f84dba9a8a92b777b3eb32 P 7986206b93f24bd09dc510b1f308ed19: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 15:03:58.170275 29554 ts_tablet_manager.cc:1918] T 0b28973ab83347369fd701df1d3578ca P 7986206b93f24bd09dc510b1f308ed19: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 15:03:58.170758 29554 log.cc:1196] T 0b28973ab83347369fd701df1d3578ca P 7986206b93f24bd09dc510b1f308ed19: Deleting WAL directory at /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/minicluster-data/ts-1/wal/wals/0b28973ab83347369fd701df1d3578ca
I20260811 15:03:58.171171 29554 ts_tablet_manager.cc:1939] T 0b28973ab83347369fd701df1d3578ca P 7986206b93f24bd09dc510b1f308ed19: Deleting consensus metadata
I20260811 15:03:58.172470 28951 catalog_manager.cc:4841] TS 7986206b93f24bd09dc510b1f308ed19 (127.19.236.66:32837): tablet 0b28973ab83347369fd701df1d3578ca (table test-table [id=f6cb7da7cff94d6987201a43be52eb19]) successfully deleted
W20260811 15:03:58.229801 29500 tablet.cc:2369] T 80923b2c71f84dba9a8a92b777b3eb32 P a3f975537fe340ce88bf33d4bdcb8884: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 15:03:58.235580 29351 tablet.cc:2369] T 80923b2c71f84dba9a8a92b777b3eb32 P 7986206b93f24bd09dc510b1f308ed19: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 15:03:58.252849 29190 tablet.cc:2369] T 80923b2c71f84dba9a8a92b777b3eb32 P c55114e7834d47eb830087dff4cf5242: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 15:03:58.265137 29537 raft_consensus.cc:482] T 80923b2c71f84dba9a8a92b777b3eb32 P 7986206b93f24bd09dc510b1f308ed19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 15:03:58.265337 29537 raft_consensus.cc:504] T 80923b2c71f84dba9a8a92b777b3eb32 P 7986206b93f24bd09dc510b1f308ed19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c55114e7834d47eb830087dff4cf5242" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 39839 } } peers { permanent_uuid: "7986206b93f24bd09dc510b1f308ed19" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 32837 } } peers { permanent_uuid: "a3f975537fe340ce88bf33d4bdcb8884" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 45119 } }
I20260811 15:03:58.266541 29537 leader_election.cc:288] T 80923b2c71f84dba9a8a92b777b3eb32 P 7986206b93f24bd09dc510b1f308ed19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c55114e7834d47eb830087dff4cf5242 (127.19.236.65:39839), a3f975537fe340ce88bf33d4bdcb8884 (127.19.236.67:45119)
I20260811 15:03:58.271101 29527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:58.267338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.66:53721 (local address 127.19.236.67:45119)
0811 15:03:58.267497 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:58.267504 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:58.267521 (+ 17us) server_negotiation.cc:407] Connection header received
0811 15:03:58.267643 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:58.267649 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:58.267698 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:58.267766 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:03:58.268073 (+ 307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:58.268820 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:58.269975 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:58.270520 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:58.270652 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:58.270712 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:58.270908 (+ 196us) server_negotiation.cc:299] Negotiation successful
0811 15:03:58.270978 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 15:03:58.271121 29560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:58.267188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.67:45119 (local address 127.19.236.66:53721)
0811 15:03:58.267446 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:58.267461 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:58.267550 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:58.267802 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:58.267806 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:58.267829 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:03:58.267936 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:58.267944 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:58.268947 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:58.268950 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:58.269827 (+ 877us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:58.269837 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:58.270652 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:58.270656 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:58.270756 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:58.270778 (+ 22us) client_negotiation.cc:769] Sending connection context
0811 15:03:58.270876 (+ 98us) client_negotiation.cc:240] Negotiation successful
0811 15:03:58.270956 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171,"mutex_wait_us":42,"thread_start_us":74,"threads_started":1}
I20260811 15:03:58.271754 29559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:58.266747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.65:39839 (local address 127.19.236.66:42847)
0811 15:03:58.267064 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:58.267082 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:58.267194 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:58.267664 (+ 470us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:58.267666 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:58.267679 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:03:58.267826 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:58.267836 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:58.268924 (+ 1088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:58.268928 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:58.270241 (+ 1313us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:58.270253 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:58.271297 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:58.271301 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:58.271418 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:58.271442 (+ 24us) client_negotiation.cc:769] Sending connection context
0811 15:03:58.271534 (+ 92us) client_negotiation.cc:240] Negotiation successful
0811 15:03:58.271608 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":231,"mutex_wait_us":57,"thread_start_us":142,"threads_started":1}
I20260811 15:03:58.271981 29449 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "80923b2c71f84dba9a8a92b777b3eb32" candidate_uuid: "7986206b93f24bd09dc510b1f308ed19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3f975537fe340ce88bf33d4bdcb8884" is_pre_election: true
I20260811 15:03:58.272143 29529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:58.266906 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.66:42847 (local address 127.19.236.65:39839)
0811 15:03:58.267069 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:58.267073 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:58.267418 (+ 345us) server_negotiation.cc:407] Connection header received
0811 15:03:58.267503 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:58.267506 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:58.267558 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:58.267649 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:03:58.267944 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:58.268782 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:58.270401 (+ 1619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:58.271040 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:58.271175 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:58.271226 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:58.271929 (+ 703us) server_negotiation.cc:299] Negotiation successful
0811 15:03:58.272021 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260811 15:03:58.272243 29449 raft_consensus.cc:2454] T 80923b2c71f84dba9a8a92b777b3eb32 P a3f975537fe340ce88bf33d4bdcb8884 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7986206b93f24bd09dc510b1f308ed19 in term 0.
I20260811 15:03:58.272542 29142 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "80923b2c71f84dba9a8a92b777b3eb32" candidate_uuid: "7986206b93f24bd09dc510b1f308ed19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c55114e7834d47eb830087dff4cf5242" is_pre_election: true
I20260811 15:03:58.272710 29142 raft_consensus.cc:2454] T 80923b2c71f84dba9a8a92b777b3eb32 P c55114e7834d47eb830087dff4cf5242 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7986206b93f24bd09dc510b1f308ed19 in term 0.
I20260811 15:03:58.272779 29221 leader_election.cc:302] T 80923b2c71f84dba9a8a92b777b3eb32 P 7986206b93f24bd09dc510b1f308ed19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7986206b93f24bd09dc510b1f308ed19, a3f975537fe340ce88bf33d4bdcb8884; no voters:
I20260811 15:03:58.273058 29537 raft_consensus.cc:2781] T 80923b2c71f84dba9a8a92b777b3eb32 P 7986206b93f24bd09dc510b1f308ed19 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 15:03:58.273137 29537 raft_consensus.cc:482] T 80923b2c71f84dba9a8a92b777b3eb32 P 7986206b93f24bd09dc510b1f308ed19 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 15:03:58.273190 29537 raft_consensus.cc:3037] T 80923b2c71f84dba9a8a92b777b3eb32 P 7986206b93f24bd09dc510b1f308ed19 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:03:58.274173 29537 raft_consensus.cc:504] T 80923b2c71f84dba9a8a92b777b3eb32 P 7986206b93f24bd09dc510b1f308ed19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c55114e7834d47eb830087dff4cf5242" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 39839 } } peers { permanent_uuid: "7986206b93f24bd09dc510b1f308ed19" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 32837 } } peers { permanent_uuid: "a3f975537fe340ce88bf33d4bdcb8884" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 45119 } }
I20260811 15:03:58.274490 29537 leader_election.cc:288] T 80923b2c71f84dba9a8a92b777b3eb32 P 7986206b93f24bd09dc510b1f308ed19 [CANDIDATE]: Term 1 election: Requested vote from peers c55114e7834d47eb830087dff4cf5242 (127.19.236.65:39839), a3f975537fe340ce88bf33d4bdcb8884 (127.19.236.67:45119)
I20260811 15:03:58.274914 29449 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "80923b2c71f84dba9a8a92b777b3eb32" candidate_uuid: "7986206b93f24bd09dc510b1f308ed19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3f975537fe340ce88bf33d4bdcb8884"
I20260811 15:03:58.274935 29142 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "80923b2c71f84dba9a8a92b777b3eb32" candidate_uuid: "7986206b93f24bd09dc510b1f308ed19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c55114e7834d47eb830087dff4cf5242"
I20260811 15:03:58.275059 29449 raft_consensus.cc:3037] T 80923b2c71f84dba9a8a92b777b3eb32 P a3f975537fe340ce88bf33d4bdcb8884 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:03:58.275068 29142 raft_consensus.cc:3037] T 80923b2c71f84dba9a8a92b777b3eb32 P c55114e7834d47eb830087dff4cf5242 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:03:58.276156 29449 raft_consensus.cc:2454] T 80923b2c71f84dba9a8a92b777b3eb32 P a3f975537fe340ce88bf33d4bdcb8884 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7986206b93f24bd09dc510b1f308ed19 in term 1.
I20260811 15:03:58.276300 29142 raft_consensus.cc:2454] T 80923b2c71f84dba9a8a92b777b3eb32 P c55114e7834d47eb830087dff4cf5242 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7986206b93f24bd09dc510b1f308ed19 in term 1.
I20260811 15:03:58.276448 29221 leader_election.cc:302] T 80923b2c71f84dba9a8a92b777b3eb32 P 7986206b93f24bd09dc510b1f308ed19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7986206b93f24bd09dc510b1f308ed19, a3f975537fe340ce88bf33d4bdcb8884; no voters:
I20260811 15:03:58.276679 29537 raft_consensus.cc:2781] T 80923b2c71f84dba9a8a92b777b3eb32 P 7986206b93f24bd09dc510b1f308ed19 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:03:58.276865 29537 raft_consensus.cc:686] T 80923b2c71f84dba9a8a92b777b3eb32 P 7986206b93f24bd09dc510b1f308ed19 [term 1 LEADER]: Becoming Leader. State: Replica: 7986206b93f24bd09dc510b1f308ed19, State: Running, Role: LEADER
I20260811 15:03:58.277138 29537 consensus_queue.cc:237] T 80923b2c71f84dba9a8a92b777b3eb32 P 7986206b93f24bd09dc510b1f308ed19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c55114e7834d47eb830087dff4cf5242" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 39839 } } peers { permanent_uuid: "7986206b93f24bd09dc510b1f308ed19" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 32837 } } peers { permanent_uuid: "a3f975537fe340ce88bf33d4bdcb8884" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 45119 } }
I20260811 15:03:58.279831 28965 catalog_manager.cc:5495] T 80923b2c71f84dba9a8a92b777b3eb32 P 7986206b93f24bd09dc510b1f308ed19 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7986206b93f24bd09dc510b1f308ed19 (127.19.236.66). New cstate: current_term: 1 leader_uuid: "7986206b93f24bd09dc510b1f308ed19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c55114e7834d47eb830087dff4cf5242" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 39839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7986206b93f24bd09dc510b1f308ed19" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 32837 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3f975537fe340ce88bf33d4bdcb8884" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 45119 } health_report { overall_health: UNKNOWN } } }
Aug 11 15:03:58 dist-test-slave-8n49 krb5kdc[28912](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460637, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.236.126@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM
I20260811 15:03:58.315649 29568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:58.306507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:35361 (local address 127.0.0.1:56346)
0811 15:03:58.306852 (+ 345us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:58.306866 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:58.307019 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:58.307265 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:58.307268 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:58.307681 (+ 413us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:03:58.307778 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:58.307789 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:58.308663 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:58.308668 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:58.309237 (+ 569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:58.309245 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:58.309701 (+ 456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:58.309704 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:58.309805 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:58.310445 (+ 640us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:03:58.310457 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:03:58.312012 (+ 1555us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:03:58.314040 (+ 2028us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:58.314050 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:58.314057 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:58.314300 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:58.314579 (+ 279us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:03:58.314582 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:03:58.314583 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:03:58.314673 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:03:58.315091 (+ 418us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:03:58.315097 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:03:58.315209 (+ 112us) client_negotiation.cc:769] Sending connection context
0811 15:03:58.315305 (+ 96us) client_negotiation.cc:240] Negotiation successful
0811 15:03:58.315443 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":216,"mutex_wait_us":4,"thread_start_us":117,"threads_started":1}
I20260811 15:03:58.315716 29020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:58.306569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56346 (local address 127.19.236.126:35361)
0811 15:03:58.306734 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:58.306740 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:58.306946 (+ 206us) server_negotiation.cc:407] Connection header received
0811 15:03:58.307116 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:58.307119 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:58.307164 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:58.307248 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:58.307974 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:58.308493 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:58.309362 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:58.309581 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:58.309694 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:58.312165 (+ 2471us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:58.312168 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:58.312170 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:58.312193 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:58.313913 (+ 1720us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:58.314395 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:58.314398 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:58.314399 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:58.314471 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:58.314812 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:58.314814 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:58.314815 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:58.314993 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:58.315072 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:58.315363 (+ 291us) server_negotiation.cc:299] Negotiation successful
0811 15:03:58.315496 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":51,"server-negotiator.queue_time_us":50}
I20260811 15:03:58.320120 28965 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.19.236.126@KRBTEST.COM'} at 127.0.0.1:56346:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 15:03:58.321012 28965 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 15:03:58.326208 29117 tablet_service.cc:1467] Processing CreateTablet for tablet 538beaf234e54041aa49a51ed7d196bf (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=f5500f23ff47477487e2543428f54159]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 15:03:58.326208 29275 tablet_service.cc:1467] Processing CreateTablet for tablet 538beaf234e54041aa49a51ed7d196bf (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=f5500f23ff47477487e2543428f54159]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 15:03:58.326450 29428 tablet_service.cc:1467] Processing CreateTablet for tablet 538beaf234e54041aa49a51ed7d196bf (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=f5500f23ff47477487e2543428f54159]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 15:03:58.326643 29117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 538beaf234e54041aa49a51ed7d196bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:03:58.326639 29275 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 538beaf234e54041aa49a51ed7d196bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:03:58.326867 29428 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 538beaf234e54041aa49a51ed7d196bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:03:58.329492 29532 tablet_bootstrap.cc:492] T 538beaf234e54041aa49a51ed7d196bf P a3f975537fe340ce88bf33d4bdcb8884: Bootstrap starting.
I20260811 15:03:58.329622 29531 tablet_bootstrap.cc:492] T 538beaf234e54041aa49a51ed7d196bf P 7986206b93f24bd09dc510b1f308ed19: Bootstrap starting.
I20260811 15:03:58.329694 29533 tablet_bootstrap.cc:492] T 538beaf234e54041aa49a51ed7d196bf P c55114e7834d47eb830087dff4cf5242: Bootstrap starting.
I20260811 15:03:58.330552 29532 tablet_bootstrap.cc:654] T 538beaf234e54041aa49a51ed7d196bf P a3f975537fe340ce88bf33d4bdcb8884: Neither blocks nor log segments found. Creating new log.
I20260811 15:03:58.330665 29531 tablet_bootstrap.cc:654] T 538beaf234e54041aa49a51ed7d196bf P 7986206b93f24bd09dc510b1f308ed19: Neither blocks nor log segments found. Creating new log.
I20260811 15:03:58.330674 29533 tablet_bootstrap.cc:654] T 538beaf234e54041aa49a51ed7d196bf P c55114e7834d47eb830087dff4cf5242: Neither blocks nor log segments found. Creating new log.
I20260811 15:03:58.331921 29532 tablet_bootstrap.cc:492] T 538beaf234e54041aa49a51ed7d196bf P a3f975537fe340ce88bf33d4bdcb8884: No bootstrap required, opened a new log
I20260811 15:03:58.331923 29533 tablet_bootstrap.cc:492] T 538beaf234e54041aa49a51ed7d196bf P c55114e7834d47eb830087dff4cf5242: No bootstrap required, opened a new log
I20260811 15:03:58.332008 29532 ts_tablet_manager.cc:1397] T 538beaf234e54041aa49a51ed7d196bf P a3f975537fe340ce88bf33d4bdcb8884: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20260811 15:03:58.332008 29533 ts_tablet_manager.cc:1397] T 538beaf234e54041aa49a51ed7d196bf P c55114e7834d47eb830087dff4cf5242: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 15:03:58.332275 29531 tablet_bootstrap.cc:492] T 538beaf234e54041aa49a51ed7d196bf P 7986206b93f24bd09dc510b1f308ed19: No bootstrap required, opened a new log
I20260811 15:03:58.332335 29531 ts_tablet_manager.cc:1397] T 538beaf234e54041aa49a51ed7d196bf P 7986206b93f24bd09dc510b1f308ed19: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 15:03:58.332451 29532 raft_consensus.cc:348] T 538beaf234e54041aa49a51ed7d196bf P a3f975537fe340ce88bf33d4bdcb8884 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c55114e7834d47eb830087dff4cf5242" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 39839 } } peers { permanent_uuid: "7986206b93f24bd09dc510b1f308ed19" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 32837 } } peers { permanent_uuid: "a3f975537fe340ce88bf33d4bdcb8884" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 45119 } }
I20260811 15:03:58.332451 29533 raft_consensus.cc:348] T 538beaf234e54041aa49a51ed7d196bf P c55114e7834d47eb830087dff4cf5242 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c55114e7834d47eb830087dff4cf5242" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 39839 } } peers { permanent_uuid: "7986206b93f24bd09dc510b1f308ed19" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 32837 } } peers { permanent_uuid: "a3f975537fe340ce88bf33d4bdcb8884" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 45119 } }
I20260811 15:03:58.332602 29533 raft_consensus.cc:374] T 538beaf234e54041aa49a51ed7d196bf P c55114e7834d47eb830087dff4cf5242 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:03:58.332602 29532 raft_consensus.cc:374] T 538beaf234e54041aa49a51ed7d196bf P a3f975537fe340ce88bf33d4bdcb8884 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:03:58.332641 29533 raft_consensus.cc:729] T 538beaf234e54041aa49a51ed7d196bf P c55114e7834d47eb830087dff4cf5242 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c55114e7834d47eb830087dff4cf5242, State: Initialized, Role: FOLLOWER
I20260811 15:03:58.332641 29532 raft_consensus.cc:729] T 538beaf234e54041aa49a51ed7d196bf P a3f975537fe340ce88bf33d4bdcb8884 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3f975537fe340ce88bf33d4bdcb8884, State: Initialized, Role: FOLLOWER
I20260811 15:03:58.332787 29533 consensus_queue.cc:260] T 538beaf234e54041aa49a51ed7d196bf P c55114e7834d47eb830087dff4cf5242 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c55114e7834d47eb830087dff4cf5242" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 39839 } } peers { permanent_uuid: "7986206b93f24bd09dc510b1f308ed19" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 32837 } } peers { permanent_uuid: "a3f975537fe340ce88bf33d4bdcb8884" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 45119 } }
I20260811 15:03:58.332782 29532 consensus_queue.cc:260] T 538beaf234e54041aa49a51ed7d196bf P a3f975537fe340ce88bf33d4bdcb8884 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c55114e7834d47eb830087dff4cf5242" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 39839 } } peers { permanent_uuid: "7986206b93f24bd09dc510b1f308ed19" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 32837 } } peers { permanent_uuid: "a3f975537fe340ce88bf33d4bdcb8884" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 45119 } }
I20260811 15:03:58.332826 29531 raft_consensus.cc:348] T 538beaf234e54041aa49a51ed7d196bf P 7986206b93f24bd09dc510b1f308ed19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c55114e7834d47eb830087dff4cf5242" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 39839 } } peers { permanent_uuid: "7986206b93f24bd09dc510b1f308ed19" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 32837 } } peers { permanent_uuid: "a3f975537fe340ce88bf33d4bdcb8884" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 45119 } }
I20260811 15:03:58.332950 29531 raft_consensus.cc:374] T 538beaf234e54041aa49a51ed7d196bf P 7986206b93f24bd09dc510b1f308ed19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:03:58.332993 29531 raft_consensus.cc:729] T 538beaf234e54041aa49a51ed7d196bf P 7986206b93f24bd09dc510b1f308ed19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7986206b93f24bd09dc510b1f308ed19, State: Initialized, Role: FOLLOWER
I20260811 15:03:58.333071 29533 ts_tablet_manager.cc:1428] T 538beaf234e54041aa49a51ed7d196bf P c55114e7834d47eb830087dff4cf5242: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 15:03:58.333065 29532 ts_tablet_manager.cc:1428] T 538beaf234e54041aa49a51ed7d196bf P a3f975537fe340ce88bf33d4bdcb8884: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 15:03:58.333130 29531 consensus_queue.cc:260] T 538beaf234e54041aa49a51ed7d196bf P 7986206b93f24bd09dc510b1f308ed19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c55114e7834d47eb830087dff4cf5242" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 39839 } } peers { permanent_uuid: "7986206b93f24bd09dc510b1f308ed19" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 32837 } } peers { permanent_uuid: "a3f975537fe340ce88bf33d4bdcb8884" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 45119 } }
I20260811 15:03:58.333390 29531 ts_tablet_manager.cc:1428] T 538beaf234e54041aa49a51ed7d196bf P 7986206b93f24bd09dc510b1f308ed19: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 15:03:58.333329 29539 tablet_replica.cc:439] T 538beaf234e54041aa49a51ed7d196bf P c55114e7834d47eb830087dff4cf5242: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c55114e7834d47eb830087dff4cf5242" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 39839 } } peers { permanent_uuid: "7986206b93f24bd09dc510b1f308ed19" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 32837 } } peers { permanent_uuid: "a3f975537fe340ce88bf33d4bdcb8884" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 45119 } } }
I20260811 15:03:58.333488 29539 tablet_replica.cc:442] T 538beaf234e54041aa49a51ed7d196bf P c55114e7834d47eb830087dff4cf5242: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 15:03:58.333596 29541 tablet_replica.cc:439] T 538beaf234e54041aa49a51ed7d196bf P a3f975537fe340ce88bf33d4bdcb8884: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c55114e7834d47eb830087dff4cf5242" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 39839 } } peers { permanent_uuid: "7986206b93f24bd09dc510b1f308ed19" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 32837 } } peers { permanent_uuid: "a3f975537fe340ce88bf33d4bdcb8884" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 45119 } } }
I20260811 15:03:58.333741 29541 tablet_replica.cc:442] T 538beaf234e54041aa49a51ed7d196bf P a3f975537fe340ce88bf33d4bdcb8884: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 15:03:58.333930 29537 tablet_replica.cc:439] T 538beaf234e54041aa49a51ed7d196bf P 7986206b93f24bd09dc510b1f308ed19: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c55114e7834d47eb830087dff4cf5242" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 39839 } } peers { permanent_uuid: "7986206b93f24bd09dc510b1f308ed19" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 32837 } } peers { permanent_uuid: "a3f975537fe340ce88bf33d4bdcb8884" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 45119 } } }
I20260811 15:03:58.334081 29537 tablet_replica.cc:442] T 538beaf234e54041aa49a51ed7d196bf P 7986206b93f24bd09dc510b1f308ed19: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 15:03:58.468271 29537 raft_consensus.cc:482] T 538beaf234e54041aa49a51ed7d196bf P 7986206b93f24bd09dc510b1f308ed19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 15:03:58.468454 29537 raft_consensus.cc:504] T 538beaf234e54041aa49a51ed7d196bf P 7986206b93f24bd09dc510b1f308ed19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c55114e7834d47eb830087dff4cf5242" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 39839 } } peers { permanent_uuid: "7986206b93f24bd09dc510b1f308ed19" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 32837 } } peers { permanent_uuid: "a3f975537fe340ce88bf33d4bdcb8884" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 45119 } }
I20260811 15:03:58.469055 29537 leader_election.cc:288] T 538beaf234e54041aa49a51ed7d196bf P 7986206b93f24bd09dc510b1f308ed19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c55114e7834d47eb830087dff4cf5242 (127.19.236.65:39839), a3f975537fe340ce88bf33d4bdcb8884 (127.19.236.67:45119)
I20260811 15:03:58.469689 29142 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "538beaf234e54041aa49a51ed7d196bf" candidate_uuid: "7986206b93f24bd09dc510b1f308ed19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c55114e7834d47eb830087dff4cf5242" is_pre_election: true
I20260811 15:03:58.469770 29449 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "538beaf234e54041aa49a51ed7d196bf" candidate_uuid: "7986206b93f24bd09dc510b1f308ed19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3f975537fe340ce88bf33d4bdcb8884" is_pre_election: true
I20260811 15:03:58.469866 29142 raft_consensus.cc:2454] T 538beaf234e54041aa49a51ed7d196bf P c55114e7834d47eb830087dff4cf5242 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7986206b93f24bd09dc510b1f308ed19 in term 0.
I20260811 15:03:58.470026 29449 raft_consensus.cc:2454] T 538beaf234e54041aa49a51ed7d196bf P a3f975537fe340ce88bf33d4bdcb8884 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7986206b93f24bd09dc510b1f308ed19 in term 0.
I20260811 15:03:58.470266 29221 leader_election.cc:302] T 538beaf234e54041aa49a51ed7d196bf P 7986206b93f24bd09dc510b1f308ed19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7986206b93f24bd09dc510b1f308ed19, c55114e7834d47eb830087dff4cf5242; no voters:
I20260811 15:03:58.470520 29537 raft_consensus.cc:2781] T 538beaf234e54041aa49a51ed7d196bf P 7986206b93f24bd09dc510b1f308ed19 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 15:03:58.470615 29537 raft_consensus.cc:482] T 538beaf234e54041aa49a51ed7d196bf P 7986206b93f24bd09dc510b1f308ed19 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 15:03:58.470662 29537 raft_consensus.cc:3037] T 538beaf234e54041aa49a51ed7d196bf P 7986206b93f24bd09dc510b1f308ed19 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:03:58.471879 29537 raft_consensus.cc:504] T 538beaf234e54041aa49a51ed7d196bf P 7986206b93f24bd09dc510b1f308ed19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c55114e7834d47eb830087dff4cf5242" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 39839 } } peers { permanent_uuid: "7986206b93f24bd09dc510b1f308ed19" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 32837 } } peers { permanent_uuid: "a3f975537fe340ce88bf33d4bdcb8884" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 45119 } }
I20260811 15:03:58.472276 29537 leader_election.cc:288] T 538beaf234e54041aa49a51ed7d196bf P 7986206b93f24bd09dc510b1f308ed19 [CANDIDATE]: Term 1 election: Requested vote from peers c55114e7834d47eb830087dff4cf5242 (127.19.236.65:39839), a3f975537fe340ce88bf33d4bdcb8884 (127.19.236.67:45119)
I20260811 15:03:58.472733 29142 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "538beaf234e54041aa49a51ed7d196bf" candidate_uuid: "7986206b93f24bd09dc510b1f308ed19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c55114e7834d47eb830087dff4cf5242"
I20260811 15:03:58.472873 29142 raft_consensus.cc:3037] T 538beaf234e54041aa49a51ed7d196bf P c55114e7834d47eb830087dff4cf5242 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:03:58.472819 29449 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "538beaf234e54041aa49a51ed7d196bf" candidate_uuid: "7986206b93f24bd09dc510b1f308ed19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3f975537fe340ce88bf33d4bdcb8884"
I20260811 15:03:58.472960 29449 raft_consensus.cc:3037] T 538beaf234e54041aa49a51ed7d196bf P a3f975537fe340ce88bf33d4bdcb8884 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:03:58.473800 29142 raft_consensus.cc:2454] T 538beaf234e54041aa49a51ed7d196bf P c55114e7834d47eb830087dff4cf5242 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7986206b93f24bd09dc510b1f308ed19 in term 1.
I20260811 15:03:58.474097 29449 raft_consensus.cc:2454] T 538beaf234e54041aa49a51ed7d196bf P a3f975537fe340ce88bf33d4bdcb8884 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7986206b93f24bd09dc510b1f308ed19 in term 1.
I20260811 15:03:58.474146 29221 leader_election.cc:302] T 538beaf234e54041aa49a51ed7d196bf P 7986206b93f24bd09dc510b1f308ed19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7986206b93f24bd09dc510b1f308ed19, c55114e7834d47eb830087dff4cf5242; no voters:
I20260811 15:03:58.474321 29537 raft_consensus.cc:2781] T 538beaf234e54041aa49a51ed7d196bf P 7986206b93f24bd09dc510b1f308ed19 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:03:58.474437 29537 raft_consensus.cc:686] T 538beaf234e54041aa49a51ed7d196bf P 7986206b93f24bd09dc510b1f308ed19 [term 1 LEADER]: Becoming Leader. State: Replica: 7986206b93f24bd09dc510b1f308ed19, State: Running, Role: LEADER
I20260811 15:03:58.474581 29537 consensus_queue.cc:237] T 538beaf234e54041aa49a51ed7d196bf P 7986206b93f24bd09dc510b1f308ed19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c55114e7834d47eb830087dff4cf5242" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 39839 } } peers { permanent_uuid: "7986206b93f24bd09dc510b1f308ed19" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 32837 } } peers { permanent_uuid: "a3f975537fe340ce88bf33d4bdcb8884" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 45119 } }
I20260811 15:03:58.475346 29561 tablet_replica.cc:439] T 538beaf234e54041aa49a51ed7d196bf P 7986206b93f24bd09dc510b1f308ed19: TxnStatusTablet state changed. Reason: New leader 7986206b93f24bd09dc510b1f308ed19. Latest consensus state: current_term: 1 leader_uuid: "7986206b93f24bd09dc510b1f308ed19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c55114e7834d47eb830087dff4cf5242" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 39839 } } peers { permanent_uuid: "7986206b93f24bd09dc510b1f308ed19" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 32837 } } peers { permanent_uuid: "a3f975537fe340ce88bf33d4bdcb8884" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 45119 } } }
I20260811 15:03:58.475468 29561 tablet_replica.cc:442] T 538beaf234e54041aa49a51ed7d196bf P 7986206b93f24bd09dc510b1f308ed19: This TxnStatusTablet replica's current role is: LEADER
I20260811 15:03:58.475788 29573 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 15:03:58.476193 29573 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 15:03:58.476884 28964 catalog_manager.cc:5495] T 538beaf234e54041aa49a51ed7d196bf P 7986206b93f24bd09dc510b1f308ed19 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7986206b93f24bd09dc510b1f308ed19 (127.19.236.66). New cstate: current_term: 1 leader_uuid: "7986206b93f24bd09dc510b1f308ed19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c55114e7834d47eb830087dff4cf5242" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 39839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7986206b93f24bd09dc510b1f308ed19" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 32837 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a3f975537fe340ce88bf33d4bdcb8884" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 45119 } health_report { overall_health: UNKNOWN } } }
I20260811 15:03:58.490440 29568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:58.486351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.66:32837 (local address 127.0.0.1:49296)
0811 15:03:58.486613 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:58.486632 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:58.486761 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:58.487121 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:58.487124 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:58.487131 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 15:03:58.487250 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:58.487255 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:58.488008 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:58.488012 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:58.488762 (+ 750us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:58.488772 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:58.489257 (+ 485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:58.489261 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:58.489359 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:58.489417 (+ 58us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 15:03:58.490121 (+ 704us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 15:03:58.490141 (+ 20us) client_negotiation.cc:769] Sending connection context
0811 15:03:58.490212 (+ 71us) client_negotiation.cc:240] Negotiation successful
0811 15:03:58.490309 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":164}
I20260811 15:03:58.490450 29524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:58.486396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49296 (local address 127.19.236.66:32837)
0811 15:03:58.486525 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:58.486531 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:58.486696 (+ 165us) server_negotiation.cc:407] Connection header received
0811 15:03:58.486915 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:58.486918 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:58.486992 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:58.487090 (+ 98us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 15:03:58.487359 (+ 269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:58.487881 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:58.488886 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:58.489137 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:58.489254 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:58.489576 (+ 322us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 15:03:58.490015 (+ 439us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 15:03:58.490143 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:58.490223 (+ 80us) server_negotiation.cc:299] Negotiation successful
0811 15:03:58.490279 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 15:03:58.493674 29142 raft_consensus.cc:1261] T 538beaf234e54041aa49a51ed7d196bf P c55114e7834d47eb830087dff4cf5242 [term 1 FOLLOWER]: Refusing update from remote peer 7986206b93f24bd09dc510b1f308ed19: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:03:58.493865 29449 raft_consensus.cc:1261] T 538beaf234e54041aa49a51ed7d196bf P a3f975537fe340ce88bf33d4bdcb8884 [term 1 FOLLOWER]: Refusing update from remote peer 7986206b93f24bd09dc510b1f308ed19: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:03:58.494186 29537 consensus_queue.cc:1035] T 538beaf234e54041aa49a51ed7d196bf P 7986206b93f24bd09dc510b1f308ed19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c55114e7834d47eb830087dff4cf5242" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 39839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:03:58.494357 29561 consensus_queue.cc:1035] T 538beaf234e54041aa49a51ed7d196bf P 7986206b93f24bd09dc510b1f308ed19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3f975537fe340ce88bf33d4bdcb8884" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:03:58.496156 29539 tablet_replica.cc:439] T 538beaf234e54041aa49a51ed7d196bf P c55114e7834d47eb830087dff4cf5242: TxnStatusTablet state changed. Reason: New leader 7986206b93f24bd09dc510b1f308ed19. Latest consensus state: current_term: 1 leader_uuid: "7986206b93f24bd09dc510b1f308ed19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c55114e7834d47eb830087dff4cf5242" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 39839 } } peers { permanent_uuid: "7986206b93f24bd09dc510b1f308ed19" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 32837 } } peers { permanent_uuid: "a3f975537fe340ce88bf33d4bdcb8884" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 45119 } } }
I20260811 15:03:58.496197 29541 tablet_replica.cc:439] T 538beaf234e54041aa49a51ed7d196bf P a3f975537fe340ce88bf33d4bdcb8884: TxnStatusTablet state changed. Reason: New leader 7986206b93f24bd09dc510b1f308ed19. Latest consensus state: current_term: 1 leader_uuid: "7986206b93f24bd09dc510b1f308ed19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c55114e7834d47eb830087dff4cf5242" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 39839 } } peers { permanent_uuid: "7986206b93f24bd09dc510b1f308ed19" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 32837 } } peers { permanent_uuid: "a3f975537fe340ce88bf33d4bdcb8884" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 45119 } } }
I20260811 15:03:58.496294 29539 tablet_replica.cc:442] T 538beaf234e54041aa49a51ed7d196bf P c55114e7834d47eb830087dff4cf5242: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 15:03:58.496304 29541 tablet_replica.cc:442] T 538beaf234e54041aa49a51ed7d196bf P a3f975537fe340ce88bf33d4bdcb8884: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 15:03:58.499576 29561 tablet_replica.cc:439] T 538beaf234e54041aa49a51ed7d196bf P 7986206b93f24bd09dc510b1f308ed19: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7986206b93f24bd09dc510b1f308ed19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c55114e7834d47eb830087dff4cf5242" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 39839 } } peers { permanent_uuid: "7986206b93f24bd09dc510b1f308ed19" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 32837 } } peers { permanent_uuid: "a3f975537fe340ce88bf33d4bdcb8884" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 45119 } } }
I20260811 15:03:58.499696 29561 tablet_replica.cc:442] T 538beaf234e54041aa49a51ed7d196bf P 7986206b93f24bd09dc510b1f308ed19: This TxnStatusTablet replica's current role is: LEADER
I20260811 15:03:58.499830 29561 tablet_replica.cc:439] T 538beaf234e54041aa49a51ed7d196bf P 7986206b93f24bd09dc510b1f308ed19: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7986206b93f24bd09dc510b1f308ed19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c55114e7834d47eb830087dff4cf5242" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 39839 } } peers { permanent_uuid: "7986206b93f24bd09dc510b1f308ed19" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 32837 } } peers { permanent_uuid: "a3f975537fe340ce88bf33d4bdcb8884" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 45119 } } }
I20260811 15:03:58.499900 29561 tablet_replica.cc:442] T 538beaf234e54041aa49a51ed7d196bf P 7986206b93f24bd09dc510b1f308ed19: This TxnStatusTablet replica's current role is: LEADER
I20260811 15:03:58.501996 29539 tablet_replica.cc:439] T 538beaf234e54041aa49a51ed7d196bf P c55114e7834d47eb830087dff4cf5242: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7986206b93f24bd09dc510b1f308ed19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c55114e7834d47eb830087dff4cf5242" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 39839 } } peers { permanent_uuid: "7986206b93f24bd09dc510b1f308ed19" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 32837 } } peers { permanent_uuid: "a3f975537fe340ce88bf33d4bdcb8884" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 45119 } } }
I20260811 15:03:58.502110 29539 tablet_replica.cc:442] T 538beaf234e54041aa49a51ed7d196bf P c55114e7834d47eb830087dff4cf5242: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 15:03:58.503857 29541 tablet_replica.cc:439] T 538beaf234e54041aa49a51ed7d196bf P a3f975537fe340ce88bf33d4bdcb8884: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7986206b93f24bd09dc510b1f308ed19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c55114e7834d47eb830087dff4cf5242" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 39839 } } peers { permanent_uuid: "7986206b93f24bd09dc510b1f308ed19" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 32837 } } peers { permanent_uuid: "a3f975537fe340ce88bf33d4bdcb8884" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 45119 } } }
I20260811 15:03:58.503986 29541 tablet_replica.cc:442] T 538beaf234e54041aa49a51ed7d196bf P a3f975537fe340ce88bf33d4bdcb8884: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 15:03:58.508831 29524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:58.504840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49300 (local address 127.19.236.66:32837)
0811 15:03:58.505131 (+ 291us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:58.505135 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:58.505149 (+ 14us) server_negotiation.cc:407] Connection header received
0811 15:03:58.505192 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:58.505195 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:58.505244 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:58.505332 (+ 88us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 15:03:58.505647 (+ 315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:58.506464 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:58.507485 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:58.507781 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:58.507893 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:58.508216 (+ 323us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 15:03:58.508300 (+ 84us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 15:03:58.508382 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:58.508648 (+ 266us) server_negotiation.cc:299] Negotiation successful
0811 15:03:58.508708 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":218}
I20260811 15:03:58.526149 29583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:58.521766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.66:32837 (local address 127.19.236.66:50271)
0811 15:03:58.522294 (+ 528us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:58.522307 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:58.522455 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:58.522737 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:58.522740 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:58.522748 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 15:03:58.522931 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:58.522938 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:58.523767 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:58.523773 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:58.524534 (+ 761us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:58.524543 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:58.525289 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:58.525294 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:58.525450 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:58.525506 (+ 56us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 15:03:58.525837 (+ 331us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 15:03:58.525844 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 15:03:58.525907 (+ 63us) client_negotiation.cc:240] Negotiation successful
0811 15:03:58.525982 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":414,"mutex_wait_us":22,"thread_start_us":103,"threads_started":1}
I20260811 15:03:58.526147 29524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:58.522045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.66:50271 (local address 127.19.236.66:32837)
0811 15:03:58.522192 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:58.522200 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:58.522385 (+ 185us) server_negotiation.cc:407] Connection header received
0811 15:03:58.522575 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:58.522579 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:58.522630 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:58.522715 (+ 85us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 15:03:58.523045 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:58.523652 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:58.524740 (+ 1088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:58.525125 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:58.525248 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:58.525656 (+ 408us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 15:03:58.525744 (+ 88us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 15:03:58.525823 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:58.525944 (+ 121us) server_negotiation.cc:299] Negotiation successful
0811 15:03:58.525999 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":23,"server-negotiator.queue_time_us":53}
I20260811 15:03:58.533869 29449 raft_consensus.cc:1261] T 80923b2c71f84dba9a8a92b777b3eb32 P a3f975537fe340ce88bf33d4bdcb8884 [term 1 FOLLOWER]: Refusing update from remote peer 7986206b93f24bd09dc510b1f308ed19: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:03:58.534418 29561 consensus_queue.cc:1035] T 80923b2c71f84dba9a8a92b777b3eb32 P 7986206b93f24bd09dc510b1f308ed19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3f975537fe340ce88bf33d4bdcb8884" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:03:58.534665 29142 raft_consensus.cc:1261] T 80923b2c71f84dba9a8a92b777b3eb32 P c55114e7834d47eb830087dff4cf5242 [term 1 FOLLOWER]: Refusing update from remote peer 7986206b93f24bd09dc510b1f308ed19: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:03:58.535073 29561 consensus_queue.cc:1035] T 80923b2c71f84dba9a8a92b777b3eb32 P 7986206b93f24bd09dc510b1f308ed19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c55114e7834d47eb830087dff4cf5242" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 39839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:03:58.541450 29544 mvcc.cc:205] Tried to move back new op lower bound from 7317342775431139328 to 7317342774386331648. Current Snapshot: MvccSnapshot[applied={T|T < 7317342775431139328}]
I20260811 15:03:58.577261 28963 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56340:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 15:03:58.577456 28963 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56340:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 15:03:58.579658 28963 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 310341f977fe4f90ad0e21aa6f2495d7: Sending DeleteTablet for 3 replicas of tablet 80923b2c71f84dba9a8a92b777b3eb32
I20260811 15:03:58.580313 29275 tablet_service.cc:1514] Processing DeleteTablet for tablet 80923b2c71f84dba9a8a92b777b3eb32 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:03:58 UTC) from {username='oryx', principal='oryx/127.19.236.126@KRBTEST.COM'} at 127.0.0.1:49290
I20260811 15:03:58.580374 29428 tablet_service.cc:1514] Processing DeleteTablet for tablet 80923b2c71f84dba9a8a92b777b3eb32 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:03:58 UTC) from {username='oryx', principal='oryx/127.19.236.126@KRBTEST.COM'} at 127.0.0.1:47390
I20260811 15:03:58.580596 29555 tablet_replica.cc:330] T 80923b2c71f84dba9a8a92b777b3eb32 P a3f975537fe340ce88bf33d4bdcb8884: stopping tablet replica
I20260811 15:03:58.580626 29554 tablet_replica.cc:330] T 80923b2c71f84dba9a8a92b777b3eb32 P 7986206b93f24bd09dc510b1f308ed19: stopping tablet replica
I20260811 15:03:58.580727 29554 raft_consensus.cc:2229] T 80923b2c71f84dba9a8a92b777b3eb32 P 7986206b93f24bd09dc510b1f308ed19 [term 1 LEADER]: Raft consensus shutting down.
I20260811 15:03:58.580727 29555 raft_consensus.cc:2229] T 80923b2c71f84dba9a8a92b777b3eb32 P a3f975537fe340ce88bf33d4bdcb8884 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 15:03:58.580842 29555 raft_consensus.cc:2258] T 80923b2c71f84dba9a8a92b777b3eb32 P a3f975537fe340ce88bf33d4bdcb8884 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:03:58.581070 29554 raft_consensus.cc:2258] T 80923b2c71f84dba9a8a92b777b3eb32 P 7986206b93f24bd09dc510b1f308ed19 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:03:58.581275 29117 tablet_service.cc:1514] Processing DeleteTablet for tablet 80923b2c71f84dba9a8a92b777b3eb32 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:03:58 UTC) from {username='oryx', principal='oryx/127.19.236.126@KRBTEST.COM'} at 127.0.0.1:34464
I20260811 15:03:58.581499 29553 tablet_replica.cc:330] T 80923b2c71f84dba9a8a92b777b3eb32 P c55114e7834d47eb830087dff4cf5242: stopping tablet replica
I20260811 15:03:58.581614 29553 raft_consensus.cc:2229] T 80923b2c71f84dba9a8a92b777b3eb32 P c55114e7834d47eb830087dff4cf5242 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 15:03:58.581743 29553 raft_consensus.cc:2258] T 80923b2c71f84dba9a8a92b777b3eb32 P c55114e7834d47eb830087dff4cf5242 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:03:58.581853 29555 ts_tablet_manager.cc:1905] T 80923b2c71f84dba9a8a92b777b3eb32 P a3f975537fe340ce88bf33d4bdcb8884: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 15:03:58.582442 29554 ts_tablet_manager.cc:1905] T 80923b2c71f84dba9a8a92b777b3eb32 P 7986206b93f24bd09dc510b1f308ed19: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 15:03:58.582470 29553 ts_tablet_manager.cc:1905] T 80923b2c71f84dba9a8a92b777b3eb32 P c55114e7834d47eb830087dff4cf5242: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 15:03:58.585351 29553 ts_tablet_manager.cc:1918] T 80923b2c71f84dba9a8a92b777b3eb32 P c55114e7834d47eb830087dff4cf5242: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 15:03:58.585449 29553 log.cc:1196] T 80923b2c71f84dba9a8a92b777b3eb32 P c55114e7834d47eb830087dff4cf5242: Deleting WAL directory at /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/minicluster-data/ts-0/wal/wals/80923b2c71f84dba9a8a92b777b3eb32
I20260811 15:03:58.585585 29554 ts_tablet_manager.cc:1918] T 80923b2c71f84dba9a8a92b777b3eb32 P 7986206b93f24bd09dc510b1f308ed19: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 15:03:58.585737 29554 log.cc:1196] T 80923b2c71f84dba9a8a92b777b3eb32 P 7986206b93f24bd09dc510b1f308ed19: Deleting WAL directory at /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/minicluster-data/ts-1/wal/wals/80923b2c71f84dba9a8a92b777b3eb32
I20260811 15:03:58.585759 29553 ts_tablet_manager.cc:1939] T 80923b2c71f84dba9a8a92b777b3eb32 P c55114e7834d47eb830087dff4cf5242: Deleting consensus metadata
I20260811 15:03:58.586148 29554 ts_tablet_manager.cc:1939] T 80923b2c71f84dba9a8a92b777b3eb32 P 7986206b93f24bd09dc510b1f308ed19: Deleting consensus metadata
I20260811 15:03:58.586786 28950 catalog_manager.cc:4841] TS c55114e7834d47eb830087dff4cf5242 (127.19.236.65:39839): tablet 80923b2c71f84dba9a8a92b777b3eb32 (table test-table [id=3ec31ce181404114a2129ce783ac5a53]) successfully deleted
I20260811 15:03:58.586866 28951 catalog_manager.cc:4841] TS 7986206b93f24bd09dc510b1f308ed19 (127.19.236.66:32837): tablet 80923b2c71f84dba9a8a92b777b3eb32 (table test-table [id=3ec31ce181404114a2129ce783ac5a53]) successfully deleted
I20260811 15:03:58.587909 29555 ts_tablet_manager.cc:1918] T 80923b2c71f84dba9a8a92b777b3eb32 P a3f975537fe340ce88bf33d4bdcb8884: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 15:03:58.587992 29555 log.cc:1196] T 80923b2c71f84dba9a8a92b777b3eb32 P a3f975537fe340ce88bf33d4bdcb8884: Deleting WAL directory at /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/minicluster-data/ts-2/wal/wals/80923b2c71f84dba9a8a92b777b3eb32
I20260811 15:03:58.588263 29555 ts_tablet_manager.cc:1939] T 80923b2c71f84dba9a8a92b777b3eb32 P a3f975537fe340ce88bf33d4bdcb8884: Deleting consensus metadata
I20260811 15:03:58.590293 28950 catalog_manager.cc:4841] TS a3f975537fe340ce88bf33d4bdcb8884 (127.19.236.67:45119): tablet 80923b2c71f84dba9a8a92b777b3eb32 (table test-table [id=3ec31ce181404114a2129ce783ac5a53]) successfully deleted
Aug 11 15:03:58 dist-test-slave-8n49 krb5kdc[28912](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460638, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 15:03:58 dist-test-slave-8n49 krb5kdc[28912](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 15:03:58 dist-test-slave-8n49 krb5kdc[28912](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
W20260811 15:03:58.615082 29020 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:03:58.607962 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56350 (local address 127.19.236.126:35361)
0811 15:03:58.608146 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:58.608152 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:58.608344 (+ 192us) server_negotiation.cc:407] Connection header received
0811 15:03:58.608450 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:58.608454 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:58.608506 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:58.608635 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:58.609323 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:58.610164 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:58.611076 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:58.611421 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:58.611536 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:58.614924 (+ 3388us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56350: BlockingRecv error: recv got EOF from 127.0.0.1:56350 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
Aug 11 15:03:58 dist-test-slave-8n49 krb5kdc[28912](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460638, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM
I20260811 15:03:58.625438 29020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:58.616970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56362 (local address 127.19.236.126:35361)
0811 15:03:58.617091 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:58.617096 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:58.617296 (+ 200us) server_negotiation.cc:407] Connection header received
0811 15:03:58.617440 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:58.617443 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:58.617541 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:58.617625 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:03:58.618229 (+ 604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:58.618771 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:58.619557 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:58.619775 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:58.619880 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:58.622256 (+ 2376us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:03:58.622260 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:03:58.622263 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:03:58.622290 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:03:58.623727 (+ 1437us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:58.624155 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:58.624158 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:58.624160 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:58.624244 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:03:58.624521 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:03:58.624527 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:03:58.624529 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:03:58.624767 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:03:58.624912 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:58.625145 (+ 233us) server_negotiation.cc:299] Negotiation successful
0811 15:03:58.625265 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 15:03:58.628192 28963 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56362:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 15:03:58.628742 28963 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 15:03:58.634236 29117 tablet_service.cc:1467] Processing CreateTablet for tablet 0956542a462b4b66aa704fabd920ce63 (DEFAULT_TABLE table=test-table [id=f67cf13e41944243861eb9cc628f4c65]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:03:58.634230 29275 tablet_service.cc:1467] Processing CreateTablet for tablet 0956542a462b4b66aa704fabd920ce63 (DEFAULT_TABLE table=test-table [id=f67cf13e41944243861eb9cc628f4c65]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:03:58.634548 29117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0956542a462b4b66aa704fabd920ce63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:03:58.634548 29275 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0956542a462b4b66aa704fabd920ce63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:03:58.637272 29428 tablet_service.cc:1467] Processing CreateTablet for tablet 0956542a462b4b66aa704fabd920ce63 (DEFAULT_TABLE table=test-table [id=f67cf13e41944243861eb9cc628f4c65]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:03:58.637578 29428 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0956542a462b4b66aa704fabd920ce63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:03:58.639585 29532 tablet_bootstrap.cc:492] T 0956542a462b4b66aa704fabd920ce63 P a3f975537fe340ce88bf33d4bdcb8884: Bootstrap starting.
I20260811 15:03:58.639675 29531 tablet_bootstrap.cc:492] T 0956542a462b4b66aa704fabd920ce63 P 7986206b93f24bd09dc510b1f308ed19: Bootstrap starting.
I20260811 15:03:58.640673 29532 tablet_bootstrap.cc:654] T 0956542a462b4b66aa704fabd920ce63 P a3f975537fe340ce88bf33d4bdcb8884: Neither blocks nor log segments found. Creating new log.
I20260811 15:03:58.640710 29531 tablet_bootstrap.cc:654] T 0956542a462b4b66aa704fabd920ce63 P 7986206b93f24bd09dc510b1f308ed19: Neither blocks nor log segments found. Creating new log.
I20260811 15:03:58.641333 29533 tablet_bootstrap.cc:492] T 0956542a462b4b66aa704fabd920ce63 P c55114e7834d47eb830087dff4cf5242: Bootstrap starting.
I20260811 15:03:58.642246 29533 tablet_bootstrap.cc:654] T 0956542a462b4b66aa704fabd920ce63 P c55114e7834d47eb830087dff4cf5242: Neither blocks nor log segments found. Creating new log.
I20260811 15:03:58.643733 29533 tablet_bootstrap.cc:492] T 0956542a462b4b66aa704fabd920ce63 P c55114e7834d47eb830087dff4cf5242: No bootstrap required, opened a new log
I20260811 15:03:58.643834 29533 ts_tablet_manager.cc:1397] T 0956542a462b4b66aa704fabd920ce63 P c55114e7834d47eb830087dff4cf5242: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 15:03:58.643991 29531 tablet_bootstrap.cc:492] T 0956542a462b4b66aa704fabd920ce63 P 7986206b93f24bd09dc510b1f308ed19: No bootstrap required, opened a new log
I20260811 15:03:58.644086 29531 ts_tablet_manager.cc:1397] T 0956542a462b4b66aa704fabd920ce63 P 7986206b93f24bd09dc510b1f308ed19: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20260811 15:03:58.644373 29533 raft_consensus.cc:348] T 0956542a462b4b66aa704fabd920ce63 P c55114e7834d47eb830087dff4cf5242 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c55114e7834d47eb830087dff4cf5242" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 39839 } } peers { permanent_uuid: "7986206b93f24bd09dc510b1f308ed19" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 32837 } } peers { permanent_uuid: "a3f975537fe340ce88bf33d4bdcb8884" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 45119 } }
I20260811 15:03:58.644541 29533 raft_consensus.cc:374] T 0956542a462b4b66aa704fabd920ce63 P c55114e7834d47eb830087dff4cf5242 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:03:58.644616 29533 raft_consensus.cc:729] T 0956542a462b4b66aa704fabd920ce63 P c55114e7834d47eb830087dff4cf5242 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c55114e7834d47eb830087dff4cf5242, State: Initialized, Role: FOLLOWER
I20260811 15:03:58.644598 29531 raft_consensus.cc:348] T 0956542a462b4b66aa704fabd920ce63 P 7986206b93f24bd09dc510b1f308ed19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c55114e7834d47eb830087dff4cf5242" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 39839 } } peers { permanent_uuid: "7986206b93f24bd09dc510b1f308ed19" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 32837 } } peers { permanent_uuid: "a3f975537fe340ce88bf33d4bdcb8884" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 45119 } }
I20260811 15:03:58.644701 29531 raft_consensus.cc:374] T 0956542a462b4b66aa704fabd920ce63 P 7986206b93f24bd09dc510b1f308ed19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:03:58.644739 29531 raft_consensus.cc:729] T 0956542a462b4b66aa704fabd920ce63 P 7986206b93f24bd09dc510b1f308ed19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7986206b93f24bd09dc510b1f308ed19, State: Initialized, Role: FOLLOWER
I20260811 15:03:58.644755 29533 consensus_queue.cc:260] T 0956542a462b4b66aa704fabd920ce63 P c55114e7834d47eb830087dff4cf5242 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c55114e7834d47eb830087dff4cf5242" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 39839 } } peers { permanent_uuid: "7986206b93f24bd09dc510b1f308ed19" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 32837 } } peers { permanent_uuid: "a3f975537fe340ce88bf33d4bdcb8884" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 45119 } }
I20260811 15:03:58.644853 29531 consensus_queue.cc:260] T 0956542a462b4b66aa704fabd920ce63 P 7986206b93f24bd09dc510b1f308ed19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c55114e7834d47eb830087dff4cf5242" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 39839 } } peers { permanent_uuid: "7986206b93f24bd09dc510b1f308ed19" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 32837 } } peers { permanent_uuid: "a3f975537fe340ce88bf33d4bdcb8884" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 45119 } }
I20260811 15:03:58.645056 29533 ts_tablet_manager.cc:1428] T 0956542a462b4b66aa704fabd920ce63 P c55114e7834d47eb830087dff4cf5242: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260811 15:03:58.645947 29531 ts_tablet_manager.cc:1428] T 0956542a462b4b66aa704fabd920ce63 P 7986206b93f24bd09dc510b1f308ed19: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260811 15:03:58.646914 29532 tablet_bootstrap.cc:492] T 0956542a462b4b66aa704fabd920ce63 P a3f975537fe340ce88bf33d4bdcb8884: No bootstrap required, opened a new log
I20260811 15:03:58.647008 29532 ts_tablet_manager.cc:1397] T 0956542a462b4b66aa704fabd920ce63 P a3f975537fe340ce88bf33d4bdcb8884: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.002s
I20260811 15:03:58.647388 29532 raft_consensus.cc:348] T 0956542a462b4b66aa704fabd920ce63 P a3f975537fe340ce88bf33d4bdcb8884 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c55114e7834d47eb830087dff4cf5242" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 39839 } } peers { permanent_uuid: "7986206b93f24bd09dc510b1f308ed19" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 32837 } } peers { permanent_uuid: "a3f975537fe340ce88bf33d4bdcb8884" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 45119 } }
I20260811 15:03:58.647501 29532 raft_consensus.cc:374] T 0956542a462b4b66aa704fabd920ce63 P a3f975537fe340ce88bf33d4bdcb8884 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:03:58.647529 29532 raft_consensus.cc:729] T 0956542a462b4b66aa704fabd920ce63 P a3f975537fe340ce88bf33d4bdcb8884 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3f975537fe340ce88bf33d4bdcb8884, State: Initialized, Role: FOLLOWER
I20260811 15:03:58.647650 29532 consensus_queue.cc:260] T 0956542a462b4b66aa704fabd920ce63 P a3f975537fe340ce88bf33d4bdcb8884 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c55114e7834d47eb830087dff4cf5242" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 39839 } } peers { permanent_uuid: "7986206b93f24bd09dc510b1f308ed19" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 32837 } } peers { permanent_uuid: "a3f975537fe340ce88bf33d4bdcb8884" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 45119 } }
I20260811 15:03:58.647892 29532 ts_tablet_manager.cc:1428] T 0956542a462b4b66aa704fabd920ce63 P a3f975537fe340ce88bf33d4bdcb8884: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260811 15:03:58.666586 29539 raft_consensus.cc:482] T 0956542a462b4b66aa704fabd920ce63 P c55114e7834d47eb830087dff4cf5242 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 15:03:58.666757 29539 raft_consensus.cc:504] T 0956542a462b4b66aa704fabd920ce63 P c55114e7834d47eb830087dff4cf5242 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c55114e7834d47eb830087dff4cf5242" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 39839 } } peers { permanent_uuid: "7986206b93f24bd09dc510b1f308ed19" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 32837 } } peers { permanent_uuid: "a3f975537fe340ce88bf33d4bdcb8884" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 45119 } }
I20260811 15:03:58.668028 29539 leader_election.cc:288] T 0956542a462b4b66aa704fabd920ce63 P c55114e7834d47eb830087dff4cf5242 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7986206b93f24bd09dc510b1f308ed19 (127.19.236.66:32837), a3f975537fe340ce88bf33d4bdcb8884 (127.19.236.67:45119)
I20260811 15:03:58.673318 29524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:58.668910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.65:44693 (local address 127.19.236.66:32837)
0811 15:03:58.669032 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:58.669039 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:58.669056 (+ 17us) server_negotiation.cc:407] Connection header received
0811 15:03:58.669119 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:58.669122 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:58.669301 (+ 179us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:58.669377 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:03:58.669751 (+ 374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:58.670243 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:58.672064 (+ 1821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:58.672724 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:58.672856 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:58.672910 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:58.673117 (+ 207us) server_negotiation.cc:299] Negotiation successful
0811 15:03:58.673191 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 15:03:58.673357 29607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:58.668242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.66:32837 (local address 127.19.236.65:44693)
0811 15:03:58.668676 (+ 434us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:58.668692 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:58.668810 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:58.669479 (+ 669us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:58.669482 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:58.669498 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:03:58.669626 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:58.669632 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:58.670364 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:58.670367 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:58.671914 (+ 1547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:58.671921 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:58.672864 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:58.672868 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:58.672974 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:58.673001 (+ 27us) client_negotiation.cc:769] Sending connection context
0811 15:03:58.673083 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 15:03:58.673158 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":352,"mutex_wait_us":85,"thread_start_us":113,"threads_started":1}
I20260811 15:03:58.673866 29299 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0956542a462b4b66aa704fabd920ce63" candidate_uuid: "c55114e7834d47eb830087dff4cf5242" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7986206b93f24bd09dc510b1f308ed19" is_pre_election: true
I20260811 15:03:58.674036 29299 raft_consensus.cc:2454] T 0956542a462b4b66aa704fabd920ce63 P 7986206b93f24bd09dc510b1f308ed19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c55114e7834d47eb830087dff4cf5242 in term 0.
I20260811 15:03:58.674324 29527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:58.668735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.65:52255 (local address 127.19.236.67:45119)
0811 15:03:58.669057 (+ 322us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:58.669062 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:58.669076 (+ 14us) server_negotiation.cc:407] Connection header received
0811 15:03:58.669129 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:58.669132 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:58.669178 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:58.669255 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:03:58.669625 (+ 370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:58.670416 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:58.672653 (+ 2237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:58.673241 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:58.673361 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:58.673426 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:58.674103 (+ 677us) server_negotiation.cc:299] Negotiation successful
0811 15:03:58.674203 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":218}
I20260811 15:03:58.674419 29606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:58.668347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.67:45119 (local address 127.19.236.65:52255)
0811 15:03:58.668729 (+ 382us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:58.668744 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:58.668849 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:58.669299 (+ 450us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:58.669302 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:58.669322 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:03:58.669480 (+ 158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:58.669487 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:58.670550 (+ 1063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:58.670553 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:58.671908 (+ 1355us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:58.671921 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:58.673800 (+ 1879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:58.673804 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:58.673916 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:58.673943 (+ 27us) client_negotiation.cc:769] Sending connection context
0811 15:03:58.674071 (+ 128us) client_negotiation.cc:240] Negotiation successful
0811 15:03:58.674145 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":316,"mutex_wait_us":36,"thread_start_us":124,"threads_started":1}
I20260811 15:03:58.674417 29068 leader_election.cc:302] T 0956542a462b4b66aa704fabd920ce63 P c55114e7834d47eb830087dff4cf5242 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7986206b93f24bd09dc510b1f308ed19, c55114e7834d47eb830087dff4cf5242; no voters:
I20260811 15:03:58.674759 29539 raft_consensus.cc:2781] T 0956542a462b4b66aa704fabd920ce63 P c55114e7834d47eb830087dff4cf5242 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 15:03:58.674823 29539 raft_consensus.cc:482] T 0956542a462b4b66aa704fabd920ce63 P c55114e7834d47eb830087dff4cf5242 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 15:03:58.674871 29539 raft_consensus.cc:3037] T 0956542a462b4b66aa704fabd920ce63 P c55114e7834d47eb830087dff4cf5242 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:03:58.674836 29449 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0956542a462b4b66aa704fabd920ce63" candidate_uuid: "c55114e7834d47eb830087dff4cf5242" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3f975537fe340ce88bf33d4bdcb8884" is_pre_election: true
I20260811 15:03:58.674990 29449 raft_consensus.cc:2454] T 0956542a462b4b66aa704fabd920ce63 P a3f975537fe340ce88bf33d4bdcb8884 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c55114e7834d47eb830087dff4cf5242 in term 0.
I20260811 15:03:58.676280 29539 raft_consensus.cc:504] T 0956542a462b4b66aa704fabd920ce63 P c55114e7834d47eb830087dff4cf5242 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c55114e7834d47eb830087dff4cf5242" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 39839 } } peers { permanent_uuid: "7986206b93f24bd09dc510b1f308ed19" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 32837 } } peers { permanent_uuid: "a3f975537fe340ce88bf33d4bdcb8884" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 45119 } }
I20260811 15:03:58.676707 29539 leader_election.cc:288] T 0956542a462b4b66aa704fabd920ce63 P c55114e7834d47eb830087dff4cf5242 [CANDIDATE]: Term 1 election: Requested vote from peers 7986206b93f24bd09dc510b1f308ed19 (127.19.236.66:32837), a3f975537fe340ce88bf33d4bdcb8884 (127.19.236.67:45119)
I20260811 15:03:58.676986 29299 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0956542a462b4b66aa704fabd920ce63" candidate_uuid: "c55114e7834d47eb830087dff4cf5242" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7986206b93f24bd09dc510b1f308ed19"
I20260811 15:03:58.677101 29299 raft_consensus.cc:3037] T 0956542a462b4b66aa704fabd920ce63 P 7986206b93f24bd09dc510b1f308ed19 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:03:58.677172 29449 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0956542a462b4b66aa704fabd920ce63" candidate_uuid: "c55114e7834d47eb830087dff4cf5242" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3f975537fe340ce88bf33d4bdcb8884"
I20260811 15:03:58.677292 29449 raft_consensus.cc:3037] T 0956542a462b4b66aa704fabd920ce63 P a3f975537fe340ce88bf33d4bdcb8884 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:03:58.677983 29299 raft_consensus.cc:2454] T 0956542a462b4b66aa704fabd920ce63 P 7986206b93f24bd09dc510b1f308ed19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c55114e7834d47eb830087dff4cf5242 in term 1.
I20260811 15:03:58.678249 29068 leader_election.cc:302] T 0956542a462b4b66aa704fabd920ce63 P c55114e7834d47eb830087dff4cf5242 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7986206b93f24bd09dc510b1f308ed19, c55114e7834d47eb830087dff4cf5242; no voters:
I20260811 15:03:58.678422 29539 raft_consensus.cc:2781] T 0956542a462b4b66aa704fabd920ce63 P c55114e7834d47eb830087dff4cf5242 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:03:58.678469 29449 raft_consensus.cc:2454] T 0956542a462b4b66aa704fabd920ce63 P a3f975537fe340ce88bf33d4bdcb8884 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c55114e7834d47eb830087dff4cf5242 in term 1.
I20260811 15:03:58.678646 29539 raft_consensus.cc:686] T 0956542a462b4b66aa704fabd920ce63 P c55114e7834d47eb830087dff4cf5242 [term 1 LEADER]: Becoming Leader. State: Replica: c55114e7834d47eb830087dff4cf5242, State: Running, Role: LEADER
I20260811 15:03:58.678926 29539 consensus_queue.cc:237] T 0956542a462b4b66aa704fabd920ce63 P c55114e7834d47eb830087dff4cf5242 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c55114e7834d47eb830087dff4cf5242" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 39839 } } peers { permanent_uuid: "7986206b93f24bd09dc510b1f308ed19" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 32837 } } peers { permanent_uuid: "a3f975537fe340ce88bf33d4bdcb8884" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 45119 } }
I20260811 15:03:58.681386 28964 catalog_manager.cc:5495] T 0956542a462b4b66aa704fabd920ce63 P c55114e7834d47eb830087dff4cf5242 reported cstate change: term changed from 0 to 1, leader changed from <none> to c55114e7834d47eb830087dff4cf5242 (127.19.236.65). New cstate: current_term: 1 leader_uuid: "c55114e7834d47eb830087dff4cf5242" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c55114e7834d47eb830087dff4cf5242" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 39839 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7986206b93f24bd09dc510b1f308ed19" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 32837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3f975537fe340ce88bf33d4bdcb8884" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 45119 } health_report { overall_health: UNKNOWN } } }
I20260811 15:03:58.694339 29529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:58.690522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34474 (local address 127.19.236.65:39839)
0811 15:03:58.690673 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:58.690677 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:58.690692 (+ 15us) server_negotiation.cc:407] Connection header received
0811 15:03:58.690873 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:58.690876 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:58.690933 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:58.691049 (+ 116us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 15:03:58.691342 (+ 293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:58.691850 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:58.692808 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:58.693041 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:58.693153 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:58.693463 (+ 310us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 15:03:58.693930 (+ 467us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 15:03:58.694070 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:58.694133 (+ 63us) server_negotiation.cc:299] Negotiation successful
0811 15:03:58.694191 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 15:03:58.697265 29299 raft_consensus.cc:1261] T 0956542a462b4b66aa704fabd920ce63 P 7986206b93f24bd09dc510b1f308ed19 [term 1 FOLLOWER]: Refusing update from remote peer c55114e7834d47eb830087dff4cf5242: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:03:58.697237 29449 raft_consensus.cc:1261] T 0956542a462b4b66aa704fabd920ce63 P a3f975537fe340ce88bf33d4bdcb8884 [term 1 FOLLOWER]: Refusing update from remote peer c55114e7834d47eb830087dff4cf5242: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:03:58.697885 29539 consensus_queue.cc:1035] T 0956542a462b4b66aa704fabd920ce63 P c55114e7834d47eb830087dff4cf5242 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3f975537fe340ce88bf33d4bdcb8884" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:03:58.698144 29608 consensus_queue.cc:1035] T 0956542a462b4b66aa704fabd920ce63 P c55114e7834d47eb830087dff4cf5242 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7986206b93f24bd09dc510b1f308ed19" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 32837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:03:58.711768 28963 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56362:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 15:03:58.711953 28963 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56362:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 15:03:58.714403 28963 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 310341f977fe4f90ad0e21aa6f2495d7: Sending DeleteTablet for 3 replicas of tablet 0956542a462b4b66aa704fabd920ce63
I20260811 15:03:58.715399 29275 tablet_service.cc:1514] Processing DeleteTablet for tablet 0956542a462b4b66aa704fabd920ce63 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:03:58 UTC) from {username='oryx', principal='oryx/127.19.236.126@KRBTEST.COM'} at 127.0.0.1:49290
I20260811 15:03:58.715538 29117 tablet_service.cc:1514] Processing DeleteTablet for tablet 0956542a462b4b66aa704fabd920ce63 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:03:58 UTC) from {username='oryx', principal='oryx/127.19.236.126@KRBTEST.COM'} at 127.0.0.1:34464
I20260811 15:03:58.715746 29428 tablet_service.cc:1514] Processing DeleteTablet for tablet 0956542a462b4b66aa704fabd920ce63 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:03:58 UTC) from {username='oryx', principal='oryx/127.19.236.126@KRBTEST.COM'} at 127.0.0.1:47390
I20260811 15:03:58.716370 29554 tablet_replica.cc:330] T 0956542a462b4b66aa704fabd920ce63 P 7986206b93f24bd09dc510b1f308ed19: stopping tablet replica
I20260811 15:03:58.716535 29554 raft_consensus.cc:2229] T 0956542a462b4b66aa704fabd920ce63 P 7986206b93f24bd09dc510b1f308ed19 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 15:03:58.716696 29555 tablet_replica.cc:330] T 0956542a462b4b66aa704fabd920ce63 P a3f975537fe340ce88bf33d4bdcb8884: stopping tablet replica
I20260811 15:03:58.716727 29554 raft_consensus.cc:2258] T 0956542a462b4b66aa704fabd920ce63 P 7986206b93f24bd09dc510b1f308ed19 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:03:58.716835 29555 raft_consensus.cc:2229] T 0956542a462b4b66aa704fabd920ce63 P a3f975537fe340ce88bf33d4bdcb8884 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 15:03:58.716974 29555 raft_consensus.cc:2258] T 0956542a462b4b66aa704fabd920ce63 P a3f975537fe340ce88bf33d4bdcb8884 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:03:58.717159 29553 tablet_replica.cc:330] T 0956542a462b4b66aa704fabd920ce63 P c55114e7834d47eb830087dff4cf5242: stopping tablet replica
I20260811 15:03:58.717278 29553 raft_consensus.cc:2229] T 0956542a462b4b66aa704fabd920ce63 P c55114e7834d47eb830087dff4cf5242 [term 1 LEADER]: Raft consensus shutting down.
I20260811 15:03:58.717605 29553 raft_consensus.cc:2258] T 0956542a462b4b66aa704fabd920ce63 P c55114e7834d47eb830087dff4cf5242 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:03:58.717671 29554 ts_tablet_manager.cc:1905] T 0956542a462b4b66aa704fabd920ce63 P 7986206b93f24bd09dc510b1f308ed19: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 15:03:58.718758 29553 ts_tablet_manager.cc:1905] T 0956542a462b4b66aa704fabd920ce63 P c55114e7834d47eb830087dff4cf5242: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 15:03:58.720302 29554 ts_tablet_manager.cc:1918] T 0956542a462b4b66aa704fabd920ce63 P 7986206b93f24bd09dc510b1f308ed19: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 15:03:58.720377 29554 log.cc:1196] T 0956542a462b4b66aa704fabd920ce63 P 7986206b93f24bd09dc510b1f308ed19: Deleting WAL directory at /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/minicluster-data/ts-1/wal/wals/0956542a462b4b66aa704fabd920ce63
I20260811 15:03:58.720666 29554 ts_tablet_manager.cc:1939] T 0956542a462b4b66aa704fabd920ce63 P 7986206b93f24bd09dc510b1f308ed19: Deleting consensus metadata
I20260811 15:03:58.721156 28963 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56362:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 15:03:58.721480 29553 ts_tablet_manager.cc:1918] T 0956542a462b4b66aa704fabd920ce63 P c55114e7834d47eb830087dff4cf5242: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 15:03:58.721550 29553 log.cc:1196] T 0956542a462b4b66aa704fabd920ce63 P c55114e7834d47eb830087dff4cf5242: Deleting WAL directory at /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/minicluster-data/ts-0/wal/wals/0956542a462b4b66aa704fabd920ce63
W20260811 15:03:58.721659 28963 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 15:03:58.721799 29553 ts_tablet_manager.cc:1939] T 0956542a462b4b66aa704fabd920ce63 P c55114e7834d47eb830087dff4cf5242: Deleting consensus metadata
I20260811 15:03:58.722474 28950 catalog_manager.cc:4841] TS c55114e7834d47eb830087dff4cf5242 (127.19.236.65:39839): tablet 0956542a462b4b66aa704fabd920ce63 (table test-table [id=f67cf13e41944243861eb9cc628f4c65]) successfully deleted
I20260811 15:03:58.723482 28951 catalog_manager.cc:4841] TS 7986206b93f24bd09dc510b1f308ed19 (127.19.236.66:32837): tablet 0956542a462b4b66aa704fabd920ce63 (table test-table [id=f67cf13e41944243861eb9cc628f4c65]) successfully deleted
I20260811 15:03:58.725234 29555 ts_tablet_manager.cc:1905] T 0956542a462b4b66aa704fabd920ce63 P a3f975537fe340ce88bf33d4bdcb8884: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 15:03:58.727478 29555 ts_tablet_manager.cc:1918] T 0956542a462b4b66aa704fabd920ce63 P a3f975537fe340ce88bf33d4bdcb8884: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 15:03:58.727576 29555 log.cc:1196] T 0956542a462b4b66aa704fabd920ce63 P a3f975537fe340ce88bf33d4bdcb8884: Deleting WAL directory at /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/minicluster-data/ts-2/wal/wals/0956542a462b4b66aa704fabd920ce63
I20260811 15:03:58.727819 29555 ts_tablet_manager.cc:1939] T 0956542a462b4b66aa704fabd920ce63 P a3f975537fe340ce88bf33d4bdcb8884: Deleting consensus metadata
I20260811 15:03:58.728497 28950 catalog_manager.cc:4841] TS a3f975537fe340ce88bf33d4bdcb8884 (127.19.236.67:45119): tablet 0956542a462b4b66aa704fabd920ce63 (table test-table [id=f67cf13e41944243861eb9cc628f4c65]) successfully deleted
I20260811 15:03:58.729112 29117 tablet_service.cc:1467] Processing CreateTablet for tablet d7d971eb59474f618d98aa30ef999bd3 (DEFAULT_TABLE table=test-table [id=f5f45caf365e4713a67e2d1e49a68c33]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:03:58.729396 29117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d7d971eb59474f618d98aa30ef999bd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:03:58.731405 29533 tablet_bootstrap.cc:492] T d7d971eb59474f618d98aa30ef999bd3 P c55114e7834d47eb830087dff4cf5242: Bootstrap starting.
I20260811 15:03:58.732218 29533 tablet_bootstrap.cc:654] T d7d971eb59474f618d98aa30ef999bd3 P c55114e7834d47eb830087dff4cf5242: Neither blocks nor log segments found. Creating new log.
I20260811 15:03:58.733480 29275 tablet_service.cc:1467] Processing CreateTablet for tablet d7d971eb59474f618d98aa30ef999bd3 (DEFAULT_TABLE table=test-table [id=f5f45caf365e4713a67e2d1e49a68c33]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:03:58.733759 29275 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d7d971eb59474f618d98aa30ef999bd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:03:58.733847 29428 tablet_service.cc:1467] Processing CreateTablet for tablet d7d971eb59474f618d98aa30ef999bd3 (DEFAULT_TABLE table=test-table [id=f5f45caf365e4713a67e2d1e49a68c33]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:03:58.734102 29428 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d7d971eb59474f618d98aa30ef999bd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:03:58.736414 29532 tablet_bootstrap.cc:492] T d7d971eb59474f618d98aa30ef999bd3 P a3f975537fe340ce88bf33d4bdcb8884: Bootstrap starting.
I20260811 15:03:58.736542 29531 tablet_bootstrap.cc:492] T d7d971eb59474f618d98aa30ef999bd3 P 7986206b93f24bd09dc510b1f308ed19: Bootstrap starting.
I20260811 15:03:58.737291 29531 tablet_bootstrap.cc:654] T d7d971eb59474f618d98aa30ef999bd3 P 7986206b93f24bd09dc510b1f308ed19: Neither blocks nor log segments found. Creating new log.
I20260811 15:03:58.737291 29532 tablet_bootstrap.cc:654] T d7d971eb59474f618d98aa30ef999bd3 P a3f975537fe340ce88bf33d4bdcb8884: Neither blocks nor log segments found. Creating new log.
I20260811 15:03:58.738476 29533 tablet_bootstrap.cc:492] T d7d971eb59474f618d98aa30ef999bd3 P c55114e7834d47eb830087dff4cf5242: No bootstrap required, opened a new log
I20260811 15:03:58.738585 29533 ts_tablet_manager.cc:1397] T d7d971eb59474f618d98aa30ef999bd3 P c55114e7834d47eb830087dff4cf5242: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.001s
I20260811 15:03:58.739013 29533 raft_consensus.cc:348] T d7d971eb59474f618d98aa30ef999bd3 P c55114e7834d47eb830087dff4cf5242 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c55114e7834d47eb830087dff4cf5242" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 39839 } } peers { permanent_uuid: "7986206b93f24bd09dc510b1f308ed19" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 32837 } } peers { permanent_uuid: "a3f975537fe340ce88bf33d4bdcb8884" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 45119 } }
I20260811 15:03:58.739187 29533 raft_consensus.cc:374] T d7d971eb59474f618d98aa30ef999bd3 P c55114e7834d47eb830087dff4cf5242 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:03:58.739230 29533 raft_consensus.cc:729] T d7d971eb59474f618d98aa30ef999bd3 P c55114e7834d47eb830087dff4cf5242 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c55114e7834d47eb830087dff4cf5242, State: Initialized, Role: FOLLOWER
I20260811 15:03:58.739367 29533 consensus_queue.cc:260] T d7d971eb59474f618d98aa30ef999bd3 P c55114e7834d47eb830087dff4cf5242 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c55114e7834d47eb830087dff4cf5242" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 39839 } } peers { permanent_uuid: "7986206b93f24bd09dc510b1f308ed19" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 32837 } } peers { permanent_uuid: "a3f975537fe340ce88bf33d4bdcb8884" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 45119 } }
I20260811 15:03:58.739661 29533 ts_tablet_manager.cc:1428] T d7d971eb59474f618d98aa30ef999bd3 P c55114e7834d47eb830087dff4cf5242: Time spent starting tablet: real 0.001s user 0.000s sys 0.002s
I20260811 15:03:58.741417 29531 tablet_bootstrap.cc:492] T d7d971eb59474f618d98aa30ef999bd3 P 7986206b93f24bd09dc510b1f308ed19: No bootstrap required, opened a new log
I20260811 15:03:58.741508 29531 ts_tablet_manager.cc:1397] T d7d971eb59474f618d98aa30ef999bd3 P 7986206b93f24bd09dc510b1f308ed19: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.001s
I20260811 15:03:58.741932 29531 raft_consensus.cc:348] T d7d971eb59474f618d98aa30ef999bd3 P 7986206b93f24bd09dc510b1f308ed19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c55114e7834d47eb830087dff4cf5242" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 39839 } } peers { permanent_uuid: "7986206b93f24bd09dc510b1f308ed19" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 32837 } } peers { permanent_uuid: "a3f975537fe340ce88bf33d4bdcb8884" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 45119 } }
I20260811 15:03:58.742050 29531 raft_consensus.cc:374] T d7d971eb59474f618d98aa30ef999bd3 P 7986206b93f24bd09dc510b1f308ed19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:03:58.742094 29531 raft_consensus.cc:729] T d7d971eb59474f618d98aa30ef999bd3 P 7986206b93f24bd09dc510b1f308ed19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7986206b93f24bd09dc510b1f308ed19, State: Initialized, Role: FOLLOWER
I20260811 15:03:58.742224 29531 consensus_queue.cc:260] T d7d971eb59474f618d98aa30ef999bd3 P 7986206b93f24bd09dc510b1f308ed19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c55114e7834d47eb830087dff4cf5242" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 39839 } } peers { permanent_uuid: "7986206b93f24bd09dc510b1f308ed19" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 32837 } } peers { permanent_uuid: "a3f975537fe340ce88bf33d4bdcb8884" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 45119 } }
I20260811 15:03:58.742482 29531 ts_tablet_manager.cc:1428] T d7d971eb59474f618d98aa30ef999bd3 P 7986206b93f24bd09dc510b1f308ed19: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20260811 15:03:58.744801 29532 tablet_bootstrap.cc:492] T d7d971eb59474f618d98aa30ef999bd3 P a3f975537fe340ce88bf33d4bdcb8884: No bootstrap required, opened a new log
I20260811 15:03:58.744920 29532 ts_tablet_manager.cc:1397] T d7d971eb59474f618d98aa30ef999bd3 P a3f975537fe340ce88bf33d4bdcb8884: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20260811 15:03:58.745282 29532 raft_consensus.cc:348] T d7d971eb59474f618d98aa30ef999bd3 P a3f975537fe340ce88bf33d4bdcb8884 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c55114e7834d47eb830087dff4cf5242" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 39839 } } peers { permanent_uuid: "7986206b93f24bd09dc510b1f308ed19" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 32837 } } peers { permanent_uuid: "a3f975537fe340ce88bf33d4bdcb8884" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 45119 } }
I20260811 15:03:58.745414 29532 raft_consensus.cc:374] T d7d971eb59474f618d98aa30ef999bd3 P a3f975537fe340ce88bf33d4bdcb8884 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:03:58.745456 29532 raft_consensus.cc:729] T d7d971eb59474f618d98aa30ef999bd3 P a3f975537fe340ce88bf33d4bdcb8884 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3f975537fe340ce88bf33d4bdcb8884, State: Initialized, Role: FOLLOWER
I20260811 15:03:58.745615 29532 consensus_queue.cc:260] T d7d971eb59474f618d98aa30ef999bd3 P a3f975537fe340ce88bf33d4bdcb8884 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c55114e7834d47eb830087dff4cf5242" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 39839 } } peers { permanent_uuid: "7986206b93f24bd09dc510b1f308ed19" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 32837 } } peers { permanent_uuid: "a3f975537fe340ce88bf33d4bdcb8884" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 45119 } }
I20260811 15:03:58.745898 29532 ts_tablet_manager.cc:1428] T d7d971eb59474f618d98aa30ef999bd3 P a3f975537fe340ce88bf33d4bdcb8884: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 15:03:58.826030 29541 raft_consensus.cc:482] T d7d971eb59474f618d98aa30ef999bd3 P a3f975537fe340ce88bf33d4bdcb8884 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 15:03:58.826346 29541 raft_consensus.cc:504] T d7d971eb59474f618d98aa30ef999bd3 P a3f975537fe340ce88bf33d4bdcb8884 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c55114e7834d47eb830087dff4cf5242" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 39839 } } peers { permanent_uuid: "7986206b93f24bd09dc510b1f308ed19" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 32837 } } peers { permanent_uuid: "a3f975537fe340ce88bf33d4bdcb8884" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 45119 } }
I20260811 15:03:58.826916 29541 leader_election.cc:288] T d7d971eb59474f618d98aa30ef999bd3 P a3f975537fe340ce88bf33d4bdcb8884 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c55114e7834d47eb830087dff4cf5242 (127.19.236.65:39839), 7986206b93f24bd09dc510b1f308ed19 (127.19.236.66:32837)
I20260811 15:03:58.827521 29299 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7d971eb59474f618d98aa30ef999bd3" candidate_uuid: "a3f975537fe340ce88bf33d4bdcb8884" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7986206b93f24bd09dc510b1f308ed19" is_pre_election: true
I20260811 15:03:58.827704 29299 raft_consensus.cc:2454] T d7d971eb59474f618d98aa30ef999bd3 P 7986206b93f24bd09dc510b1f308ed19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3f975537fe340ce88bf33d4bdcb8884 in term 0.
I20260811 15:03:58.827790 29141 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7d971eb59474f618d98aa30ef999bd3" candidate_uuid: "a3f975537fe340ce88bf33d4bdcb8884" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c55114e7834d47eb830087dff4cf5242" is_pre_election: true
I20260811 15:03:58.827947 29141 raft_consensus.cc:2454] T d7d971eb59474f618d98aa30ef999bd3 P c55114e7834d47eb830087dff4cf5242 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3f975537fe340ce88bf33d4bdcb8884 in term 0.
I20260811 15:03:58.828209 29380 leader_election.cc:302] T d7d971eb59474f618d98aa30ef999bd3 P a3f975537fe340ce88bf33d4bdcb8884 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7986206b93f24bd09dc510b1f308ed19, a3f975537fe340ce88bf33d4bdcb8884; no voters:
I20260811 15:03:58.828414 29541 raft_consensus.cc:2781] T d7d971eb59474f618d98aa30ef999bd3 P a3f975537fe340ce88bf33d4bdcb8884 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 15:03:58.828480 29541 raft_consensus.cc:482] T d7d971eb59474f618d98aa30ef999bd3 P a3f975537fe340ce88bf33d4bdcb8884 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 15:03:58.828514 29541 raft_consensus.cc:3037] T d7d971eb59474f618d98aa30ef999bd3 P a3f975537fe340ce88bf33d4bdcb8884 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:03:58.829912 29541 raft_consensus.cc:504] T d7d971eb59474f618d98aa30ef999bd3 P a3f975537fe340ce88bf33d4bdcb8884 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c55114e7834d47eb830087dff4cf5242" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 39839 } } peers { permanent_uuid: "7986206b93f24bd09dc510b1f308ed19" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 32837 } } peers { permanent_uuid: "a3f975537fe340ce88bf33d4bdcb8884" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 45119 } }
I20260811 15:03:58.830299 29541 leader_election.cc:288] T d7d971eb59474f618d98aa30ef999bd3 P a3f975537fe340ce88bf33d4bdcb8884 [CANDIDATE]: Term 1 election: Requested vote from peers c55114e7834d47eb830087dff4cf5242 (127.19.236.65:39839), 7986206b93f24bd09dc510b1f308ed19 (127.19.236.66:32837)
I20260811 15:03:58.830716 29299 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7d971eb59474f618d98aa30ef999bd3" candidate_uuid: "a3f975537fe340ce88bf33d4bdcb8884" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7986206b93f24bd09dc510b1f308ed19"
I20260811 15:03:58.830737 29141 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d7d971eb59474f618d98aa30ef999bd3" candidate_uuid: "a3f975537fe340ce88bf33d4bdcb8884" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c55114e7834d47eb830087dff4cf5242"
I20260811 15:03:58.830866 29141 raft_consensus.cc:3037] T d7d971eb59474f618d98aa30ef999bd3 P c55114e7834d47eb830087dff4cf5242 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:03:58.830870 29299 raft_consensus.cc:3037] T d7d971eb59474f618d98aa30ef999bd3 P 7986206b93f24bd09dc510b1f308ed19 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:03:58.832207 29299 raft_consensus.cc:2454] T d7d971eb59474f618d98aa30ef999bd3 P 7986206b93f24bd09dc510b1f308ed19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3f975537fe340ce88bf33d4bdcb8884 in term 1.
I20260811 15:03:58.832267 29141 raft_consensus.cc:2454] T d7d971eb59474f618d98aa30ef999bd3 P c55114e7834d47eb830087dff4cf5242 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3f975537fe340ce88bf33d4bdcb8884 in term 1.
I20260811 15:03:58.832674 29380 leader_election.cc:302] T d7d971eb59474f618d98aa30ef999bd3 P a3f975537fe340ce88bf33d4bdcb8884 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7986206b93f24bd09dc510b1f308ed19, a3f975537fe340ce88bf33d4bdcb8884; no voters:
I20260811 15:03:58.832866 29541 raft_consensus.cc:2781] T d7d971eb59474f618d98aa30ef999bd3 P a3f975537fe340ce88bf33d4bdcb8884 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:03:58.833017 29541 raft_consensus.cc:686] T d7d971eb59474f618d98aa30ef999bd3 P a3f975537fe340ce88bf33d4bdcb8884 [term 1 LEADER]: Becoming Leader. State: Replica: a3f975537fe340ce88bf33d4bdcb8884, State: Running, Role: LEADER
I20260811 15:03:58.833180 29541 consensus_queue.cc:237] T d7d971eb59474f618d98aa30ef999bd3 P a3f975537fe340ce88bf33d4bdcb8884 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c55114e7834d47eb830087dff4cf5242" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 39839 } } peers { permanent_uuid: "7986206b93f24bd09dc510b1f308ed19" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 32837 } } peers { permanent_uuid: "a3f975537fe340ce88bf33d4bdcb8884" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 45119 } }
I20260811 15:03:58.835157 28964 catalog_manager.cc:5495] T d7d971eb59474f618d98aa30ef999bd3 P a3f975537fe340ce88bf33d4bdcb8884 reported cstate change: term changed from 0 to 1, leader changed from <none> to a3f975537fe340ce88bf33d4bdcb8884 (127.19.236.67). New cstate: current_term: 1 leader_uuid: "a3f975537fe340ce88bf33d4bdcb8884" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c55114e7834d47eb830087dff4cf5242" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 39839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7986206b93f24bd09dc510b1f308ed19" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 32837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3f975537fe340ce88bf33d4bdcb8884" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 45119 } health_report { overall_health: HEALTHY } } }
I20260811 15:03:58.857640 29527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:58.854025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47414 (local address 127.19.236.67:45119)
0811 15:03:58.854133 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:58.854137 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:58.854158 (+ 21us) server_negotiation.cc:407] Connection header received
0811 15:03:58.854285 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:58.854288 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:58.854332 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:58.854397 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 15:03:58.854720 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:58.855234 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:58.856510 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:58.856788 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:58.856891 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:58.857180 (+ 289us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 15:03:58.857249 (+ 69us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 15:03:58.857303 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:58.857448 (+ 145us) server_negotiation.cc:299] Negotiation successful
0811 15:03:58.857493 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 15:03:58.868834 29524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:58.865037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.67:38771 (local address 127.19.236.66:32837)
0811 15:03:58.865171 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:58.865174 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:58.865398 (+ 224us) server_negotiation.cc:407] Connection header received
0811 15:03:58.865633 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:58.865635 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:58.865679 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:58.865744 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 15:03:58.866017 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:58.866511 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:58.867745 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:58.867956 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:58.868027 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:58.868378 (+ 351us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 15:03:58.868443 (+ 65us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 15:03:58.868498 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:58.868676 (+ 178us) server_negotiation.cc:299] Negotiation successful
0811 15:03:58.868724 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 15:03:58.868898 29625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:58.864930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.66:32837 (local address 127.19.236.67:38771)
0811 15:03:58.865306 (+ 376us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:58.865322 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:58.865519 (+ 197us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:58.865789 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:58.865792 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:58.865802 (+ 10us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 15:03:58.865904 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:58.865910 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:58.866629 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:58.866633 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:58.867614 (+ 981us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:58.867627 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:58.868076 (+ 449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:58.868080 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:58.868173 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:58.868230 (+ 57us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 15:03:58.868545 (+ 315us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 15:03:58.868572 (+ 27us) client_negotiation.cc:769] Sending connection context
0811 15:03:58.868654 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 15:03:58.868742 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":278,"thread_start_us":110,"threads_started":1}
I20260811 15:03:58.875980 29141 raft_consensus.cc:1261] T d7d971eb59474f618d98aa30ef999bd3 P c55114e7834d47eb830087dff4cf5242 [term 1 FOLLOWER]: Refusing update from remote peer a3f975537fe340ce88bf33d4bdcb8884: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:03:58.875977 29299 raft_consensus.cc:1261] T d7d971eb59474f618d98aa30ef999bd3 P 7986206b93f24bd09dc510b1f308ed19 [term 1 FOLLOWER]: Refusing update from remote peer a3f975537fe340ce88bf33d4bdcb8884: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:03:58.876456 29618 consensus_queue.cc:1035] T d7d971eb59474f618d98aa30ef999bd3 P a3f975537fe340ce88bf33d4bdcb8884 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c55114e7834d47eb830087dff4cf5242" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 39839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:03:58.876718 29541 consensus_queue.cc:1035] T d7d971eb59474f618d98aa30ef999bd3 P a3f975537fe340ce88bf33d4bdcb8884 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7986206b93f24bd09dc510b1f308ed19" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 32837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:03:58.893407 29583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:58.889526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.67:45119 (local address 127.19.236.66:43557)
0811 15:03:58.889658 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:58.889673 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 15:03:58.889784 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:03:58.890109 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:03:58.890112 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:03:58.890120 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 15:03:58.890224 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:58.890230 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:58.891283 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:58.891286 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:58.892104 (+ 818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:03:58.892122 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:03:58.892704 (+ 582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:03:58.892707 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:03:58.892791 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:58.892827 (+ 36us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 15:03:58.893121 (+ 294us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 15:03:58.893130 (+ 9us) client_negotiation.cc:769] Sending connection context
0811 15:03:58.893195 (+ 65us) client_negotiation.cc:240] Negotiation successful
0811 15:03:58.893282 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260811 15:03:58.893396 29527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:58.889578 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.66:43557 (local address 127.19.236.67:45119)
0811 15:03:58.889703 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0811 15:03:58.889710 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 15:03:58.889728 (+ 18us) server_negotiation.cc:407] Connection header received
0811 15:03:58.889939 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:03:58.889942 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:03:58.889998 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:03:58.890080 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 15:03:58.890357 (+ 277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:58.891148 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:58.892244 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:03:58.892602 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:03:58.892703 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:03:58.892950 (+ 247us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 15:03:58.893031 (+ 81us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 15:03:58.893113 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 15:03:58.893205 (+ 92us) server_negotiation.cc:299] Negotiation successful
0811 15:03:58.893256 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 15:03:58.917333 28964 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56362:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 15:03:58.917515 28964 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56362:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 15:03:58.919525 28964 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 310341f977fe4f90ad0e21aa6f2495d7: Sending DeleteTablet for 3 replicas of tablet d7d971eb59474f618d98aa30ef999bd3
I20260811 15:03:58.920094 29117 tablet_service.cc:1514] Processing DeleteTablet for tablet d7d971eb59474f618d98aa30ef999bd3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:03:58 UTC) from {username='oryx', principal='oryx/127.19.236.126@KRBTEST.COM'} at 127.0.0.1:34464
I20260811 15:03:58.920131 29428 tablet_service.cc:1514] Processing DeleteTablet for tablet d7d971eb59474f618d98aa30ef999bd3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:03:58 UTC) from {username='oryx', principal='oryx/127.19.236.126@KRBTEST.COM'} at 127.0.0.1:47390
I20260811 15:03:58.920159 29275 tablet_service.cc:1514] Processing DeleteTablet for tablet d7d971eb59474f618d98aa30ef999bd3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:03:58 UTC) from {username='oryx', principal='oryx/127.19.236.126@KRBTEST.COM'} at 127.0.0.1:49290
I20260811 15:03:58.920281 29553 tablet_replica.cc:330] T d7d971eb59474f618d98aa30ef999bd3 P c55114e7834d47eb830087dff4cf5242: stopping tablet replica
I20260811 15:03:58.920280 29555 tablet_replica.cc:330] T d7d971eb59474f618d98aa30ef999bd3 P a3f975537fe340ce88bf33d4bdcb8884: stopping tablet replica
I20260811 15:03:58.920334 29554 tablet_replica.cc:330] T d7d971eb59474f618d98aa30ef999bd3 P 7986206b93f24bd09dc510b1f308ed19: stopping tablet replica
I20260811 15:03:58.920382 29553 raft_consensus.cc:2229] T d7d971eb59474f618d98aa30ef999bd3 P c55114e7834d47eb830087dff4cf5242 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 15:03:58.920388 29555 raft_consensus.cc:2229] T d7d971eb59474f618d98aa30ef999bd3 P a3f975537fe340ce88bf33d4bdcb8884 [term 1 LEADER]: Raft consensus shutting down.
I20260811 15:03:58.920446 29554 raft_consensus.cc:2229] T d7d971eb59474f618d98aa30ef999bd3 P 7986206b93f24bd09dc510b1f308ed19 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 15:03:58.920496 29553 raft_consensus.cc:2258] T d7d971eb59474f618d98aa30ef999bd3 P c55114e7834d47eb830087dff4cf5242 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:03:58.920571 29554 raft_consensus.cc:2258] T d7d971eb59474f618d98aa30ef999bd3 P 7986206b93f24bd09dc510b1f308ed19 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:03:58.920621 29555 raft_consensus.cc:2258] T d7d971eb59474f618d98aa30ef999bd3 P a3f975537fe340ce88bf33d4bdcb8884 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:03:58.920890 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 29047
I20260811 15:03:58.921329 29555 ts_tablet_manager.cc:1905] T d7d971eb59474f618d98aa30ef999bd3 P a3f975537fe340ce88bf33d4bdcb8884: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 15:03:58.924388 29555 ts_tablet_manager.cc:1918] T d7d971eb59474f618d98aa30ef999bd3 P a3f975537fe340ce88bf33d4bdcb8884: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 15:03:58.924492 29555 log.cc:1196] T d7d971eb59474f618d98aa30ef999bd3 P a3f975537fe340ce88bf33d4bdcb8884: Deleting WAL directory at /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/minicluster-data/ts-2/wal/wals/d7d971eb59474f618d98aa30ef999bd3
I20260811 15:03:58.924764 29555 ts_tablet_manager.cc:1939] T d7d971eb59474f618d98aa30ef999bd3 P a3f975537fe340ce88bf33d4bdcb8884: Deleting consensus metadata
I20260811 15:03:58.925459 28950 catalog_manager.cc:4841] TS a3f975537fe340ce88bf33d4bdcb8884 (127.19.236.67:45119): tablet d7d971eb59474f618d98aa30ef999bd3 (table test-table [id=f5f45caf365e4713a67e2d1e49a68c33]) successfully deleted
I20260811 15:03:58.929373 29554 ts_tablet_manager.cc:1905] T d7d971eb59474f618d98aa30ef999bd3 P 7986206b93f24bd09dc510b1f308ed19: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 15:03:58.932873 29554 ts_tablet_manager.cc:1918] T d7d971eb59474f618d98aa30ef999bd3 P 7986206b93f24bd09dc510b1f308ed19: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 15:03:58.932978 29554 log.cc:1196] T d7d971eb59474f618d98aa30ef999bd3 P 7986206b93f24bd09dc510b1f308ed19: Deleting WAL directory at /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786460596631409-20401-0/minicluster-data/ts-1/wal/wals/d7d971eb59474f618d98aa30ef999bd3
I20260811 15:03:58.933275 29554 ts_tablet_manager.cc:1939] T d7d971eb59474f618d98aa30ef999bd3 P 7986206b93f24bd09dc510b1f308ed19: Deleting consensus metadata
W20260811 15:03:58.933440 28950 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.19.236.65:39839 (error 108)
I20260811 15:03:58.933825 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 29199
I20260811 15:03:58.936896 29632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:58.936248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.65:39839 (local address 127.0.0.1:34478)
0811 15:03:58.936669 (+ 421us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:58.936757 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.65:39839: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":315,"thread_start_us":61,"threads_started":1}
W20260811 15:03:58.937076 28950 catalog_manager.cc:4584] TS c55114e7834d47eb830087dff4cf5242 (127.19.236.65:39839): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d7d971eb59474f618d98aa30ef999bd3: Network error: Client connection negotiation failed: client connection to 127.19.236.65:39839: connect: Connection refused (error 111)
I20260811 15:03:58.944658 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 29359
I20260811 15:03:58.946345 29632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:03:58.944755 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.66:32837 (local address 127.0.0.1:49302)
0811 15:03:58.946162 (+ 1407us) negotiation.cc:107] Waiting for socket to connect
0811 15:03:58.946232 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.66:32837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1288}
I20260811 15:03:58.954448 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 28928
2026-08-11T15:03:58Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (3217 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786460596631409-20401-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 15:03:59 dist-test-slave-8n49 krb5kdc[29635](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 15:03:59 dist-test-slave-8n49 krb5kdc[29635](info): set up 2 sockets
Aug 11 15:03:59 dist-test-slave-8n49 krb5kdc[29635](info): commencing operation
krb5kdc: starting...
W20260811 15:04:00.072780 20401 mini_kdc.cc:121] Time spent starting KDC: real 1.092s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786460596631409-20401-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786460596631409-20401-0/krb5kdc/test-user.keytab.
Aug 11 15:04:00 dist-test-slave-8n49 krb5kdc[29635](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460640, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T15:04:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T15:04:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.236.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.236.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.236.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab.
Entry for principal kudu/127.19.236.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab.
I20260811 15:04:00.204209 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786460596631409-20401-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786460596631409-20401-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786460596631409-20401-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:37177
--webserver_interface=127.19.236.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab
--principal=kudu/127.19.236.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:41713
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.236.126:37177
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:04:00.318608 29648 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:04:00.318897 29648 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:04:00.318939 29648 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:04:00.323081 29648 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:04:00.323143 29648 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:04:00.323163 29648 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:04:00.323179 29648 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:04:00.323194 29648 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:04:00.328521 29648 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:41713
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786460596631409-20401-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786460596631409-20401-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.236.126:37177
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:37177
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.236.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29648
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786460596631409-20401-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:04:00.329707 29648 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:04:00.330778 29648 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:04:00.339810 29654 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:04:00.339819 29655 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:04:00.339888 29648 server_base.cc:1034] running on GCE node
W20260811 15:04:00.339898 29657 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:04:00.340817 29648 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:04:00.341940 29648 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:04:00.343132 29648 hybrid_clock.cc:648] HybridClock initialized: now 1786460640343091 us; error 56 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-11T15:04:00Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1393 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 15:04:00 dist-test-slave-8n49 krb5kdc[29663](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 15:04:00 dist-test-slave-8n49 krb5kdc[29663](info): set up 2 sockets
Aug 11 15:04:00 dist-test-slave-8n49 krb5kdc[29663](info): commencing operation
krb5kdc: starting...
W20260811 15:04:01.472966 20401 mini_kdc.cc:121] Time spent starting KDC: real 1.098s user 0.007s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/krb5kdc/test-user.keytab.
Aug 11 15:04:01 dist-test-slave-8n49 krb5kdc[29663](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460641, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T15:04:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T15:04:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.236.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.236.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.236.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab.
Entry for principal kudu/127.19.236.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab.
I20260811 15:04:01.608265 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:42757
--webserver_interface=127.19.236.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab
--principal=kudu/127.19.236.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:38003
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.236.126:42757
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:04:01.723443 29677 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:04:01.723796 29677 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:04:01.723881 29677 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:04:01.728053 29677 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:04:01.728148 29677 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:04:01.728188 29677 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:04:01.728247 29677 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:04:01.728287 29677 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:04:01.734282 29677 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:38003
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.236.126:42757
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab
--principal=kudu/127.19.236.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:42757
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.236.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29677
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:04:01.735417 29677 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:04:01.736500 29677 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:04:01.745060 29682 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:04:01.745064 29683 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:04:01.745215 29677 server_base.cc:1034] running on GCE node
W20260811 15:04:01.745404 29685 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:04:01.746014 29677 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:04:01.747128 29677 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:04:01.748296 29677 hybrid_clock.cc:648] HybridClock initialized: now 1786460641748278 us; error 31 us; skew 500 ppm
Aug 11 15:04:01 dist-test-slave-8n49 krb5kdc[29663](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460641, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:04:01.759055 29677 init.cc:377] Logged in from keytab as kudu/127.19.236.126@KRBTEST.COM (short username kudu)
I20260811 15:04:01.760013 29677 webserver.cc:460] Webserver started at http://127.19.236.126:44359/ using document root <none> and password file <none>
I20260811 15:04:01.760612 29677 fs_manager.cc:359] Metadata directory not provided
I20260811 15:04:01.760690 29677 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:04:01.760871 29677 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:04:01.763010 29677 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/master-0/data/instance:
uuid: "7f503da8fa34465c9872f43776b9d25d"
format_stamp: "Formatted at 2026-08-11 15:04:01 on dist-test-slave-8n49"
server_key: "a846c3e7d18d2b006bc9a265b03fb62e"
server_key_iv: "c703ef5d5283c8755c7df3e01e6669af"
server_key_version: "encryptionkey@0"
I20260811 15:04:01.763545 29677 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/master-0/wal/instance:
uuid: "7f503da8fa34465c9872f43776b9d25d"
format_stamp: "Formatted at 2026-08-11 15:04:01 on dist-test-slave-8n49"
server_key: "a846c3e7d18d2b006bc9a265b03fb62e"
server_key_iv: "c703ef5d5283c8755c7df3e01e6669af"
server_key_version: "encryptionkey@0"
I20260811 15:04:01.767388 29677 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260811 15:04:01.769855 29692 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:04:01.771137 29677 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 15:04:01.771292 29677 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/master-0/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/master-0/wal
uuid: "7f503da8fa34465c9872f43776b9d25d"
format_stamp: "Formatted at 2026-08-11 15:04:01 on dist-test-slave-8n49"
server_key: "a846c3e7d18d2b006bc9a265b03fb62e"
server_key_iv: "c703ef5d5283c8755c7df3e01e6669af"
server_key_version: "encryptionkey@0"
I20260811 15:04:01.771414 29677 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:04:01.789775 29677 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:04:01.793222 29677 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:04:01.793437 29677 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:04:01.800985 29677 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.126:42757
I20260811 15:04:01.801044 29749 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.126:42757 every 8 connection(s)
I20260811 15:04:01.801993 29677 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
I20260811 15:04:01.804874 29750 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:04:01.806125 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 29677
I20260811 15:04:01.806288 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/master-0/wal/instance
I20260811 15:04:01.806602 20401 external_mini_cluster.cc:1428] Setting key 826ce9cdfba7012a41e3884f9a159c04
I20260811 15:04:01.811715 29750 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f503da8fa34465c9872f43776b9d25d: Bootstrap starting.
I20260811 15:04:01.814466 29750 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7f503da8fa34465c9872f43776b9d25d: Neither blocks nor log segments found. Creating new log.
I20260811 15:04:01.815231 29750 log.cc:824] T 00000000000000000000000000000000 P 7f503da8fa34465c9872f43776b9d25d: Log is configured to *not* fsync() on all Append() calls
Aug 11 15:04:01 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460641, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
I20260811 15:04:01.817580 29750 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f503da8fa34465c9872f43776b9d25d: No bootstrap required, opened a new log
I20260811 15:04:01.821771 29753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:01.808078 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50146 (local address 127.19.236.126:42757)
0811 15:04:01.808526 (+ 448us) server_negotiation.cc:206] Beginning negotiation
0811 15:04:01.808567 (+ 41us) server_negotiation.cc:399] Waiting for connection header
0811 15:04:01.808612 (+ 45us) server_negotiation.cc:407] Connection header received
0811 15:04:01.809452 (+ 840us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:04:01.809479 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:04:01.809888 (+ 409us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:04:01.810253 (+ 365us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:04:01.810939 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:01.812361 (+ 1422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:01.813282 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:01.813965 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:01.814124 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:01.816632 (+ 2508us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:04:01.816638 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:04:01.816655 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:04:01.816691 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:04:01.818574 (+ 1883us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:04:01.819012 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:04:01.819020 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:04:01.819028 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:04:01.819163 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:04:01.819422 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:04:01.819427 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:04:01.819430 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:04:01.819981 (+ 551us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:04:01.820213 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0811 15:04:01.820444 (+ 231us) server_negotiation.cc:299] Negotiation successful
0811 15:04:01.820779 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":297,"thread_start_us":115,"threads_started":1}
I20260811 15:04:01.822269 29750 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7f503da8fa34465c9872f43776b9d25d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f503da8fa34465c9872f43776b9d25d" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 42757 } }
I20260811 15:04:01.822521 29750 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7f503da8fa34465c9872f43776b9d25d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:04:01.822582 29750 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7f503da8fa34465c9872f43776b9d25d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f503da8fa34465c9872f43776b9d25d, State: Initialized, Role: FOLLOWER
I20260811 15:04:01.822983 29750 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7f503da8fa34465c9872f43776b9d25d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f503da8fa34465c9872f43776b9d25d" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 42757 } }
I20260811 15:04:01.823146 29750 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7f503da8fa34465c9872f43776b9d25d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 15:04:01.823217 29750 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7f503da8fa34465c9872f43776b9d25d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 15:04:01.823346 29750 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7f503da8fa34465c9872f43776b9d25d [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:04:01.824258 29750 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7f503da8fa34465c9872f43776b9d25d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f503da8fa34465c9872f43776b9d25d" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 42757 } }
I20260811 15:04:01.824659 29750 leader_election.cc:302] T 00000000000000000000000000000000 P 7f503da8fa34465c9872f43776b9d25d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7f503da8fa34465c9872f43776b9d25d; no voters:
I20260811 15:04:01.824987 29750 leader_election.cc:288] T 00000000000000000000000000000000 P 7f503da8fa34465c9872f43776b9d25d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 15:04:01.825244 29755 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7f503da8fa34465c9872f43776b9d25d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:04:01.825469 29755 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7f503da8fa34465c9872f43776b9d25d [term 1 LEADER]: Becoming Leader. State: Replica: 7f503da8fa34465c9872f43776b9d25d, State: Running, Role: LEADER
I20260811 15:04:01.825769 29755 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7f503da8fa34465c9872f43776b9d25d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f503da8fa34465c9872f43776b9d25d" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 42757 } }
I20260811 15:04:01.826274 29750 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7f503da8fa34465c9872f43776b9d25d [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:04:01.827396 29756 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f503da8fa34465c9872f43776b9d25d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7f503da8fa34465c9872f43776b9d25d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f503da8fa34465c9872f43776b9d25d" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 42757 } } }
I20260811 15:04:01.827525 29756 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f503da8fa34465c9872f43776b9d25d [sys.catalog]: This master's current role is: LEADER
I20260811 15:04:01.827812 29757 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f503da8fa34465c9872f43776b9d25d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7f503da8fa34465c9872f43776b9d25d. Latest consensus state: current_term: 1 leader_uuid: "7f503da8fa34465c9872f43776b9d25d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f503da8fa34465c9872f43776b9d25d" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 42757 } } }
I20260811 15:04:01.827895 29757 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f503da8fa34465c9872f43776b9d25d [sys.catalog]: This master's current role is: LEADER
I20260811 15:04:01.827935 29764 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:04:01.831036 29764 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:04:01.836654 29764 catalog_manager.cc:1347] Generated new cluster ID: 84f133e141db4bc48fd6896df07a7cca
I20260811 15:04:01.836722 29764 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:04:01.852177 29764 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 15:04:01.853510 29764 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:04:01.860306 29764 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7f503da8fa34465c9872f43776b9d25d: Generated new TSK 0
I20260811 15:04:01.861109 29764 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.236.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.236.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.236.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.65.keytab.
Entry for principal kudu/127.19.236.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.65.keytab.
I20260811 15:04:01.893839 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.65:0
--local_ip_for_outbound_sockets=127.19.236.65
--webserver_interface=127.19.236.65
--webserver_port=0
--tserver_master_addrs=127.19.236.126:42757
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.65.keytab
--principal=kudu/127.19.236.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:38003
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:04:02.010826 29778 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:04:02.011085 29778 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:04:02.011130 29778 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:04:02.015264 29778 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:04:02.015326 29778 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:04:02.015420 29778 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.65
I20260811 15:04:02.020794 29778 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:38003
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.65.keytab
--principal=kudu/127.19.236.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.236.65
--webserver_port=0
--tserver_master_addrs=127.19.236.126:42757
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29778
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.65
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:04:02.021878 29778 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:04:02.022929 29778 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:04:02.032657 29786 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:04:02.032650 29784 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:04:02.032650 29783 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:04:02.032716 29778 server_base.cc:1034] running on GCE node
I20260811 15:04:02.033327 29778 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:04:02.033934 29778 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:04:02.035100 29778 hybrid_clock.cc:648] HybridClock initialized: now 1786460642035089 us; error 38 us; skew 500 ppm
Aug 11 15:04:02 dist-test-slave-8n49 krb5kdc[29663](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460642, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:04:02.037918 29778 init.cc:377] Logged in from keytab as kudu/127.19.236.65@KRBTEST.COM (short username kudu)
I20260811 15:04:02.038812 29778 webserver.cc:460] Webserver started at http://127.19.236.65:39943/ using document root <none> and password file <none>
I20260811 15:04:02.039340 29778 fs_manager.cc:359] Metadata directory not provided
I20260811 15:04:02.039398 29778 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:04:02.039577 29778 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:04:02.041692 29778 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-0/data/instance:
uuid: "cf6c0f51ac4d48b7ac79e1c1c5cc6f25"
format_stamp: "Formatted at 2026-08-11 15:04:02 on dist-test-slave-8n49"
server_key: "e84a333232b7547ed5d7628ae362c199"
server_key_iv: "a60925bdcfff1ec3a3e33e35dbd0980b"
server_key_version: "encryptionkey@0"
I20260811 15:04:02.042243 29778 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-0/wal/instance:
uuid: "cf6c0f51ac4d48b7ac79e1c1c5cc6f25"
format_stamp: "Formatted at 2026-08-11 15:04:02 on dist-test-slave-8n49"
server_key: "e84a333232b7547ed5d7628ae362c199"
server_key_iv: "a60925bdcfff1ec3a3e33e35dbd0980b"
server_key_version: "encryptionkey@0"
I20260811 15:04:02.046154 29778 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 15:04:02.048733 29793 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:04:02.049983 29778 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 15:04:02.050083 29778 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-0/wal
uuid: "cf6c0f51ac4d48b7ac79e1c1c5cc6f25"
format_stamp: "Formatted at 2026-08-11 15:04:02 on dist-test-slave-8n49"
server_key: "e84a333232b7547ed5d7628ae362c199"
server_key_iv: "a60925bdcfff1ec3a3e33e35dbd0980b"
server_key_version: "encryptionkey@0"
I20260811 15:04:02.050176 29778 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:04:02.075532 29778 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:04:02.079237 29778 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:04:02.079455 29778 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:04:02.080102 29778 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:04:02.081009 29778 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:04:02.081065 29778 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:04:02.081151 29778 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:04:02.081182 29778 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:04:02.090353 29778 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.65:40917
I20260811 15:04:02.090378 29915 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.65:40917 every 8 connection(s)
I20260811 15:04:02.091280 29778 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
Aug 11 15:04:02 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460642, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.65@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
I20260811 15:04:02.101256 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 29778
I20260811 15:04:02.101384 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-0/wal/instance
I20260811 15:04:02.101770 20401 external_mini_cluster.cc:1428] Setting key c2601918189d7e54fffd48a0c948ebb3
I20260811 15:04:02.106201 29753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:02.093311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.65:56759 (local address 127.19.236.126:42757)
0811 15:04:02.093460 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0811 15:04:02.093464 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:04:02.094274 (+ 810us) server_negotiation.cc:407] Connection header received
0811 15:04:02.095605 (+ 1331us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:04:02.095609 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:04:02.095672 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:04:02.095747 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:04:02.096931 (+ 1184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:02.097500 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:02.098671 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:02.098917 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:02.099055 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:02.101900 (+ 2845us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:04:02.101903 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:04:02.101906 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:04:02.101932 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:04:02.103648 (+ 1716us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:04:02.104309 (+ 661us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:04:02.104312 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:04:02.104313 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:04:02.104400 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:04:02.104827 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:04:02.104830 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:04:02.104831 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:04:02.105012 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:04:02.105088 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 15:04:02.105801 (+ 713us) server_negotiation.cc:299] Negotiation successful
0811 15:04:02.105951 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 15:04:02.106915 29919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:02.093684 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42757 (local address 127.19.236.65:56759)
0811 15:04:02.094127 (+ 443us) negotiation.cc:107] Waiting for socket to connect
0811 15:04:02.094169 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 15:04:02.095367 (+ 1198us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:04:02.095918 (+ 551us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:04:02.095925 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:04:02.096273 (+ 348us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:04:02.096770 (+ 497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:02.096784 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:02.097639 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:02.097644 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:02.098534 (+ 890us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:02.098543 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:02.099100 (+ 557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:02.099105 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:02.099284 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:02.099934 (+ 650us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:04:02.099950 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:04:02.101655 (+ 1705us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:04:02.103778 (+ 2123us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:04:02.103785 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:04:02.103802 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:04:02.104199 (+ 397us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:04:02.104504 (+ 305us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:04:02.104511 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:04:02.104515 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:04:02.104732 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:04:02.105119 (+ 387us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:04:02.105129 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:04:02.105479 (+ 350us) client_negotiation.cc:769] Sending connection context
0811 15:04:02.105697 (+ 218us) client_negotiation.cc:240] Negotiation successful
0811 15:04:02.105969 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":108,"threads_started":1}
I20260811 15:04:02.108170 29917 heartbeater.cc:347] Connected to a master server at 127.19.236.126:42757
I20260811 15:04:02.108412 29917 heartbeater.cc:464] Registering TS with master...
I20260811 15:04:02.108978 29917 heartbeater.cc:511] Master 127.19.236.126:42757 requested a full tablet report, sending...
I20260811 15:04:02.110533 29711 ts_manager.cc:194] Registered new tserver with Master: cf6c0f51ac4d48b7ac79e1c1c5cc6f25 (127.19.236.65:40917)
I20260811 15:04:02.111696 29711 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.236.65@KRBTEST.COM'} at 127.19.236.65:56759
WARNING: no policy specified for kudu/127.19.236.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.236.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.236.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.66.keytab.
Entry for principal kudu/127.19.236.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.66.keytab.
I20260811 15:04:02.131796 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.66:0
--local_ip_for_outbound_sockets=127.19.236.66
--webserver_interface=127.19.236.66
--webserver_port=0
--tserver_master_addrs=127.19.236.126:42757
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.66.keytab
--principal=kudu/127.19.236.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:38003
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:04:02.245054 29923 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:04:02.245349 29923 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:04:02.245425 29923 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:04:02.249349 29923 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:04:02.249431 29923 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:04:02.249531 29923 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.66
I20260811 15:04:02.254923 29923 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:38003
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.66.keytab
--principal=kudu/127.19.236.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.236.66
--webserver_port=0
--tserver_master_addrs=127.19.236.126:42757
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29923
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.66
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:04:02.255947 29923 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:04:02.256992 29923 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:04:02.266500 29929 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:04:02.266510 29928 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:04:02.266543 29931 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:04:02.266904 29923 server_base.cc:1034] running on GCE node
I20260811 15:04:02.267261 29923 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:04:02.267880 29923 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:04:02.269057 29923 hybrid_clock.cc:648] HybridClock initialized: now 1786460642269039 us; error 26 us; skew 500 ppm
Aug 11 15:04:02 dist-test-slave-8n49 krb5kdc[29663](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460642, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:04:02.271745 29923 init.cc:377] Logged in from keytab as kudu/127.19.236.66@KRBTEST.COM (short username kudu)
I20260811 15:04:02.272665 29923 webserver.cc:460] Webserver started at http://127.19.236.66:45859/ using document root <none> and password file <none>
I20260811 15:04:02.273195 29923 fs_manager.cc:359] Metadata directory not provided
I20260811 15:04:02.273252 29923 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:04:02.273415 29923 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:04:02.275529 29923 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-1/data/instance:
uuid: "8f349d9966ee4f168878bc9a2a0beb01"
format_stamp: "Formatted at 2026-08-11 15:04:02 on dist-test-slave-8n49"
server_key: "9580d114bab7dbf40e58357eded72f83"
server_key_iv: "9abe99e82507bb76b3212b3d9832502c"
server_key_version: "encryptionkey@0"
I20260811 15:04:02.276052 29923 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-1/wal/instance:
uuid: "8f349d9966ee4f168878bc9a2a0beb01"
format_stamp: "Formatted at 2026-08-11 15:04:02 on dist-test-slave-8n49"
server_key: "9580d114bab7dbf40e58357eded72f83"
server_key_iv: "9abe99e82507bb76b3212b3d9832502c"
server_key_version: "encryptionkey@0"
I20260811 15:04:02.279917 29923 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260811 15:04:02.282289 29938 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:04:02.283459 29923 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20260811 15:04:02.283588 29923 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-1/wal
uuid: "8f349d9966ee4f168878bc9a2a0beb01"
format_stamp: "Formatted at 2026-08-11 15:04:02 on dist-test-slave-8n49"
server_key: "9580d114bab7dbf40e58357eded72f83"
server_key_iv: "9abe99e82507bb76b3212b3d9832502c"
server_key_version: "encryptionkey@0"
I20260811 15:04:02.283690 29923 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:04:02.303577 29923 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:04:02.306844 29923 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:04:02.307065 29923 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:04:02.307715 29923 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:04:02.308624 29923 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:04:02.308672 29923 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:04:02.308744 29923 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:04:02.308784 29923 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:04:02.318110 29923 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.66:37673
I20260811 15:04:02.318130 30062 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.66:37673 every 8 connection(s)
I20260811 15:04:02.319051 29923 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
I20260811 15:04:02.328943 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 29923
I20260811 15:04:02.329087 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-1/wal/instance
Aug 11 15:04:02 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460642, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.66@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
I20260811 15:04:02.329412 20401 external_mini_cluster.cc:1428] Setting key bfaafb3e909df1de24721f54f4fd05a9
I20260811 15:04:02.333935 29753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:02.320977 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.66:57899 (local address 127.19.236.126:42757)
0811 15:04:02.321163 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0811 15:04:02.321170 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 15:04:02.321970 (+ 800us) server_negotiation.cc:407] Connection header received
0811 15:04:02.323339 (+ 1369us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:04:02.323343 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:04:02.323405 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:04:02.323488 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:04:02.324723 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:02.325300 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:02.326705 (+ 1405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:02.326977 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:02.327095 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:02.330068 (+ 2973us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:04:02.330072 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:04:02.330075 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:04:02.330105 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:04:02.331718 (+ 1613us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:04:02.332260 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:04:02.332264 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:04:02.332266 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:04:02.332351 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:04:02.332782 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:04:02.332786 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:04:02.332788 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:04:02.332981 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:04:02.333094 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0811 15:04:02.333629 (+ 535us) server_negotiation.cc:299] Negotiation successful
0811 15:04:02.333761 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 15:04:02.334753 30066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:02.321357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42757 (local address 127.19.236.66:57899)
0811 15:04:02.321815 (+ 458us) negotiation.cc:107] Waiting for socket to connect
0811 15:04:02.321857 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 15:04:02.323110 (+ 1253us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:04:02.323676 (+ 566us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:04:02.323683 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:04:02.324040 (+ 357us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:04:02.324524 (+ 484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:02.324538 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:02.325434 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:02.325452 (+ 18us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:02.326568 (+ 1116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:02.326579 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:02.327154 (+ 575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:02.327158 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:02.327362 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:02.328062 (+ 700us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:04:02.328080 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:04:02.329860 (+ 1780us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:04:02.331853 (+ 1993us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:04:02.331860 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:04:02.331876 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:04:02.332146 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:04:02.332463 (+ 317us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:04:02.332466 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:04:02.332468 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:04:02.332682 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:04:02.333094 (+ 412us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:04:02.333108 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:04:02.333376 (+ 268us) client_negotiation.cc:769] Sending connection context
0811 15:04:02.333566 (+ 190us) client_negotiation.cc:240] Negotiation successful
0811 15:04:02.333901 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":276,"thread_start_us":123,"threads_started":1}
I20260811 15:04:02.335994 30063 heartbeater.cc:347] Connected to a master server at 127.19.236.126:42757
I20260811 15:04:02.336289 30063 heartbeater.cc:464] Registering TS with master...
I20260811 15:04:02.336961 30063 heartbeater.cc:511] Master 127.19.236.126:42757 requested a full tablet report, sending...
I20260811 15:04:02.338191 29711 ts_manager.cc:194] Registered new tserver with Master: 8f349d9966ee4f168878bc9a2a0beb01 (127.19.236.66:37673)
I20260811 15:04:02.338794 29711 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.236.66@KRBTEST.COM'} at 127.19.236.66:57899
WARNING: no policy specified for kudu/127.19.236.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.236.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.236.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.67.keytab.
Entry for principal kudu/127.19.236.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.67.keytab.
I20260811 15:04:02.359938 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.67:0
--local_ip_for_outbound_sockets=127.19.236.67
--webserver_interface=127.19.236.67
--webserver_port=0
--tserver_master_addrs=127.19.236.126:42757
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.67.keytab
--principal=kudu/127.19.236.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:38003
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:04:02.475909 30070 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:04:02.476203 30070 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:04:02.476293 30070 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:04:02.480741 30070 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:04:02.480809 30070 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:04:02.480870 30070 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.67
I20260811 15:04:02.486261 30070 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:38003
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.67.keytab
--principal=kudu/127.19.236.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.236.67
--webserver_port=0
--tserver_master_addrs=127.19.236.126:42757
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30070
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.67
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:04:02.487428 30070 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:04:02.488533 30070 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:04:02.499295 30077 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:04:02.499285 30080 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:04:02.499285 30078 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:04:02.499329 30070 server_base.cc:1034] running on GCE node
I20260811 15:04:02.499995 30070 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:04:02.500777 30070 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:04:02.501994 30070 hybrid_clock.cc:648] HybridClock initialized: now 1786460642501972 us; error 31 us; skew 500 ppm
Aug 11 15:04:02 dist-test-slave-8n49 krb5kdc[29663](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460642, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:04:02.504964 30070 init.cc:377] Logged in from keytab as kudu/127.19.236.67@KRBTEST.COM (short username kudu)
I20260811 15:04:02.505864 30070 webserver.cc:460] Webserver started at http://127.19.236.67:40461/ using document root <none> and password file <none>
I20260811 15:04:02.506462 30070 fs_manager.cc:359] Metadata directory not provided
I20260811 15:04:02.506558 30070 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:04:02.506811 30070 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:04:02.508972 30070 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-2/data/instance:
uuid: "9394067ba44d478fa6310c765c49d2be"
format_stamp: "Formatted at 2026-08-11 15:04:02 on dist-test-slave-8n49"
server_key: "fc9410a2dfd2ff477a17358897136a52"
server_key_iv: "003634edf475401081bc907083ef4989"
server_key_version: "encryptionkey@0"
I20260811 15:04:02.509547 30070 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-2/wal/instance:
uuid: "9394067ba44d478fa6310c765c49d2be"
format_stamp: "Formatted at 2026-08-11 15:04:02 on dist-test-slave-8n49"
server_key: "fc9410a2dfd2ff477a17358897136a52"
server_key_iv: "003634edf475401081bc907083ef4989"
server_key_version: "encryptionkey@0"
I20260811 15:04:02.513347 30070 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260811 15:04:02.515789 30087 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:04:02.517068 30070 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 15:04:02.517204 30070 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-2/wal
uuid: "9394067ba44d478fa6310c765c49d2be"
format_stamp: "Formatted at 2026-08-11 15:04:02 on dist-test-slave-8n49"
server_key: "fc9410a2dfd2ff477a17358897136a52"
server_key_iv: "003634edf475401081bc907083ef4989"
server_key_version: "encryptionkey@0"
I20260811 15:04:02.517323 30070 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:04:02.543318 30070 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:04:02.546536 30070 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:04:02.546747 30070 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:04:02.547369 30070 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:04:02.548337 30070 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:04:02.548410 30070 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:04:02.548482 30070 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:04:02.548532 30070 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:04:02.557687 30070 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.67:36765
I20260811 15:04:02.557710 30217 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.67:36765 every 8 connection(s)
I20260811 15:04:02.558642 30070 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
I20260811 15:04:02.567564 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 30070
I20260811 15:04:02.567752 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-2/wal/instance
I20260811 15:04:02.568073 20401 external_mini_cluster.cc:1428] Setting key d6be3a88f5f8d56d503d1fa2bd394078
Aug 11 15:04:02 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460642, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.67@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
I20260811 15:04:02.572862 29753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:02.560627 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.67:47935 (local address 127.19.236.126:42757)
0811 15:04:02.560790 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0811 15:04:02.560796 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 15:04:02.561676 (+ 880us) server_negotiation.cc:407] Connection header received
0811 15:04:02.562964 (+ 1288us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:04:02.562967 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:04:02.563018 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:04:02.563091 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:04:02.564274 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:02.564891 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:02.566003 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:02.566227 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:02.566321 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:02.568961 (+ 2640us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:04:02.568966 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:04:02.568969 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:04:02.569005 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:04:02.570722 (+ 1717us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:04:02.571257 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:04:02.571261 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:04:02.571262 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:04:02.571349 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:04:02.571708 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:04:02.571711 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:04:02.571713 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:04:02.571932 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:04:02.572023 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 15:04:02.572537 (+ 514us) server_negotiation.cc:299] Negotiation successful
0811 15:04:02.572725 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 15:04:02.573706 30220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:02.561039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42757 (local address 127.19.236.67:47935)
0811 15:04:02.561518 (+ 479us) negotiation.cc:107] Waiting for socket to connect
0811 15:04:02.561563 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 15:04:02.562738 (+ 1175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:04:02.563266 (+ 528us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:04:02.563272 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:04:02.563638 (+ 366us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:04:02.564125 (+ 487us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:02.564139 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:02.565009 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:02.565012 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:02.565869 (+ 857us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:02.565878 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:02.566373 (+ 495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:02.566375 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:02.566517 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:02.567078 (+ 561us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:04:02.567094 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:04:02.568816 (+ 1722us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:04:02.570845 (+ 2029us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:04:02.570850 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:04:02.570863 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:04:02.571141 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:04:02.571449 (+ 308us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:04:02.571451 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:04:02.571452 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:04:02.571587 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:04:02.572042 (+ 455us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:04:02.572048 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:04:02.572292 (+ 244us) client_negotiation.cc:769] Sending connection context
0811 15:04:02.572464 (+ 172us) client_negotiation.cc:240] Negotiation successful
0811 15:04:02.572814 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":281,"thread_start_us":119,"threads_started":1}
I20260811 15:04:02.574924 30218 heartbeater.cc:347] Connected to a master server at 127.19.236.126:42757
I20260811 15:04:02.575186 30218 heartbeater.cc:464] Registering TS with master...
I20260811 15:04:02.575719 30218 heartbeater.cc:511] Master 127.19.236.126:42757 requested a full tablet report, sending...
I20260811 15:04:02.576805 29711 ts_manager.cc:194] Registered new tserver with Master: 9394067ba44d478fa6310c765c49d2be (127.19.236.67:36765)
I20260811 15:04:02.577343 29711 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.236.67@KRBTEST.COM'} at 127.19.236.67:47935
I20260811 15:04:02.582464 20401 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.19.236.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.19.236.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.19.236.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/krb5kdc/oryx_127.19.236.65.keytab.
Entry for principal oryx/127.19.236.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/krb5kdc/oryx_127.19.236.65.keytab.
WARNING: no policy specified for oryx/127.19.236.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.19.236.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.19.236.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/krb5kdc/oryx_127.19.236.66.keytab.
Entry for principal oryx/127.19.236.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/krb5kdc/oryx_127.19.236.66.keytab.
WARNING: no policy specified for oryx/127.19.236.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.19.236.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.19.236.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/krb5kdc/oryx_127.19.236.67.keytab.
Entry for principal oryx/127.19.236.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/krb5kdc/oryx_127.19.236.67.keytab.
I20260811 15:04:02.667259 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 29778
I20260811 15:04:02.675999 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 29923
I20260811 15:04:02.685192 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 30070
I20260811 15:04:02.694731 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 29677
I20260811 15:04:02.701980 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:42757
--webserver_interface=127.19.236.126
--webserver_port=44359
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab
--principal=kudu/127.19.236.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:38003
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.236.126:42757
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:04:02.815718 30228 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:04:02.816018 30228 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:04:02.816062 30228 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:04:02.820262 30228 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:04:02.820343 30228 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:04:02.820362 30228 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:04:02.820380 30228 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:04:02.820395 30228 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:04:02.825935 30228 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:38003
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.236.126:42757
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab
--principal=kudu/127.19.236.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:42757
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.236.126
--webserver_port=44359
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30228
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:04:02.827121 30228 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:04:02.828150 30228 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:04:02.837064 30238 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:04:02.837056 30234 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:04:02.837064 30235 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:04:02.837474 30228 server_base.cc:1034] running on GCE node
I20260811 15:04:02.838083 30228 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:04:02.839206 30228 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:04:02.840390 30228 hybrid_clock.cc:648] HybridClock initialized: now 1786460642840370 us; error 35 us; skew 500 ppm
Aug 11 15:04:02 dist-test-slave-8n49 krb5kdc[29663](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460642, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:04:02.843262 30228 init.cc:377] Logged in from keytab as kudu/127.19.236.126@KRBTEST.COM (short username kudu)
I20260811 15:04:02.844250 30228 webserver.cc:460] Webserver started at http://127.19.236.126:44359/ using document root <none> and password file <none>
I20260811 15:04:02.844904 30228 fs_manager.cc:359] Metadata directory not provided
I20260811 15:04:02.844985 30228 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:04:02.849128 30228 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 15:04:02.851418 30245 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:04:02.852854 30228 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 15:04:02.853008 30228 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/master-0/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/master-0/wal
uuid: "7f503da8fa34465c9872f43776b9d25d"
format_stamp: "Formatted at 2026-08-11 15:04:01 on dist-test-slave-8n49"
server_key: "a846c3e7d18d2b006bc9a265b03fb62e"
server_key_iv: "c703ef5d5283c8755c7df3e01e6669af"
server_key_version: "encryptionkey@0"
I20260811 15:04:02.853561 30228 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:04:02.872110 30228 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:04:02.875273 30228 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:04:02.875500 30228 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:04:02.883231 30228 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.126:42757
I20260811 15:04:02.883260 30303 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.126:42757 every 8 connection(s)
I20260811 15:04:02.884372 30228 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
I20260811 15:04:02.888958 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 30228
I20260811 15:04:02.889324 30304 sys_catalog.cc:263] Verifying existing consensus state
I20260811 15:04:02.889539 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.65:40917
--local_ip_for_outbound_sockets=127.19.236.65
--tserver_master_addrs=127.19.236.126:42757
--webserver_port=39943
--webserver_interface=127.19.236.65
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.65.keytab
--principal=kudu/127.19.236.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:38003
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.19.236.65
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/krb5kdc/oryx_127.19.236.65.keytab with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 15:04:02.891974 30304 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f503da8fa34465c9872f43776b9d25d: Bootstrap starting.
I20260811 15:04:02.910162 30304 log.cc:824] T 00000000000000000000000000000000 P 7f503da8fa34465c9872f43776b9d25d: Log is configured to *not* fsync() on all Append() calls
I20260811 15:04:02.917356 30304 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f503da8fa34465c9872f43776b9d25d: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 15:04:02.917789 30304 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f503da8fa34465c9872f43776b9d25d: Bootstrap complete.
I20260811 15:04:02.922469 30304 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7f503da8fa34465c9872f43776b9d25d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f503da8fa34465c9872f43776b9d25d" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 42757 } }
I20260811 15:04:02.922899 30304 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7f503da8fa34465c9872f43776b9d25d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f503da8fa34465c9872f43776b9d25d, State: Initialized, Role: FOLLOWER
I20260811 15:04:02.923421 30304 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7f503da8fa34465c9872f43776b9d25d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f503da8fa34465c9872f43776b9d25d" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 42757 } }
I20260811 15:04:02.923555 30304 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7f503da8fa34465c9872f43776b9d25d [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 15:04:02.923653 30304 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7f503da8fa34465c9872f43776b9d25d [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 15:04:02.923750 30304 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7f503da8fa34465c9872f43776b9d25d [term 1 FOLLOWER]: Advancing to term 2
I20260811 15:04:02.926055 30304 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7f503da8fa34465c9872f43776b9d25d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f503da8fa34465c9872f43776b9d25d" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 42757 } }
I20260811 15:04:02.926429 30304 leader_election.cc:302] T 00000000000000000000000000000000 P 7f503da8fa34465c9872f43776b9d25d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7f503da8fa34465c9872f43776b9d25d; no voters:
I20260811 15:04:02.926822 30304 leader_election.cc:288] T 00000000000000000000000000000000 P 7f503da8fa34465c9872f43776b9d25d [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 15:04:02.926928 30308 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7f503da8fa34465c9872f43776b9d25d [term 2 FOLLOWER]: Leader election won for term 2
I20260811 15:04:02.927136 30308 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7f503da8fa34465c9872f43776b9d25d [term 2 LEADER]: Becoming Leader. State: Replica: 7f503da8fa34465c9872f43776b9d25d, State: Running, Role: LEADER
I20260811 15:04:02.927528 30308 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7f503da8fa34465c9872f43776b9d25d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f503da8fa34465c9872f43776b9d25d" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 42757 } }
I20260811 15:04:02.928205 30304 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7f503da8fa34465c9872f43776b9d25d [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:04:02.929177 30309 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f503da8fa34465c9872f43776b9d25d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "7f503da8fa34465c9872f43776b9d25d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f503da8fa34465c9872f43776b9d25d" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 42757 } } }
I20260811 15:04:02.929220 30311 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f503da8fa34465c9872f43776b9d25d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7f503da8fa34465c9872f43776b9d25d. Latest consensus state: current_term: 2 leader_uuid: "7f503da8fa34465c9872f43776b9d25d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f503da8fa34465c9872f43776b9d25d" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 42757 } } }
I20260811 15:04:02.929363 30311 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f503da8fa34465c9872f43776b9d25d [sys.catalog]: This master's current role is: LEADER
I20260811 15:04:02.929309 30309 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f503da8fa34465c9872f43776b9d25d [sys.catalog]: This master's current role is: LEADER
I20260811 15:04:02.933946 30326 catalog_manager.cc:1259] Loaded cluster ID: 84f133e141db4bc48fd6896df07a7cca
I20260811 15:04:02.934015 30326 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 7f503da8fa34465c9872f43776b9d25d: loading cluster ID for follower catalog manager: success
I20260811 15:04:02.936698 30326 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 7f503da8fa34465c9872f43776b9d25d: acquiring CA information for follower catalog manager: success
I20260811 15:04:02.938265 30326 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 7f503da8fa34465c9872f43776b9d25d: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 15:04:02.938414 30318 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:04:02.939173 30318 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:04:02.939621 30318 catalog_manager.cc:1259] Loaded cluster ID: 84f133e141db4bc48fd6896df07a7cca
I20260811 15:04:02.939702 30318 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:04:02.940248 30318 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:04:02.940728 30318 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 7f503da8fa34465c9872f43776b9d25d: Loaded TSK: 0
I20260811 15:04:02.941304 30318 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 15:04:03.012722 30306 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:04:03.013059 30306 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:04:03.013144 30306 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:04:03.017210 30306 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:04:03.017307 30306 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:04:03.017403 30306 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.65
I20260811 15:04:03.022745 30306 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:38003
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/krb5kdc/oryx_127.19.236.65.keytab
--principal=oryx/127.19.236.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.65:40917
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.236.65
--webserver_port=39943
--tserver_master_addrs=127.19.236.126:42757
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30306
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.65
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:04:03.023825 30306 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:04:03.024958 30306 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:04:03.035420 30332 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:04:03.035614 30306 server_base.cc:1034] running on GCE node
W20260811 15:04:03.035421 30333 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:04:03.035432 30336 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:04:03.036188 30306 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:04:03.036942 30306 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:04:03.038170 30306 hybrid_clock.cc:648] HybridClock initialized: now 1786460643038145 us; error 43 us; skew 500 ppm
Aug 11 15:04:03 dist-test-slave-8n49 krb5kdc[29663](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460643, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.236.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:04:03.041235 30306 init.cc:377] Logged in from keytab as oryx/127.19.236.65@KRBTEST.COM (short username oryx)
I20260811 15:04:03.042199 30306 webserver.cc:460] Webserver started at http://127.19.236.65:39943/ using document root <none> and password file <none>
I20260811 15:04:03.042809 30306 fs_manager.cc:359] Metadata directory not provided
I20260811 15:04:03.042927 30306 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:04:03.047180 30306 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 15:04:03.049479 30343 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:04:03.050810 30306 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 15:04:03.050947 30306 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-0/wal
uuid: "cf6c0f51ac4d48b7ac79e1c1c5cc6f25"
format_stamp: "Formatted at 2026-08-11 15:04:02 on dist-test-slave-8n49"
server_key: "e84a333232b7547ed5d7628ae362c199"
server_key_iv: "a60925bdcfff1ec3a3e33e35dbd0980b"
server_key_version: "encryptionkey@0"
I20260811 15:04:03.051499 30306 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:04:03.069684 30306 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:04:03.072990 30306 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:04:03.073199 30306 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:04:03.073873 30306 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:04:03.074800 30306 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:04:03.074868 30306 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:04:03.074937 30306 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:04:03.074986 30306 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:04:03.085233 30306 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.65:40917
I20260811 15:04:03.085258 30465 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.65:40917 every 8 connection(s)
I20260811 15:04:03.086259 30306 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
I20260811 15:04:03.087586 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 30306
I20260811 15:04:03.088112 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.66:37673
--local_ip_for_outbound_sockets=127.19.236.66
--tserver_master_addrs=127.19.236.126:42757
--webserver_port=45859
--webserver_interface=127.19.236.66
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.66.keytab
--principal=kudu/127.19.236.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:38003
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.19.236.66
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/krb5kdc/oryx_127.19.236.66.keytab with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 15:04:03 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.65@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 15:04:03 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.65@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
W20260811 15:04:03.100942 30468 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:04:03.088636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.65:34521 (local address 127.19.236.126:42757)
0811 15:04:03.089104 (+ 468us) server_negotiation.cc:206] Beginning negotiation
0811 15:04:03.089149 (+ 45us) server_negotiation.cc:399] Waiting for connection header
0811 15:04:03.089531 (+ 382us) server_negotiation.cc:407] Connection header received
0811 15:04:03.091671 (+ 2140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:04:03.091688 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:04:03.092094 (+ 406us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:04:03.092481 (+ 387us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:04:03.093589 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:03.094571 (+ 982us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:03.095695 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:03.096165 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:03.096339 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:03.100135 (+ 3796us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.236.65:34521: BlockingRecv error: recv got EOF from 127.19.236.65:34521 (error 108)
Metrics: {"server-negotiator.queue_time_us":295,"thread_start_us":125,"threads_started":1}
I20260811 15:04:03.100950 30469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:03.088854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42757 (local address 127.19.236.65:34521)
0811 15:04:03.089365 (+ 511us) negotiation.cc:107] Waiting for socket to connect
0811 15:04:03.089406 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 15:04:03.091163 (+ 1757us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:04:03.092520 (+ 1357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:04:03.092527 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:04:03.092944 (+ 417us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:04:03.093385 (+ 441us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:03.093398 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:03.094716 (+ 1318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:03.094725 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:03.095567 (+ 842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:03.095577 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:03.096346 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:03.096350 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:03.096528 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:03.097240 (+ 712us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:04:03.097256 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:04:03.099918 (+ 2662us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.236.126:42757: Server oryx/127.19.236.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":331,"thread_start_us":143,"threads_started":1}
W20260811 15:04:03.101630 30466 heartbeater.cc:644] Failed to heartbeat to 127.19.236.126:42757 (0 consecutive failures): Not authorized: Failed to ping master at 127.19.236.126:42757: Client connection negotiation failed: client connection to 127.19.236.126:42757: Server oryx/127.19.236.126@KRBTEST.COM not found in Kerberos database
Aug 11 15:04:03 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.65@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 15:04:03 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.65@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 15:04:03.107596 30469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:03.102114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42757 (local address 127.19.236.65:60755)
0811 15:04:03.102234 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0811 15:04:03.102250 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 15:04:03.102327 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:04:03.102575 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:04:03.102577 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:04:03.102710 (+ 133us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:04:03.102800 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:03.102805 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:03.103857 (+ 1052us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:03.103860 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:03.104388 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:03.104396 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:03.104975 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:03.104978 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:03.105049 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:03.105593 (+ 544us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:04:03.105605 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:04:03.107495 (+ 1890us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.236.126:42757: Server oryx/127.19.236.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":45}
W20260811 15:04:03.108019 30468 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:04:03.102198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.65:60755 (local address 127.19.236.126:42757)
0811 15:04:03.102327 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0811 15:04:03.102331 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:04:03.102346 (+ 15us) server_negotiation.cc:407] Connection header received
0811 15:04:03.102387 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:04:03.102390 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:04:03.102446 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:04:03.102535 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:04:03.102909 (+ 374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:03.103748 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:03.104497 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:03.104871 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:03.104973 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:03.107673 (+ 2700us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.236.65:60755: BlockingRecv error: recv got EOF from 127.19.236.65:60755 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 11 15:04:03 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.65@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 15:04:03 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.65@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 15:04:03.113266 30469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:03.108146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42757 (local address 127.19.236.65:41763)
0811 15:04:03.108314 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0811 15:04:03.108327 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 15:04:03.108409 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:04:03.108661 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:04:03.108664 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:04:03.108783 (+ 119us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:04:03.108852 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:03.108857 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:03.109846 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:03.109848 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:03.110349 (+ 501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:03.110356 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:03.110921 (+ 565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:03.110924 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:03.110979 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:03.111445 (+ 466us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:04:03.111456 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:04:03.113178 (+ 1722us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.236.126:42757: Server oryx/127.19.236.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":103}
W20260811 15:04:03.113481 30466 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 15:04:03.113673 30468 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:04:03.108222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.65:41763 (local address 127.19.236.126:42757)
0811 15:04:03.108440 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0811 15:04:03.108444 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:04:03.108459 (+ 15us) server_negotiation.cc:407] Connection header received
0811 15:04:03.108499 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:04:03.108502 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:04:03.108567 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:04:03.108648 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:04:03.108954 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:03.109735 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:03.110458 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:03.110807 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:03.110907 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:03.113345 (+ 2438us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.236.65:41763: BlockingRecv error: recv got EOF from 127.19.236.65:41763 (error 108)
Metrics: {"mutex_wait_us":85,"server-negotiator.queue_time_us":141}
W20260811 15:04:03.208505 30470 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:04:03.208825 30470 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:04:03.208870 30470 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:04:03.213034 30470 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:04:03.213097 30470 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:04:03.213193 30470 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.66
I20260811 15:04:03.218679 30470 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:38003
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/krb5kdc/oryx_127.19.236.66.keytab
--principal=oryx/127.19.236.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.66:37673
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.236.66
--webserver_port=45859
--tserver_master_addrs=127.19.236.126:42757
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30470
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.66
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:04:03.219875 30470 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:04:03.221050 30470 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 15:04:03.231700 30470 server_base.cc:1034] running on GCE node
W20260811 15:04:03.231678 30477 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:04:03.231666 30476 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:04:03.231950 30480 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:04:03.232393 30470 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:04:03.233146 30470 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:04:03.234337 30470 hybrid_clock.cc:648] HybridClock initialized: now 1786460643234301 us; error 55 us; skew 500 ppm
Aug 11 15:04:03 dist-test-slave-8n49 krb5kdc[29663](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460643, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.236.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:04:03.237185 30470 init.cc:377] Logged in from keytab as oryx/127.19.236.66@KRBTEST.COM (short username oryx)
I20260811 15:04:03.238178 30470 webserver.cc:460] Webserver started at http://127.19.236.66:45859/ using document root <none> and password file <none>
I20260811 15:04:03.238785 30470 fs_manager.cc:359] Metadata directory not provided
I20260811 15:04:03.238898 30470 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:04:03.242970 30470 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 15:04:03.245227 30487 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:04:03.246526 30470 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 15:04:03.246680 30470 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-1/wal
uuid: "8f349d9966ee4f168878bc9a2a0beb01"
format_stamp: "Formatted at 2026-08-11 15:04:02 on dist-test-slave-8n49"
server_key: "9580d114bab7dbf40e58357eded72f83"
server_key_iv: "9abe99e82507bb76b3212b3d9832502c"
server_key_version: "encryptionkey@0"
I20260811 15:04:03.247263 30470 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:04:03.260671 30470 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:04:03.263670 30470 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:04:03.263887 30470 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:04:03.264504 30470 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:04:03.265386 30470 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:04:03.265462 30470 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:04:03.265537 30470 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:04:03.265583 30470 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:04:03.274948 30470 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.66:37673
I20260811 15:04:03.274976 30610 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.66:37673 every 8 connection(s)
I20260811 15:04:03.276000 30470 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
I20260811 15:04:03.276856 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 30470
I20260811 15:04:03.277343 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.67:36765
--local_ip_for_outbound_sockets=127.19.236.67
--tserver_master_addrs=127.19.236.126:42757
--webserver_port=40461
--webserver_interface=127.19.236.67
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.67.keytab
--principal=kudu/127.19.236.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:38003
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.19.236.67
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/krb5kdc/oryx_127.19.236.67.keytab with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 15:04:03 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.66@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 15:04:03 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.66@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
W20260811 15:04:03.290045 30468 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:04:03.278228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.66:47365 (local address 127.19.236.126:42757)
0811 15:04:03.278417 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0811 15:04:03.278424 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 15:04:03.279342 (+ 918us) server_negotiation.cc:407] Connection header received
0811 15:04:03.280852 (+ 1510us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:04:03.280856 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:04:03.280910 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:04:03.281025 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:04:03.282664 (+ 1639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:03.283197 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:03.285144 (+ 1947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:03.285358 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:03.285440 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:03.289832 (+ 4392us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.236.66:47365: BlockingRecv error: recv got EOF from 127.19.236.66:47365 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
I20260811 15:04:03.290773 30613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:03.278606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42757 (local address 127.19.236.66:47365)
0811 15:04:03.279170 (+ 564us) negotiation.cc:107] Waiting for socket to connect
0811 15:04:03.279234 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0811 15:04:03.280612 (+ 1378us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:04:03.281202 (+ 590us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:04:03.281214 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:04:03.281747 (+ 533us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:04:03.282497 (+ 750us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:03.282521 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:03.283339 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:03.283345 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:03.285012 (+ 1667us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:03.285027 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:03.285531 (+ 504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:03.285538 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:03.285786 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:03.286491 (+ 705us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:04:03.286520 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:04:03.289569 (+ 3049us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.236.126:42757: Server oryx/127.19.236.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":302,"thread_start_us":122,"threads_started":1}
W20260811 15:04:03.291312 30611 heartbeater.cc:644] Failed to heartbeat to 127.19.236.126:42757 (0 consecutive failures): Not authorized: Failed to ping master at 127.19.236.126:42757: Client connection negotiation failed: client connection to 127.19.236.126:42757: Server oryx/127.19.236.126@KRBTEST.COM not found in Kerberos database
Aug 11 15:04:03 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.66@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 15:04:03 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.66@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 15:04:03.297389 30613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:03.291766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42757 (local address 127.19.236.66:40797)
0811 15:04:03.291960 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0811 15:04:03.291974 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 15:04:03.292051 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:04:03.292303 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:04:03.292305 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:04:03.292455 (+ 150us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:04:03.292601 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:03.292612 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:03.293656 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:03.293658 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:03.294204 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:03.294211 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:03.294762 (+ 551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:03.294764 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:03.294832 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:03.295348 (+ 516us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:04:03.295361 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:04:03.297252 (+ 1891us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.236.126:42757: Server oryx/127.19.236.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":126}
W20260811 15:04:03.297676 30468 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:04:03.291895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.66:40797 (local address 127.19.236.126:42757)
0811 15:04:03.292028 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0811 15:04:03.292032 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:04:03.292048 (+ 16us) server_negotiation.cc:407] Connection header received
0811 15:04:03.292137 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:04:03.292140 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:04:03.292193 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:04:03.292277 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:04:03.292726 (+ 449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:03.293553 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:03.294310 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:03.294655 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:03.294755 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:03.297386 (+ 2631us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.236.66:40797: BlockingRecv error: recv got EOF from 127.19.236.66:40797 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 11 15:04:03 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.66@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 15:04:03 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.66@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 15:04:03.303495 30613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:03.297965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42757 (local address 127.19.236.66:47879)
0811 15:04:03.298073 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0811 15:04:03.298087 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 15:04:03.298162 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:04:03.298395 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:04:03.298398 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:04:03.298560 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:04:03.298648 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:03.298653 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:03.299350 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:03.299353 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:03.300231 (+ 878us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:03.300241 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:03.300690 (+ 449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:03.300693 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:03.300783 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:03.301240 (+ 457us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:04:03.301254 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:04:03.303354 (+ 2100us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.236.126:42757: Server oryx/127.19.236.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":31}
W20260811 15:04:03.303582 30468 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:04:03.298023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.66:47879 (local address 127.19.236.126:42757)
0811 15:04:03.298156 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0811 15:04:03.298160 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:04:03.298175 (+ 15us) server_negotiation.cc:407] Connection header received
0811 15:04:03.298240 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:04:03.298245 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:04:03.298289 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:04:03.298354 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:04:03.298755 (+ 401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:03.299243 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:03.300344 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:03.300540 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:03.300676 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:03.303471 (+ 2795us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.236.66:47879: BlockingRecv error: recv got EOF from 127.19.236.66:47879 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
W20260811 15:04:03.303867 30611 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 15:04:03.403707 30614 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:04:03.403982 30614 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:04:03.404026 30614 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:04:03.408111 30614 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:04:03.408174 30614 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:04:03.408234 30614 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.67
I20260811 15:04:03.413636 30614 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:38003
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/krb5kdc/oryx_127.19.236.67.keytab
--principal=oryx/127.19.236.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.67:36765
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.236.67
--webserver_port=40461
--tserver_master_addrs=127.19.236.126:42757
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30614
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.67
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:04:03.414680 30614 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:04:03.415786 30614 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:04:03.425843 30622 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:04:03.425794 30614 server_base.cc:1034] running on GCE node
W20260811 15:04:03.425796 30620 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:04:03.425810 30619 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:04:03.426416 30614 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:04:03.427073 30614 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:04:03.428280 30614 hybrid_clock.cc:648] HybridClock initialized: now 1786460643428254 us; error 42 us; skew 500 ppm
Aug 11 15:04:03 dist-test-slave-8n49 krb5kdc[29663](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460643, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.236.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:04:03.431288 30614 init.cc:377] Logged in from keytab as oryx/127.19.236.67@KRBTEST.COM (short username oryx)
I20260811 15:04:03.432245 30614 webserver.cc:460] Webserver started at http://127.19.236.67:40461/ using document root <none> and password file <none>
I20260811 15:04:03.432899 30614 fs_manager.cc:359] Metadata directory not provided
I20260811 15:04:03.433014 30614 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:04:03.437107 30614 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.003s
I20260811 15:04:03.439392 30630 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:04:03.440774 30614 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 15:04:03.441093 30614 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-2/wal
uuid: "9394067ba44d478fa6310c765c49d2be"
format_stamp: "Formatted at 2026-08-11 15:04:02 on dist-test-slave-8n49"
server_key: "fc9410a2dfd2ff477a17358897136a52"
server_key_iv: "003634edf475401081bc907083ef4989"
server_key_version: "encryptionkey@0"
I20260811 15:04:03.441694 30614 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:04:03.462450 30614 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:04:03.465595 30614 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:04:03.465788 30614 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:04:03.466351 30614 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:04:03.467154 30614 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:04:03.467201 30614 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:04:03.467242 30614 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:04:03.467264 30614 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:04:03.476564 30614 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.67:36765
I20260811 15:04:03.476641 30756 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.67:36765 every 8 connection(s)
I20260811 15:04:03.477648 30614 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
I20260811 15:04:03.486178 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 30614
Aug 11 15:04:03 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.67@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 15:04:03 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.67@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
W20260811 15:04:03.490793 30468 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:04:03.479678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.67:33967 (local address 127.19.236.126:42757)
0811 15:04:03.479895 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0811 15:04:03.479899 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:04:03.480934 (+ 1035us) server_negotiation.cc:407] Connection header received
0811 15:04:03.482515 (+ 1581us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:04:03.482520 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:04:03.482590 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:04:03.482715 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:04:03.484109 (+ 1394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:03.484808 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:03.486134 (+ 1326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:03.486478 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:03.486621 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:03.490621 (+ 4000us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.236.67:33967: BlockingRecv error: recv got EOF from 127.19.236.67:33967 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
I20260811 15:04:03.491602 30759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:03.480081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42757 (local address 127.19.236.67:33967)
0811 15:04:03.480756 (+ 675us) negotiation.cc:107] Waiting for socket to connect
0811 15:04:03.480806 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 15:04:03.482255 (+ 1449us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:04:03.482923 (+ 668us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:04:03.482938 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:04:03.483349 (+ 411us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:04:03.483926 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:03.483952 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:03.484968 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:03.484972 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:03.485981 (+ 1009us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:03.485991 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:03.486683 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:03.486688 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:03.486884 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:03.487629 (+ 745us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:04:03.487651 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:04:03.490488 (+ 2837us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.236.126:42757: Server oryx/127.19.236.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":300,"thread_start_us":122,"threads_started":1}
W20260811 15:04:03.492244 30757 heartbeater.cc:644] Failed to heartbeat to 127.19.236.126:42757 (0 consecutive failures): Not authorized: Failed to ping master at 127.19.236.126:42757: Client connection negotiation failed: client connection to 127.19.236.126:42757: Server oryx/127.19.236.126@KRBTEST.COM not found in Kerberos database
Aug 11 15:04:03 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.67@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 15:04:03 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.67@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 15:04:03.497560 30761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:03.487333 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50148 (local address 127.19.236.126:42757)
0811 15:04:03.487650 (+ 317us) server_negotiation.cc:206] Beginning negotiation
0811 15:04:03.487655 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:04:03.487760 (+ 105us) server_negotiation.cc:407] Connection header received
0811 15:04:03.487878 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:04:03.487882 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:04:03.487938 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:04:03.488054 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:04:03.488912 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:03.489485 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:03.490742 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:03.491134 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:03.491233 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:03.493089 (+ 1856us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:04:03.493095 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:04:03.493111 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:04:03.493148 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:04:03.495111 (+ 1963us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:04:03.495641 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:04:03.495647 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:04:03.495653 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:04:03.495780 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:04:03.496108 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:04:03.496113 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:04:03.496115 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:04:03.496496 (+ 381us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:04:03.496757 (+ 261us) server_negotiation.cc:1035] Waiting for connection context
0811 15:04:03.497116 (+ 359us) server_negotiation.cc:299] Negotiation successful
0811 15:04:03.497409 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":231,"thread_start_us":109,"threads_started":1}
I20260811 15:04:03.497639 30759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:03.492775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42757 (local address 127.19.236.67:49401)
0811 15:04:03.492889 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0811 15:04:03.492904 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 15:04:03.492979 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:04:03.493233 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:04:03.493237 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:04:03.493397 (+ 160us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:04:03.493485 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:03.493490 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:03.494207 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:03.494212 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:03.494764 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:03.494772 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:03.495218 (+ 446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:03.495222 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:03.495311 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:03.495754 (+ 443us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:04:03.495776 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:04:03.497488 (+ 1712us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.236.126:42757: Server oryx/127.19.236.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":45}
W20260811 15:04:03.497707 30468 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:04:03.492898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.67:49401 (local address 127.19.236.126:42757)
0811 15:04:03.493040 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0811 15:04:03.493046 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 15:04:03.493061 (+ 15us) server_negotiation.cc:407] Connection header received
0811 15:04:03.493099 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:04:03.493101 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:04:03.493133 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:04:03.493217 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:04:03.493606 (+ 389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:03.494100 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:03.494888 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:03.495110 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:03.495216 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:03.497601 (+ 2385us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.236.67:49401: BlockingRecv error: recv got EOF from 127.19.236.67:49401 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Aug 11 15:04:03 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.67@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 15:04:03 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.67@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 15:04:03.503315 30759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:03.498256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42757 (local address 127.19.236.67:47423)
0811 15:04:03.498400 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0811 15:04:03.498417 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 15:04:03.498508 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:04:03.498776 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:04:03.498779 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:04:03.498932 (+ 153us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:04:03.499006 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:03.499011 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:03.499879 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:03.499882 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:03.500634 (+ 752us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:03.500646 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:03.501111 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:03.501116 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:03.501204 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:03.501615 (+ 411us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:04:03.501626 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:04:03.503222 (+ 1596us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.236.126:42757: Server oryx/127.19.236.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":61}
W20260811 15:04:03.503507 30468 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:04:03.498304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.67:47423 (local address 127.19.236.126:42757)
0811 15:04:03.498445 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0811 15:04:03.498448 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 15:04:03.498465 (+ 17us) server_negotiation.cc:407] Connection header received
0811 15:04:03.498602 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:04:03.498604 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:04:03.498637 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:04:03.498730 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:04:03.499115 (+ 385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:03.499755 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:03.500744 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:03.500988 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:03.501108 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:03.503375 (+ 2267us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.236.67:47423: BlockingRecv error: recv got EOF from 127.19.236.67:47423 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
W20260811 15:04:03.503535 30757 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 11 15:04:04 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.65@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 15:04:04 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.65@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 15:04:04.120147 30763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:04.114322 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42757 (local address 127.19.236.65:50551)
0811 15:04:04.114701 (+ 379us) negotiation.cc:107] Waiting for socket to connect
0811 15:04:04.114739 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 15:04:04.114852 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:04:04.115174 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:04:04.115177 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:04:04.115422 (+ 245us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:04:04.115548 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:04.115554 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:04.116441 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:04.116444 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:04.117096 (+ 652us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:04.117105 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:04.117521 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:04.117523 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:04.117584 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:04.118141 (+ 557us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:04:04.118153 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:04:04.120021 (+ 1868us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.236.126:42757: Server oryx/127.19.236.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":303,"thread_start_us":92,"threads_started":1}
W20260811 15:04:04.120332 30764 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:04:04.114457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.65:50551 (local address 127.19.236.126:42757)
0811 15:04:04.114793 (+ 336us) server_negotiation.cc:206] Beginning negotiation
0811 15:04:04.114797 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:04:04.114812 (+ 15us) server_negotiation.cc:407] Connection header received
0811 15:04:04.114982 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:04:04.114988 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:04:04.115050 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:04:04.115148 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:04:04.115692 (+ 544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:04.116337 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:04.117206 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:04.117426 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:04.117502 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:04.120156 (+ 2654us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.236.65:50551: BlockingRecv error: recv got EOF from 127.19.236.65:50551 (error 108)
Metrics: {"server-negotiator.queue_time_us":250,"thread_start_us":136,"threads_started":1}
Aug 11 15:04:04 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.66@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 15:04:04 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.66@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 15:04:04.310607 30766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:04.304703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42757 (local address 127.19.236.66:52573)
0811 15:04:04.305063 (+ 360us) negotiation.cc:107] Waiting for socket to connect
0811 15:04:04.305080 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 15:04:04.305229 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:04:04.305509 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:04:04.305511 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:04:04.305741 (+ 230us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:04:04.305837 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:04.305842 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:04.306623 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:04.306628 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:04.307218 (+ 590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:04.307227 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:04.307710 (+ 483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:04.307714 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:04.307801 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:04.308340 (+ 539us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:04:04.308352 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:04:04.310456 (+ 2104us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.236.126:42757: Server oryx/127.19.236.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":271,"thread_start_us":90,"threads_started":1}
W20260811 15:04:04.310899 30764 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:04:04.304847 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.66:52573 (local address 127.19.236.126:42757)
0811 15:04:04.305038 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0811 15:04:04.305043 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:04:04.305176 (+ 133us) server_negotiation.cc:407] Connection header received
0811 15:04:04.305341 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:04:04.305344 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:04:04.305398 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:04:04.305490 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:04:04.305960 (+ 470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:04.306501 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:04.307345 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:04.307580 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:04.307694 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:04.310626 (+ 2932us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.236.66:52573: BlockingRecv error: recv got EOF from 127.19.236.66:52573 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
Aug 11 15:04:04 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.67@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 15:04:04 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.67@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 15:04:04.509680 30767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:04.504287 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42757 (local address 127.19.236.67:42509)
0811 15:04:04.504643 (+ 356us) negotiation.cc:107] Waiting for socket to connect
0811 15:04:04.504658 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 15:04:04.504763 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:04:04.504971 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:04:04.504973 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:04:04.505178 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:04:04.505278 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:04.505284 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:04.506002 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:04.506005 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:04.506640 (+ 635us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:04.506649 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:04.507061 (+ 412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:04.507064 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:04.507130 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:04.507637 (+ 507us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:04:04.507649 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:04:04.509545 (+ 1896us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.236.126:42757: Server oryx/127.19.236.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":133,"threads_started":1}
W20260811 15:04:04.509822 30764 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:04:04.504336 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.67:42509 (local address 127.19.236.126:42757)
0811 15:04:04.504497 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0811 15:04:04.504500 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 15:04:04.504730 (+ 230us) server_negotiation.cc:407] Connection header received
0811 15:04:04.504835 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:04:04.504837 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:04:04.504884 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:04:04.504953 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:04:04.505377 (+ 424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:04.505900 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:04.506746 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:04.506958 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:04.507033 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:04.509689 (+ 2656us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.236.67:42509: BlockingRecv error: recv got EOF from 127.19.236.67:42509 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 11 15:04:05 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.65@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 15:04:05 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.65@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 15:04:05.126914 30768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:05.121121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42757 (local address 127.19.236.65:57269)
0811 15:04:05.121440 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0811 15:04:05.121459 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 15:04:05.121577 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:04:05.121886 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:04:05.121889 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:04:05.122149 (+ 260us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:04:05.122273 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:05.122287 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:05.123073 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:05.123078 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:05.123647 (+ 569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:05.123656 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:05.124156 (+ 500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:05.124160 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:05.124248 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:05.124867 (+ 619us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:04:05.124889 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:04:05.126715 (+ 1826us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.236.126:42757: Server oryx/127.19.236.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":125,"threads_started":1}
W20260811 15:04:05.126976 30769 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:04:05.121252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.65:57269 (local address 127.19.236.126:42757)
0811 15:04:05.121536 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0811 15:04:05.121540 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:04:05.121557 (+ 17us) server_negotiation.cc:407] Connection header received
0811 15:04:05.121683 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:04:05.121686 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:04:05.121732 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:04:05.121858 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:04:05.122403 (+ 545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:05.122947 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:05.123798 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:05.124030 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:05.124141 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:05.126841 (+ 2700us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.236.65:57269: BlockingRecv error: recv got EOF from 127.19.236.65:57269 (error 108)
Metrics: {"server-negotiator.queue_time_us":208,"thread_start_us":121,"threads_started":1}
Aug 11 15:04:05 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.66@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 15:04:05 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.66@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 15:04:05.317386 30770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:05.311639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42757 (local address 127.19.236.66:35941)
0811 15:04:05.312010 (+ 371us) negotiation.cc:107] Waiting for socket to connect
0811 15:04:05.312025 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 15:04:05.312163 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:04:05.312538 (+ 375us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:04:05.312541 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:04:05.312815 (+ 274us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:04:05.312956 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:05.312967 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:05.313763 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:05.313766 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:05.314330 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:05.314338 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:05.314780 (+ 442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:05.314782 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:05.314843 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:05.315402 (+ 559us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:04:05.315424 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:04:05.317242 (+ 1818us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.236.126:42757: Server oryx/127.19.236.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":278,"thread_start_us":91,"threads_started":1}
W20260811 15:04:05.317561 30769 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:04:05.311788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.66:35941 (local address 127.19.236.126:42757)
0811 15:04:05.311949 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0811 15:04:05.311952 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 15:04:05.312114 (+ 162us) server_negotiation.cc:407] Connection header received
0811 15:04:05.312335 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:04:05.312338 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:04:05.312402 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:04:05.312509 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:04:05.313092 (+ 583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:05.313656 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:05.314459 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:05.314675 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:05.314758 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:05.317393 (+ 2635us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.236.66:35941: BlockingRecv error: recv got EOF from 127.19.236.66:35941 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 11 15:04:05 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.67@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 15:04:05 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.67@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 15:04:05.516613 30771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:05.510707 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42757 (local address 127.19.236.67:49343)
0811 15:04:05.511020 (+ 313us) negotiation.cc:107] Waiting for socket to connect
0811 15:04:05.511034 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 15:04:05.511125 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:04:05.511395 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:04:05.511398 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:04:05.511582 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:04:05.511678 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:05.511683 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:05.512496 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:05.512499 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:05.513105 (+ 606us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:05.513114 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:05.513631 (+ 517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:05.513635 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:05.513712 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:05.514376 (+ 664us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:04:05.514391 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:04:05.516399 (+ 2008us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.236.126:42757: Server oryx/127.19.236.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":124,"threads_started":1}
W20260811 15:04:05.516772 30769 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:04:05.510940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.67:49343 (local address 127.19.236.126:42757)
0811 15:04:05.511084 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0811 15:04:05.511088 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:04:05.511103 (+ 15us) server_negotiation.cc:407] Connection header received
0811 15:04:05.511223 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:04:05.511225 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:04:05.511272 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:04:05.511340 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:04:05.511806 (+ 466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:05.512339 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:05.513235 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:05.513476 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:05.513568 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:05.516623 (+ 3055us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.236.67:49343: BlockingRecv error: recv got EOF from 127.19.236.67:49343 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 11 15:04:06 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.65@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 15:04:06 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.65@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 15:04:06.133610 30773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:06.127822 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42757 (local address 127.19.236.65:59943)
0811 15:04:06.128123 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0811 15:04:06.128138 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 15:04:06.128229 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:04:06.128499 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:04:06.128502 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:04:06.128706 (+ 204us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:04:06.128802 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:06.128807 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:06.129643 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:06.129646 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:06.130199 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:06.130207 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:06.130643 (+ 436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:06.130645 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:06.130752 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:06.131322 (+ 570us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:04:06.131333 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:04:06.133460 (+ 2127us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.236.126:42757: Server oryx/127.19.236.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":106,"threads_started":1}
W20260811 15:04:06.133751 30774 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:04:06.127942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.65:59943 (local address 127.19.236.126:42757)
0811 15:04:06.128188 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0811 15:04:06.128191 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 15:04:06.128206 (+ 15us) server_negotiation.cc:407] Connection header received
0811 15:04:06.128321 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:04:06.128324 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:04:06.128369 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:04:06.128457 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:04:06.128926 (+ 469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:06.129486 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:06.130297 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:06.130533 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:06.130654 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:06.133618 (+ 2964us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.236.65:59943: BlockingRecv error: recv got EOF from 127.19.236.65:59943 (error 108)
Metrics: {"server-negotiator.queue_time_us":167,"thread_start_us":88,"threads_started":1}
Aug 11 15:04:06 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.66@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 15:04:06 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.66@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 15:04:06.324081 30775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:06.318138 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42757 (local address 127.19.236.66:50531)
0811 15:04:06.318578 (+ 440us) negotiation.cc:107] Waiting for socket to connect
0811 15:04:06.318600 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 15:04:06.318752 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:04:06.319049 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:04:06.319052 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:04:06.319270 (+ 218us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:04:06.319364 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:06.319370 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:06.320154 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:06.320160 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:06.320805 (+ 645us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:06.320815 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:06.321281 (+ 466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:06.321284 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:06.321369 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:06.321946 (+ 577us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:04:06.321958 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:04:06.323896 (+ 1938us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.236.126:42757: Server oryx/127.19.236.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":366,"thread_start_us":92,"threads_started":1}
W20260811 15:04:06.324141 30774 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:04:06.318285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.66:50531 (local address 127.19.236.126:42757)
0811 15:04:06.318565 (+ 280us) server_negotiation.cc:206] Beginning negotiation
0811 15:04:06.318570 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:04:06.318687 (+ 117us) server_negotiation.cc:407] Connection header received
0811 15:04:06.318860 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:04:06.318863 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:04:06.318922 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:04:06.319021 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:04:06.319497 (+ 476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:06.320039 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:06.320928 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:06.321157 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:06.321275 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:06.324030 (+ 2755us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.236.66:50531: BlockingRecv error: recv got EOF from 127.19.236.66:50531 (error 108)
Metrics: {"server-negotiator.queue_time_us":164}
Aug 11 15:04:06 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.67@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 15:04:06 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.67@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 15:04:06.523154 30776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:06.517482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42757 (local address 127.19.236.67:43131)
0811 15:04:06.517768 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0811 15:04:06.517781 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 15:04:06.517882 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:04:06.518149 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:04:06.518152 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:04:06.518333 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:04:06.518432 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:06.518436 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:06.519225 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:06.519227 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:06.519795 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:06.519804 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:06.520441 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:06.520444 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:06.520524 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:06.521170 (+ 646us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:04:06.521189 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:04:06.523029 (+ 1840us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.236.126:42757: Server oryx/127.19.236.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":100,"threads_started":1}
W20260811 15:04:06.523433 30774 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:04:06.517571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.67:43131 (local address 127.19.236.126:42757)
0811 15:04:06.517756 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0811 15:04:06.517760 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:04:06.517857 (+ 97us) server_negotiation.cc:407] Connection header received
0811 15:04:06.517973 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:04:06.517976 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:04:06.518029 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:04:06.518112 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:04:06.518576 (+ 464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:06.519117 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:06.520061 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:06.520302 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:06.520394 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:06.523296 (+ 2902us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.236.67:43131: BlockingRecv error: recv got EOF from 127.19.236.67:43131 (error 108)
Metrics: {"server-negotiator.queue_time_us":85}
Aug 11 15:04:07 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.65@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 15:04:07 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.65@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 15:04:07.143838 30778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:07.134622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42757 (local address 127.19.236.65:33919)
0811 15:04:07.134955 (+ 333us) negotiation.cc:107] Waiting for socket to connect
0811 15:04:07.134973 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 15:04:07.135073 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:04:07.135339 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:04:07.135341 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:04:07.135539 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:04:07.135635 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:07.135640 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:07.136426 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:07.136430 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:07.137086 (+ 656us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:07.137097 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:07.137639 (+ 542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:07.137643 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:07.137721 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:07.141635 (+ 3914us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:04:07.141649 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:04:07.143713 (+ 2064us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.236.126:42757: Server oryx/127.19.236.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":93,"threads_started":1}
W20260811 15:04:07.144169 30780 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:04:07.134768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.65:33919 (local address 127.19.236.126:42757)
0811 15:04:07.135035 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0811 15:04:07.135039 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:04:07.135054 (+ 15us) server_negotiation.cc:407] Connection header received
0811 15:04:07.135171 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:04:07.135173 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:04:07.135220 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:04:07.135300 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:04:07.135741 (+ 441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:07.136297 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:07.137230 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:07.137486 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:07.137578 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:07.144027 (+ 6449us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.236.65:33919: BlockingRecv error: recv got EOF from 127.19.236.65:33919 (error 108)
Metrics: {"server-negotiator.queue_time_us":192,"thread_start_us":61,"threads_started":1}
Aug 11 15:04:07 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.66@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 15:04:07 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.66@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 15:04:07.331332 30781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:07.325012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42757 (local address 127.19.236.66:44779)
0811 15:04:07.325400 (+ 388us) negotiation.cc:107] Waiting for socket to connect
0811 15:04:07.325415 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 15:04:07.325568 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:04:07.325866 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:04:07.325870 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:04:07.326093 (+ 223us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:04:07.326190 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:07.326196 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:07.327137 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:07.327142 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:07.327717 (+ 575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:07.327726 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:07.328299 (+ 573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:07.328302 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:07.328398 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:07.329141 (+ 743us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:04:07.329153 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:04:07.331211 (+ 2058us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.236.126:42757: Server oryx/127.19.236.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":290,"thread_start_us":101,"threads_started":1}
W20260811 15:04:07.331512 30780 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:04:07.325169 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.66:44779 (local address 127.19.236.126:42757)
0811 15:04:07.325352 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0811 15:04:07.325357 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:04:07.325507 (+ 150us) server_negotiation.cc:407] Connection header received
0811 15:04:07.325693 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:04:07.325696 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:04:07.325753 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:04:07.325842 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:04:07.326341 (+ 499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:07.327018 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:07.327863 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:07.328171 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:07.328283 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:07.331361 (+ 3078us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.236.66:44779: BlockingRecv error: recv got EOF from 127.19.236.66:44779 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 11 15:04:07 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.67@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 15:04:07 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.67@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 15:04:07.530136 30783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:07.524028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42757 (local address 127.19.236.67:40099)
0811 15:04:07.524314 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0811 15:04:07.524328 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 15:04:07.524436 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:04:07.524753 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:04:07.524756 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:04:07.524954 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:04:07.525056 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:07.525062 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:07.525909 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:07.525913 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:07.526482 (+ 569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:07.526492 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:07.526974 (+ 482us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:07.526977 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:07.527046 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:07.527653 (+ 607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:04:07.527667 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:04:07.529951 (+ 2284us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.236.126:42757: Server oryx/127.19.236.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":103,"threads_started":1}
W20260811 15:04:07.530196 30780 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:04:07.524151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.67:40099 (local address 127.19.236.126:42757)
0811 15:04:07.524296 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0811 15:04:07.524300 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:04:07.524399 (+ 99us) server_negotiation.cc:407] Connection header received
0811 15:04:07.524534 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:04:07.524536 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:04:07.524603 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:04:07.524677 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:04:07.525218 (+ 541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:07.525777 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:07.526621 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:07.526849 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:07.526944 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:07.530085 (+ 3141us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.236.67:40099: BlockingRecv error: recv got EOF from 127.19.236.67:40099 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 11 15:04:08 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.65@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 15:04:08 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.65@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 15:04:08.150537 30784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:08.144837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42757 (local address 127.19.236.65:39013)
0811 15:04:08.145156 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0811 15:04:08.145171 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 15:04:08.145295 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:04:08.145640 (+ 345us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:04:08.145643 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:04:08.145911 (+ 268us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:04:08.146053 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:08.146060 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:08.147009 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:08.147012 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:08.147572 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:08.147580 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:08.147987 (+ 407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:08.147990 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:08.148051 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:08.148581 (+ 530us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:04:08.148594 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:04:08.150387 (+ 1793us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.236.126:42757: Server oryx/127.19.236.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":92,"threads_started":1}
W20260811 15:04:08.150667 30785 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:04:08.144927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.65:39013 (local address 127.19.236.126:42757)
0811 15:04:08.145286 (+ 359us) server_negotiation.cc:206] Beginning negotiation
0811 15:04:08.145290 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:04:08.145304 (+ 14us) server_negotiation.cc:407] Connection header received
0811 15:04:08.145414 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:04:08.145419 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:04:08.145473 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:04:08.145595 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:04:08.146199 (+ 604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:08.146904 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:08.147675 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:08.147889 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:08.147965 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:08.150533 (+ 2568us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.236.65:39013: BlockingRecv error: recv got EOF from 127.19.236.65:39013 (error 108)
Metrics: {"server-negotiator.queue_time_us":251,"thread_start_us":108,"threads_started":1}
Aug 11 15:04:08 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.66@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 15:04:08 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.66@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 15:04:08.338045 30786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:08.332178 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42757 (local address 127.19.236.66:49871)
0811 15:04:08.332600 (+ 422us) negotiation.cc:107] Waiting for socket to connect
0811 15:04:08.332618 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 15:04:08.332759 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:04:08.333053 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:04:08.333056 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:04:08.333280 (+ 224us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:04:08.333375 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:08.333381 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:08.334161 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:08.334165 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:08.334734 (+ 569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:08.334742 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:08.335315 (+ 573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:08.335322 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:08.335427 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:08.336033 (+ 606us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:04:08.336045 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:04:08.337925 (+ 1880us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.236.126:42757: Server oryx/127.19.236.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":278,"thread_start_us":108,"threads_started":1}
W20260811 15:04:08.338238 30785 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:04:08.332395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.66:49871 (local address 127.19.236.126:42757)
0811 15:04:08.332602 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0811 15:04:08.332608 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 15:04:08.332712 (+ 104us) server_negotiation.cc:407] Connection header received
0811 15:04:08.332871 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:04:08.332875 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:04:08.332933 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:04:08.333027 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:04:08.333503 (+ 476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:08.334048 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:08.334860 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:08.335125 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:08.335238 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:08.338094 (+ 2856us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.236.66:49871: BlockingRecv error: recv got EOF from 127.19.236.66:49871 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
Aug 11 15:04:08 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.67@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 15:04:08 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.67@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 15:04:08.537029 30787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:08.531042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42757 (local address 127.19.236.67:59435)
0811 15:04:08.531346 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0811 15:04:08.531361 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 15:04:08.531464 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:04:08.531713 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:04:08.531715 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:04:08.531906 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:04:08.532012 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:08.532017 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:08.532807 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:08.532810 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:08.533383 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:08.533391 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:08.534049 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:08.534052 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:08.534119 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:08.534738 (+ 619us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:04:08.534750 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:04:08.536904 (+ 2154us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.236.126:42757: Server oryx/127.19.236.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":102,"threads_started":1}
W20260811 15:04:08.537200 30785 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:04:08.531098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.67:59435 (local address 127.19.236.126:42757)
0811 15:04:08.531260 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0811 15:04:08.531266 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 15:04:08.531437 (+ 171us) server_negotiation.cc:407] Connection header received
0811 15:04:08.531556 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:04:08.531559 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:04:08.531607 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:04:08.531670 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:04:08.532116 (+ 446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:08.532697 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:08.533487 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:08.533709 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:08.533785 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:08.537040 (+ 3255us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.236.67:59435: BlockingRecv error: recv got EOF from 127.19.236.67:59435 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Aug 11 15:04:09 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.65@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 15:04:09 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.65@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 15:04:09.157950 30788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:09.151511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42757 (local address 127.19.236.65:56755)
0811 15:04:09.152089 (+ 578us) negotiation.cc:107] Waiting for socket to connect
0811 15:04:09.152123 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 15:04:09.152257 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:04:09.152617 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:04:09.152620 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:04:09.152833 (+ 213us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:04:09.152943 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:09.152949 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:09.153763 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:09.153768 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:09.154329 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:09.154337 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:09.154822 (+ 485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:09.154826 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:09.154928 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:09.155516 (+ 588us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:04:09.155528 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:04:09.157825 (+ 2297us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.236.126:42757: Server oryx/127.19.236.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":95,"threads_started":1}
W20260811 15:04:09.158316 30789 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:04:09.151628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.65:56755 (local address 127.19.236.126:42757)
0811 15:04:09.151951 (+ 323us) server_negotiation.cc:206] Beginning negotiation
0811 15:04:09.151955 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:04:09.152222 (+ 267us) server_negotiation.cc:407] Connection header received
0811 15:04:09.152362 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:04:09.152398 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:04:09.152450 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:04:09.152579 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:04:09.153070 (+ 491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:09.153642 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:09.154454 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:09.154697 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:09.154808 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:09.158016 (+ 3208us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.236.65:56755: BlockingRecv error: recv got EOF from 127.19.236.65:56755 (error 108)
Metrics: {"server-negotiator.queue_time_us":236,"thread_start_us":86,"threads_started":1}
Aug 11 15:04:09 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.66@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 15:04:09 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.66@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 15:04:09.344734 30790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:09.338963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42757 (local address 127.19.236.66:55067)
0811 15:04:09.339273 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0811 15:04:09.339287 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 15:04:09.339388 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:04:09.339745 (+ 357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:04:09.339748 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:04:09.339944 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:04:09.340045 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:09.340050 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:09.340855 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:09.340857 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:09.341433 (+ 576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:09.341441 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:09.341922 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:09.341925 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:09.342003 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:09.342594 (+ 591us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:04:09.342607 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:04:09.344517 (+ 1910us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.236.126:42757: Server oryx/127.19.236.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":113,"threads_started":1}
W20260811 15:04:09.344811 30789 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:04:09.339122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.66:55067 (local address 127.19.236.126:42757)
0811 15:04:09.339278 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0811 15:04:09.339282 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:04:09.339342 (+ 60us) server_negotiation.cc:407] Connection header received
0811 15:04:09.339489 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:04:09.339491 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:04:09.339537 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:04:09.339609 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:04:09.340163 (+ 554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:09.340752 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:09.341565 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:09.341801 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:09.341918 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:09.344696 (+ 2778us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.236.66:55067: BlockingRecv error: recv got EOF from 127.19.236.66:55067 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Aug 11 15:04:09 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.67@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 15:04:09 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.67@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 15:04:09.543524 30791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:09.537903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42757 (local address 127.19.236.67:33493)
0811 15:04:09.538213 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0811 15:04:09.538228 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 15:04:09.538330 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:04:09.538598 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:04:09.538601 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:04:09.538791 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:04:09.538889 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:09.538894 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:09.539696 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:09.539698 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:09.540250 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:09.540257 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:09.540773 (+ 516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:09.540776 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:09.540838 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:09.541376 (+ 538us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:04:09.541389 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:04:09.543388 (+ 1999us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.236.126:42757: Server oryx/127.19.236.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":121,"threads_started":1}
W20260811 15:04:09.543656 30789 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:04:09.537997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.67:33493 (local address 127.19.236.126:42757)
0811 15:04:09.538177 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0811 15:04:09.538181 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:04:09.538303 (+ 122us) server_negotiation.cc:407] Connection header received
0811 15:04:09.538418 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:04:09.538421 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:04:09.538480 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:04:09.538563 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:04:09.539009 (+ 446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:09.539596 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:09.540373 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:09.540670 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:09.540761 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:09.543533 (+ 2772us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.236.67:33493: BlockingRecv error: recv got EOF from 127.19.236.67:33493 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
Aug 11 15:04:10 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.65@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 15:04:10 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.65@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 15:04:10.164696 30793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:10.158850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42757 (local address 127.19.236.65:47871)
0811 15:04:10.159211 (+ 361us) negotiation.cc:107] Waiting for socket to connect
0811 15:04:10.159228 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 15:04:10.159346 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:04:10.159673 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:04:10.159676 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:04:10.159986 (+ 310us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:04:10.160110 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:10.160117 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:10.160945 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:10.160949 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:10.161511 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:10.161519 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:10.161986 (+ 467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:10.161989 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:10.162059 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:10.162597 (+ 538us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:04:10.162609 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:04:10.164518 (+ 1909us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.236.126:42757: Server oryx/127.19.236.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":275,"thread_start_us":80,"threads_started":1}
W20260811 15:04:10.164966 30792 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:04:10.158897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.65:47871 (local address 127.19.236.126:42757)
0811 15:04:10.159230 (+ 333us) server_negotiation.cc:206] Beginning negotiation
0811 15:04:10.159237 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 15:04:10.159315 (+ 78us) server_negotiation.cc:407] Connection header received
0811 15:04:10.159454 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:04:10.159457 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:04:10.159518 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:04:10.159629 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:04:10.160228 (+ 599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:10.160805 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:10.161632 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:10.161857 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:10.161942 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:10.164725 (+ 2783us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.236.65:47871: BlockingRecv error: recv got EOF from 127.19.236.65:47871 (error 108)
Metrics: {"server-negotiator.queue_time_us":227,"thread_start_us":96,"threads_started":1}
Aug 11 15:04:10 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.66@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 15:04:10 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.66@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 15:04:10.351509 30794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:10.345653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42757 (local address 127.19.236.66:39567)
0811 15:04:10.346029 (+ 376us) negotiation.cc:107] Waiting for socket to connect
0811 15:04:10.346042 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 15:04:10.346178 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:04:10.346492 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:04:10.346495 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:04:10.346767 (+ 272us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:04:10.346867 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:10.346873 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:10.347654 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:10.347659 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:10.348218 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:10.348226 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:10.348769 (+ 543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:10.348773 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:10.348861 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:10.349440 (+ 579us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:04:10.349457 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:04:10.351323 (+ 1866us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.236.126:42757: Server oryx/127.19.236.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":293,"thread_start_us":112,"threads_started":1}
W20260811 15:04:10.351549 30792 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:04:10.345755 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.66:39567 (local address 127.19.236.126:42757)
0811 15:04:10.345911 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0811 15:04:10.345916 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:04:10.346126 (+ 210us) server_negotiation.cc:407] Connection header received
0811 15:04:10.346275 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:04:10.346278 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:04:10.346363 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:04:10.346452 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:04:10.347003 (+ 551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:10.347541 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:10.348342 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:10.348653 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:10.348765 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:10.351448 (+ 2683us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.236.66:39567: BlockingRecv error: recv got EOF from 127.19.236.66:39567 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Aug 11 15:04:10 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.67@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 15:04:10 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.67@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 15:04:10.550953 30795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:10.544503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42757 (local address 127.19.236.67:51089)
0811 15:04:10.544897 (+ 394us) negotiation.cc:107] Waiting for socket to connect
0811 15:04:10.544918 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 15:04:10.545023 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:04:10.545331 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:04:10.545334 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:04:10.545595 (+ 261us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:04:10.545726 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:10.545732 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:10.546758 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:10.546763 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:10.547417 (+ 654us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:10.547426 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:10.547925 (+ 499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:10.547929 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:10.548018 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:10.548610 (+ 592us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:04:10.548625 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:04:10.550783 (+ 2158us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.236.126:42757: Server oryx/127.19.236.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":301,"thread_start_us":113,"threads_started":1}
W20260811 15:04:10.551288 30792 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:04:10.544660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.67:51089 (local address 127.19.236.126:42757)
0811 15:04:10.544806 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0811 15:04:10.544810 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:04:10.544990 (+ 180us) server_negotiation.cc:407] Connection header received
0811 15:04:10.545134 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:04:10.545138 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:04:10.545203 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:04:10.545279 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:04:10.545859 (+ 580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:10.546621 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:10.547559 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:10.547804 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:10.547918 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:10.550968 (+ 3050us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.236.67:51089: BlockingRecv error: recv got EOF from 127.19.236.67:51089 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 11 15:04:11 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.65@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 15:04:11 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.65@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 15:04:11.171170 30796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:11.165473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42757 (local address 127.19.236.65:40661)
0811 15:04:11.165836 (+ 363us) negotiation.cc:107] Waiting for socket to connect
0811 15:04:11.165851 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 15:04:11.165959 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:04:11.166248 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:04:11.166251 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:04:11.166454 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:04:11.166558 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:11.166564 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:11.167331 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:11.167334 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:11.167906 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:11.167915 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:11.168358 (+ 443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:11.168361 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:11.168421 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:11.168960 (+ 539us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:04:11.168972 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:04:11.171046 (+ 2074us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.236.126:42757: Server oryx/127.19.236.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":283,"thread_start_us":86,"threads_started":1}
W20260811 15:04:11.171343 30797 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:04:11.165582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.65:40661 (local address 127.19.236.126:42757)
0811 15:04:11.165837 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0811 15:04:11.165841 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:04:11.165901 (+ 60us) server_negotiation.cc:407] Connection header received
0811 15:04:11.166047 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:04:11.166049 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:04:11.166093 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:04:11.166172 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:04:11.166669 (+ 497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:11.167223 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:11.168029 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:11.168257 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:11.168338 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:11.171205 (+ 2867us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.236.65:40661: BlockingRecv error: recv got EOF from 127.19.236.65:40661 (error 108)
Metrics: {"server-negotiator.queue_time_us":181,"thread_start_us":82,"threads_started":1}
Aug 11 15:04:11 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.66@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 15:04:11 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.66@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 15:04:11.358700 30798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:11.352507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42757 (local address 127.19.236.66:34579)
0811 15:04:11.352905 (+ 398us) negotiation.cc:107] Waiting for socket to connect
0811 15:04:11.352922 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 15:04:11.353060 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:04:11.353345 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:04:11.353348 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:04:11.353603 (+ 255us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:04:11.353726 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:11.353736 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:11.354670 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:11.354674 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:11.355245 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:11.355253 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:11.355803 (+ 550us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:11.355807 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:11.355889 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:11.356456 (+ 567us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:04:11.356469 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:04:11.358578 (+ 2109us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.236.126:42757: Server oryx/127.19.236.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":292,"thread_start_us":108,"threads_started":1}
W20260811 15:04:11.358912 30797 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:04:11.352665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.66:34579 (local address 127.19.236.126:42757)
0811 15:04:11.352831 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0811 15:04:11.352838 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 15:04:11.353024 (+ 186us) server_negotiation.cc:407] Connection header received
0811 15:04:11.353172 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:04:11.353176 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:04:11.353232 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:04:11.353321 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:04:11.353858 (+ 537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:11.354550 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:11.355370 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:11.355678 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:11.355787 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:11.358732 (+ 2945us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.236.66:34579: BlockingRecv error: recv got EOF from 127.19.236.66:34579 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 11 15:04:11 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.67@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 15:04:11 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.67@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 15:04:11.558826 30799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:11.551859 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42757 (local address 127.19.236.67:33971)
0811 15:04:11.552181 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0811 15:04:11.552197 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 15:04:11.552307 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:04:11.552629 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:04:11.552632 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:04:11.552832 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:04:11.552961 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:11.552967 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:11.554022 (+ 1055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:11.554026 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:11.554937 (+ 911us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:11.554951 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:11.555780 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:11.555784 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:11.555876 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:11.556542 (+ 666us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:04:11.556583 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:04:11.558705 (+ 2122us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.236.126:42757: Server oryx/127.19.236.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":109,"threads_started":1}
W20260811 15:04:11.559051 30797 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:04:11.551937 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.67:33971 (local address 127.19.236.126:42757)
0811 15:04:11.552099 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0811 15:04:11.552102 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 15:04:11.552273 (+ 171us) server_negotiation.cc:407] Connection header received
0811 15:04:11.552395 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:04:11.552397 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:04:11.552448 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:04:11.552527 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:04:11.553103 (+ 576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:11.553861 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:11.555084 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:11.555494 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:11.555578 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:11.558918 (+ 3340us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.236.67:33971: BlockingRecv error: recv got EOF from 127.19.236.67:33971 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
Aug 11 15:04:12 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.65@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 15:04:12 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.65@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 15:04:12.183529 30800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:12.172224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42757 (local address 127.19.236.65:52225)
0811 15:04:12.172799 (+ 575us) negotiation.cc:107] Waiting for socket to connect
0811 15:04:12.172818 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 15:04:12.172957 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:04:12.173284 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:04:12.173287 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:04:12.173574 (+ 287us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:04:12.173675 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:12.173681 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:12.174435 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:12.174437 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:12.174990 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:12.174997 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:12.175441 (+ 444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:12.175444 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:12.175507 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:12.181380 (+ 5873us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:04:12.181394 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:04:12.183360 (+ 1966us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.236.126:42757: Server oryx/127.19.236.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":444,"thread_start_us":105,"threads_started":1}
W20260811 15:04:12.183709 30802 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:04:12.172376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.65:52225 (local address 127.19.236.126:42757)
0811 15:04:12.172693 (+ 317us) server_negotiation.cc:206] Beginning negotiation
0811 15:04:12.172699 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 15:04:12.172906 (+ 207us) server_negotiation.cc:407] Connection header received
0811 15:04:12.173078 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:04:12.173083 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:04:12.173139 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:04:12.173246 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:04:12.173787 (+ 541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:12.174328 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:12.175098 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:12.175321 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:12.175402 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:12.183530 (+ 8128us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.236.65:52225: BlockingRecv error: recv got EOF from 127.19.236.65:52225 (error 108)
Metrics: {"server-negotiator.queue_time_us":208,"thread_start_us":67,"threads_started":1}
Aug 11 15:04:12 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.66@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 15:04:12 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.66@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 15:04:12.365437 30803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:12.359524 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42757 (local address 127.19.236.66:54529)
0811 15:04:12.359872 (+ 348us) negotiation.cc:107] Waiting for socket to connect
0811 15:04:12.359888 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 15:04:12.360046 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:04:12.360340 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:04:12.360343 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:04:12.360614 (+ 271us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:04:12.360712 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:12.360718 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:12.361506 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:12.361510 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:12.362077 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:12.362085 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:12.362555 (+ 470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:12.362558 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:12.362645 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:12.363224 (+ 579us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:04:12.363236 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:04:12.365242 (+ 2006us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.236.126:42757: Server oryx/127.19.236.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":274,"thread_start_us":100,"threads_started":1}
W20260811 15:04:12.365478 30802 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:04:12.359663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.66:54529 (local address 127.19.236.126:42757)
0811 15:04:12.359858 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0811 15:04:12.359863 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:04:12.360009 (+ 146us) server_negotiation.cc:407] Connection header received
0811 15:04:12.360166 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:04:12.360169 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:04:12.360220 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:04:12.360312 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:04:12.360844 (+ 532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:12.361386 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:12.362203 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:12.362428 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:12.362538 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:12.365374 (+ 2836us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.236.66:54529: BlockingRecv error: recv got EOF from 127.19.236.66:54529 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
Aug 11 15:04:12 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.67@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 15:04:12 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.67@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 15:04:12.566058 30804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:12.559710 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42757 (local address 127.19.236.67:38679)
0811 15:04:12.560168 (+ 458us) negotiation.cc:107] Waiting for socket to connect
0811 15:04:12.560185 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 15:04:12.560335 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:04:12.560711 (+ 376us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:04:12.560713 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:04:12.560899 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:04:12.561006 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:12.561012 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:12.561832 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:12.561836 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:12.562473 (+ 637us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:12.562483 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:12.562908 (+ 425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:12.562918 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:12.562986 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:12.563493 (+ 507us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:04:12.563506 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:04:12.565899 (+ 2393us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.236.126:42757: Server oryx/127.19.236.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":361,"thread_start_us":105,"threads_started":1}
W20260811 15:04:12.566171 30802 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:04:12.559772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.67:38679 (local address 127.19.236.126:42757)
0811 15:04:12.559928 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0811 15:04:12.559933 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:04:12.560300 (+ 367us) server_negotiation.cc:407] Connection header received
0811 15:04:12.560462 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:04:12.560466 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:04:12.560535 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:04:12.560689 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:04:12.561119 (+ 430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:12.561690 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:12.562586 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:12.562802 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:12.562878 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:12.566039 (+ 3161us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.236.67:38679: BlockingRecv error: recv got EOF from 127.19.236.67:38679 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Aug 11 15:04:13 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.65@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 15:04:13 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.65@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 15:04:13.189716 30805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:13.184342 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42757 (local address 127.19.236.65:53035)
0811 15:04:13.184670 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0811 15:04:13.184684 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 15:04:13.184769 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:04:13.185026 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:04:13.185028 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:04:13.185208 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:04:13.185306 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:13.185311 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:13.186074 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:13.186076 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:13.186637 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:13.186645 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:13.187104 (+ 459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:13.187107 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:13.187168 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:13.187701 (+ 533us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:04:13.187712 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:04:13.189593 (+ 1881us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.236.126:42757: Server oryx/127.19.236.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":101,"threads_started":1}
W20260811 15:04:13.189951 30807 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:04:13.184488 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.65:53035 (local address 127.19.236.126:42757)
0811 15:04:13.184776 (+ 288us) server_negotiation.cc:206] Beginning negotiation
0811 15:04:13.184780 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:04:13.184828 (+ 48us) server_negotiation.cc:407] Connection header received
0811 15:04:13.184865 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:04:13.184867 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:04:13.184921 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:04:13.184993 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:04:13.185417 (+ 424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:13.185972 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:13.186760 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:13.187002 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:13.187085 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:13.189780 (+ 2695us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.236.65:53035: BlockingRecv error: recv got EOF from 127.19.236.65:53035 (error 108)
Metrics: {"server-negotiator.queue_time_us":213,"thread_start_us":116,"threads_started":1}
Aug 11 15:04:13 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.66@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 15:04:13 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.66@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 15:04:13.372936 30808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:13.366283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42757 (local address 127.19.236.66:40951)
0811 15:04:13.366589 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0811 15:04:13.366603 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 15:04:13.366700 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:04:13.366918 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:04:13.366920 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:04:13.367114 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:04:13.367215 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:13.367220 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:13.367976 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:13.367982 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:13.368643 (+ 661us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:13.368653 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:13.369255 (+ 602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:13.369262 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:13.369378 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:13.370072 (+ 694us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:04:13.370091 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:04:13.372742 (+ 2651us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.236.126:42757: Server oryx/127.19.236.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":231,"thread_start_us":125,"threads_started":1}
W20260811 15:04:13.372972 30807 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:04:13.366341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.66:40951 (local address 127.19.236.126:42757)
0811 15:04:13.366507 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0811 15:04:13.366512 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:04:13.366680 (+ 168us) server_negotiation.cc:407] Connection header received
0811 15:04:13.366768 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:04:13.366771 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:04:13.366816 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:04:13.366885 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:04:13.367319 (+ 434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:13.367855 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:13.368757 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:13.369100 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:13.369247 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:13.372868 (+ 3621us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.236.66:40951: BlockingRecv error: recv got EOF from 127.19.236.66:40951 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Aug 11 15:04:13 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.67@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 15:04:13 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.67@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 15:04:13.572356 30809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:13.566891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42757 (local address 127.19.236.67:56889)
0811 15:04:13.567219 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0811 15:04:13.567234 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 15:04:13.567338 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:04:13.567585 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:04:13.567587 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:04:13.567771 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:04:13.567870 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:13.567875 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:13.568691 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:13.568694 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:13.569285 (+ 591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:13.569296 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:13.569739 (+ 443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:13.569741 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:13.569806 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:13.570392 (+ 586us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:04:13.570404 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:04:13.572231 (+ 1827us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.236.126:42757: Server oryx/127.19.236.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":145,"threads_started":1}
W20260811 15:04:13.572513 30807 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:04:13.567045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.67:56889 (local address 127.19.236.126:42757)
0811 15:04:13.567206 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0811 15:04:13.567210 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:04:13.567313 (+ 103us) server_negotiation.cc:407] Connection header received
0811 15:04:13.567422 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:04:13.567424 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:04:13.567471 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:04:13.567545 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:04:13.567989 (+ 444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:13.568518 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:13.569403 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:13.569630 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:13.569711 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:13.572387 (+ 2676us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.236.67:56889: BlockingRecv error: recv got EOF from 127.19.236.67:56889 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 11 15:04:14 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.65@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 15:04:14 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.65@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 15:04:14.197218 30810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:14.190676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42757 (local address 127.19.236.65:34331)
0811 15:04:14.191047 (+ 371us) negotiation.cc:107] Waiting for socket to connect
0811 15:04:14.191065 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 15:04:14.191231 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:04:14.191567 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:04:14.191570 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:04:14.191852 (+ 282us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:04:14.192022 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:14.192031 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:14.193071 (+ 1040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:14.193077 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:14.193718 (+ 641us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:14.193727 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:14.194280 (+ 553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:14.194283 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:14.194383 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:14.194908 (+ 525us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:04:14.194921 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:04:14.197094 (+ 2173us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.236.126:42757: Server oryx/127.19.236.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":262,"thread_start_us":136,"threads_started":1}
W20260811 15:04:14.197467 30811 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:04:14.190841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.65:34331 (local address 127.19.236.126:42757)
0811 15:04:14.191083 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0811 15:04:14.191088 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:04:14.191178 (+ 90us) server_negotiation.cc:407] Connection header received
0811 15:04:14.191347 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:04:14.191350 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:04:14.191413 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:04:14.191500 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:04:14.192151 (+ 651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:14.192948 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:14.193879 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:14.194144 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:14.194262 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:14.197284 (+ 3022us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.236.65:34331: BlockingRecv error: recv got EOF from 127.19.236.65:34331 (error 108)
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":62,"threads_started":1}
Aug 11 15:04:14 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.66@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 15:04:14 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.66@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 15:04:14.379531 30812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:14.373997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42757 (local address 127.19.236.66:52489)
0811 15:04:14.374283 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0811 15:04:14.374296 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 15:04:14.374398 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:04:14.374645 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:04:14.374648 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:04:14.374837 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:04:14.374948 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:14.374954 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:14.375683 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:14.375685 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:14.376238 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:14.376245 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:14.376806 (+ 561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:14.376809 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:14.376871 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:14.377365 (+ 494us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:04:14.377377 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:04:14.379377 (+ 2000us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.236.126:42757: Server oryx/127.19.236.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":98,"threads_started":1}
W20260811 15:04:14.379876 30811 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:04:14.374079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.66:52489 (local address 127.19.236.126:42757)
0811 15:04:14.374253 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0811 15:04:14.374257 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:04:14.374367 (+ 110us) server_negotiation.cc:407] Connection header received
0811 15:04:14.374467 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:04:14.374469 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:04:14.374513 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:04:14.374606 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:04:14.375050 (+ 444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:14.375587 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:14.376377 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:14.376696 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:14.376785 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:14.379752 (+ 2967us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.236.66:52489: BlockingRecv error: recv got EOF from 127.19.236.66:52489 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
Aug 11 15:04:14 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.67@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 15:04:14 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.67@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 15:04:14.578934 30813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:14.573297 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42757 (local address 127.19.236.67:44517)
0811 15:04:14.573582 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0811 15:04:14.573600 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 15:04:14.573706 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:04:14.573963 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:04:14.573965 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:04:14.574174 (+ 209us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:04:14.574281 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:14.574297 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:14.575039 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:14.575042 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:14.575613 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:14.575621 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:14.576073 (+ 452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:14.576077 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:14.576152 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:14.576816 (+ 664us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:04:14.576830 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:04:14.578790 (+ 1960us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.236.126:42757: Server oryx/127.19.236.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":116,"threads_started":1}
W20260811 15:04:14.579023 30811 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:04:14.573338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.67:44517 (local address 127.19.236.126:42757)
0811 15:04:14.573505 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0811 15:04:14.573509 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:04:14.573676 (+ 167us) server_negotiation.cc:407] Connection header received
0811 15:04:14.573794 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:04:14.573797 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:04:14.573845 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:04:14.573907 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:04:14.574401 (+ 494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:14.574934 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:14.575719 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:14.575938 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:14.576020 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:14.578926 (+ 2906us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.236.67:44517: BlockingRecv error: recv got EOF from 127.19.236.67:44517 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
Aug 11 15:04:15 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.65@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 15:04:15 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.65@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 15:04:15.203567 30814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:15.197989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42757 (local address 127.19.236.65:56163)
0811 15:04:15.198305 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0811 15:04:15.198319 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 15:04:15.198415 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:04:15.198713 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:04:15.198716 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:04:15.198931 (+ 215us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:04:15.199067 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:15.199073 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:15.199863 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:15.199866 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:15.200418 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:15.200426 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:15.200911 (+ 485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:15.200914 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:15.200983 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:15.201494 (+ 511us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:04:15.201506 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:04:15.203440 (+ 1934us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.236.126:42757: Server oryx/127.19.236.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":96,"threads_started":1}
W20260811 15:04:15.203732 30815 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:04:15.198110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.65:56163 (local address 127.19.236.126:42757)
0811 15:04:15.198358 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0811 15:04:15.198362 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:04:15.198376 (+ 14us) server_negotiation.cc:407] Connection header received
0811 15:04:15.198510 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:04:15.198513 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:04:15.198558 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:04:15.198637 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:04:15.199211 (+ 574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:15.199762 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:15.200543 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:15.200796 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:15.200880 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:15.203592 (+ 2712us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.236.65:56163: BlockingRecv error: recv got EOF from 127.19.236.65:56163 (error 108)
Metrics: {"server-negotiator.queue_time_us":169,"thread_start_us":67,"threads_started":1}
Aug 11 15:04:15 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.66@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 15:04:15 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.66@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 15:04:15.385998 30816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:15.380473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42757 (local address 127.19.236.66:58443)
0811 15:04:15.380794 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0811 15:04:15.380809 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 15:04:15.380914 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:04:15.381137 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:04:15.381139 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:04:15.381328 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:04:15.381448 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:15.381454 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:15.382188 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:15.382190 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:15.382806 (+ 616us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:15.382815 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:15.383229 (+ 414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:15.383232 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:15.383298 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:15.383853 (+ 555us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:04:15.383865 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:04:15.385818 (+ 1953us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.236.126:42757: Server oryx/127.19.236.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":125,"threads_started":1}
W20260811 15:04:15.386075 30815 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:04:15.380627 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.66:58443 (local address 127.19.236.126:42757)
0811 15:04:15.380766 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0811 15:04:15.380770 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:04:15.380880 (+ 110us) server_negotiation.cc:407] Connection header received
0811 15:04:15.380987 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:04:15.380989 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:04:15.381033 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:04:15.381106 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:04:15.381554 (+ 448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:15.382083 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:15.382911 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:15.383127 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:15.383203 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:15.385959 (+ 2756us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.236.66:58443: BlockingRecv error: recv got EOF from 127.19.236.66:58443 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Aug 11 15:04:15 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.67@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 15:04:15 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.67@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 15:04:15.585606 30817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:15.579821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42757 (local address 127.19.236.67:34703)
0811 15:04:15.580153 (+ 332us) negotiation.cc:107] Waiting for socket to connect
0811 15:04:15.580168 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 15:04:15.580313 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:04:15.580626 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:04:15.580629 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:04:15.580848 (+ 219us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:04:15.580943 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:15.580948 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:15.581732 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:15.581738 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:15.582303 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:15.582311 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:15.582800 (+ 489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:15.582803 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:15.582894 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:15.583416 (+ 522us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:04:15.583428 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:04:15.585462 (+ 2034us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.236.126:42757: Server oryx/127.19.236.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":252,"thread_start_us":89,"threads_started":1}
W20260811 15:04:15.585873 30815 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:04:15.579931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.67:34703 (local address 127.19.236.126:42757)
0811 15:04:15.580107 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0811 15:04:15.580112 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:04:15.580254 (+ 142us) server_negotiation.cc:407] Connection header received
0811 15:04:15.580431 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:04:15.580435 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:04:15.580486 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:04:15.580595 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:04:15.581064 (+ 469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:15.581621 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:15.582446 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:15.582687 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:15.582795 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:15.585613 (+ 2818us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.236.67:34703: BlockingRecv error: recv got EOF from 127.19.236.67:34703 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
Aug 11 15:04:16 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.65@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 15:04:16 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.65@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 15:04:16.210397 30819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:16.204543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42757 (local address 127.19.236.65:52423)
0811 15:04:16.204897 (+ 354us) negotiation.cc:107] Waiting for socket to connect
0811 15:04:16.204911 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 15:04:16.205018 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:04:16.205315 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:04:16.205319 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:04:16.205559 (+ 240us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:04:16.205662 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:16.205668 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:16.206615 (+ 947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:16.206620 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:16.207250 (+ 630us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:16.207259 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:16.207714 (+ 455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:16.207717 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:16.207778 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:16.208345 (+ 567us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:04:16.208357 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:04:16.210267 (+ 1910us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.236.126:42757: Server oryx/127.19.236.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":95,"threads_started":1}
W20260811 15:04:16.210637 30820 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:04:16.204650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.65:52423 (local address 127.19.236.126:42757)
0811 15:04:16.204906 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0811 15:04:16.204910 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:04:16.204988 (+ 78us) server_negotiation.cc:407] Connection header received
0811 15:04:16.205104 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:04:16.205107 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:04:16.205153 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:04:16.205238 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:04:16.205782 (+ 544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:16.206492 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:16.207367 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:16.207606 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:16.207689 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:16.210481 (+ 2792us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.236.65:52423: BlockingRecv error: recv got EOF from 127.19.236.65:52423 (error 108)
Metrics: {"server-negotiator.queue_time_us":186,"thread_start_us":96,"threads_started":1}
Aug 11 15:04:16 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.66@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 15:04:16 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.66@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 15:04:16.392716 30821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:16.387033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42757 (local address 127.19.236.66:59869)
0811 15:04:16.387324 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0811 15:04:16.387338 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 15:04:16.387431 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:04:16.387687 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:04:16.387689 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:04:16.387870 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:04:16.387970 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:16.387975 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:16.388788 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:16.388791 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:16.389366 (+ 575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:16.389374 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:16.389789 (+ 415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:16.389792 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:16.389855 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:16.390331 (+ 476us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:04:16.390342 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:04:16.392501 (+ 2159us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.236.126:42757: Server oryx/127.19.236.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":87,"threads_started":1}
W20260811 15:04:16.392817 30820 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:04:16.387207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.66:59869 (local address 127.19.236.126:42757)
0811 15:04:16.387395 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0811 15:04:16.387399 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:04:16.387414 (+ 15us) server_negotiation.cc:407] Connection header received
0811 15:04:16.387526 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:04:16.387528 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:04:16.387575 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:04:16.387644 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:04:16.388075 (+ 431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:16.388682 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:16.389471 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:16.389691 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:16.389766 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:16.392683 (+ 2917us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.236.66:59869: BlockingRecv error: recv got EOF from 127.19.236.66:59869 (error 108)
Metrics: {"server-negotiator.queue_time_us":95}
Aug 11 15:04:16 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.67@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 15:04:16 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.67@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 15:04:16.592346 30822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:16.586459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42757 (local address 127.19.236.67:46855)
0811 15:04:16.586760 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0811 15:04:16.586774 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 15:04:16.586913 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:04:16.587195 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:04:16.587198 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:04:16.587407 (+ 209us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:04:16.587500 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:16.587505 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:16.588320 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:16.588325 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:16.588987 (+ 662us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:16.588997 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:16.589468 (+ 471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:16.589472 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:16.589576 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:16.590113 (+ 537us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:04:16.590125 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:04:16.592152 (+ 2027us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.236.126:42757: Server oryx/127.19.236.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":95,"threads_started":1}
W20260811 15:04:16.592411 30820 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:04:16.586521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.67:46855 (local address 127.19.236.126:42757)
0811 15:04:16.586707 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0811 15:04:16.586713 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 15:04:16.586848 (+ 135us) server_negotiation.cc:407] Connection header received
0811 15:04:16.587038 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:04:16.587041 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:04:16.587088 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:04:16.587172 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:04:16.587630 (+ 458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:16.588206 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:16.589113 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:16.589351 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:16.589466 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:16.592281 (+ 2815us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.236.67:46855: BlockingRecv error: recv got EOF from 127.19.236.67:46855 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
Aug 11 15:04:17 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.65@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 15:04:17 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.65@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 15:04:17.220602 30823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:17.211277 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42757 (local address 127.19.236.65:46111)
0811 15:04:17.211598 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0811 15:04:17.211617 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 15:04:17.211726 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:04:17.211988 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:04:17.211990 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:04:17.212178 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:04:17.212274 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:17.212280 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:17.213154 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:17.213157 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:17.213755 (+ 598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:17.213764 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:17.214228 (+ 464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:17.214230 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:17.214294 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:17.217891 (+ 3597us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:04:17.217904 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:04:17.220347 (+ 2443us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.236.126:42757: Server oryx/127.19.236.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":109,"threads_started":1}
W20260811 15:04:17.220750 30824 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:04:17.211341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.65:46111 (local address 127.19.236.126:42757)
0811 15:04:17.211746 (+ 405us) server_negotiation.cc:206] Beginning negotiation
0811 15:04:17.211750 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:04:17.211763 (+ 13us) server_negotiation.cc:407] Connection header received
0811 15:04:17.211812 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:04:17.211814 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:04:17.211857 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:04:17.211951 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:04:17.212408 (+ 457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:17.213022 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:17.213882 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:17.214120 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:17.214203 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:17.220575 (+ 6372us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.236.65:46111: BlockingRecv error: recv got EOF from 127.19.236.65:46111 (error 108)
Metrics: {"server-negotiator.queue_time_us":337,"thread_start_us":117,"threads_started":1}
Aug 11 15:04:17 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.66@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 15:04:17 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.66@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 15:04:17.399646 30825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:17.393647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42757 (local address 127.19.236.66:51863)
0811 15:04:17.393958 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0811 15:04:17.393971 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 15:04:17.394103 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:04:17.394385 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:04:17.394388 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:04:17.394613 (+ 225us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:04:17.394707 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:17.394713 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:17.395607 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:17.395750 (+ 143us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:17.396412 (+ 662us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:17.396422 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:17.397002 (+ 580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:17.397005 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:17.397094 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:17.397574 (+ 480us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:04:17.397586 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:04:17.399446 (+ 1860us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.236.126:42757: Server oryx/127.19.236.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":95,"threads_started":1}
W20260811 15:04:17.399683 30824 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:04:17.393725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.66:51863 (local address 127.19.236.126:42757)
0811 15:04:17.393904 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0811 15:04:17.393909 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:04:17.394051 (+ 142us) server_negotiation.cc:407] Connection header received
0811 15:04:17.394212 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:04:17.394216 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:04:17.394270 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:04:17.394356 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:04:17.394830 (+ 474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:17.395465 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:17.396568 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:17.396850 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:17.396990 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:17.399575 (+ 2585us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.236.66:51863: BlockingRecv error: recv got EOF from 127.19.236.66:51863 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
Aug 11 15:04:17 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.67@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 15:04:17 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.67@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 15:04:17.599304 30826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:17.593347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42757 (local address 127.19.236.67:58653)
0811 15:04:17.593720 (+ 373us) negotiation.cc:107] Waiting for socket to connect
0811 15:04:17.593736 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 15:04:17.593861 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:04:17.594155 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:04:17.594158 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:04:17.594397 (+ 239us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:04:17.594500 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:17.594506 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:17.595278 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:17.595282 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:17.595945 (+ 663us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:17.595956 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:17.596405 (+ 449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:17.596408 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:17.596476 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:17.597156 (+ 680us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:04:17.597179 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:04:17.599112 (+ 1933us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.236.126:42757: Server oryx/127.19.236.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":288,"thread_start_us":132,"threads_started":1}
W20260811 15:04:17.599351 30824 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:04:17.593390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.67:58653 (local address 127.19.236.126:42757)
0811 15:04:17.593558 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0811 15:04:17.593564 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 15:04:17.593839 (+ 275us) server_negotiation.cc:407] Connection header received
0811 15:04:17.593950 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:04:17.593954 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:04:17.594022 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:04:17.594101 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:04:17.594608 (+ 507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:17.595141 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:17.596061 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:17.596276 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:17.596351 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:17.599240 (+ 2889us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.236.67:58653: BlockingRecv error: recv got EOF from 127.19.236.67:58653 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Aug 11 15:04:18 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.65@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 15:04:18 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.65@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 15:04:18.227336 30827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:18.221702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42757 (local address 127.19.236.65:50525)
0811 15:04:18.221995 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0811 15:04:18.222016 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 15:04:18.222115 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:04:18.222343 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:04:18.222346 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:04:18.222535 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:04:18.222632 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:18.222637 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:18.223385 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:18.223388 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:18.223952 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:18.223960 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:18.224371 (+ 411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:18.224373 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:18.224436 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:18.225025 (+ 589us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:04:18.225036 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:04:18.227146 (+ 2110us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.236.126:42757: Server oryx/127.19.236.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":78,"threads_started":1}
W20260811 15:04:18.227411 30828 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:04:18.221827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.65:50525 (local address 127.19.236.126:42757)
0811 15:04:18.222117 (+ 290us) server_negotiation.cc:206] Beginning negotiation
0811 15:04:18.222121 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:04:18.222136 (+ 15us) server_negotiation.cc:407] Connection header received
0811 15:04:18.222178 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:04:18.222180 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:04:18.222224 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:04:18.222307 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:04:18.222738 (+ 431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:18.223278 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:18.224055 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:18.224273 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:18.224349 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:18.227278 (+ 2929us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.236.65:50525: BlockingRecv error: recv got EOF from 127.19.236.65:50525 (error 108)
Metrics: {"server-negotiator.queue_time_us":212,"thread_start_us":79,"threads_started":1}
Aug 11 15:04:18 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.66@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 15:04:18 dist-test-slave-8n49 krb5kdc[29663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.236.66@KRBTEST.COM for oryx/127.19.236.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 15:04:18.406236 30829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:18.400747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42757 (local address 127.19.236.66:59141)
0811 15:04:18.401011 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0811 15:04:18.401026 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 15:04:18.401122 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:04:18.401372 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:04:18.401375 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:04:18.401559 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:04:18.401668 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:18.401673 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:18.402386 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:18.402389 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:18.402969 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:18.402977 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:18.403385 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:18.403388 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:18.403449 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:18.404021 (+ 572us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:04:18.404033 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:04:18.406102 (+ 2069us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.236.126:42757: Server oryx/127.19.236.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":70,"threads_started":1}
W20260811 15:04:18.406361 30828 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:04:18.400864 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.66:59141 (local address 127.19.236.126:42757)
0811 15:04:18.401044 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0811 15:04:18.401048 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:04:18.401079 (+ 31us) server_negotiation.cc:407] Connection header received
0811 15:04:18.401214 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:04:18.401217 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:04:18.401261 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:04:18.401331 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:04:18.401770 (+ 439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:18.402293 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:18.403074 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:18.403286 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:18.403360 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:18.406239 (+ 2879us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.236.66:59141: BlockingRecv error: recv got EOF from 127.19.236.66:59141 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
I20260811 15:04:18.486820 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 30306
I20260811 15:04:18.495846 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 30470
I20260811 15:04:18.503899 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 30614
I20260811 15:04:18.511720 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 30228
2026-08-11T15:04:18Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (18161 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-11T15:04:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T15:04:18Z Disabled control of system clock
I20260811 15:04:18.545534 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460596631409-20401-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460596631409-20401-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460596631409-20401-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:37431
--webserver_interface=127.19.236.126
--webserver_port=0
--builtin_ntp_servers=127.19.236.84:44747
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.236.126:37431
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260811 15:04:18.661672 30833 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:04:18.661938 30833 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:04:18.661973 30833 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:04:18.665974 30833 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:04:18.666033 30833 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:04:18.666049 30833 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:04:18.666067 30833 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:04:18.666082 30833 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:04:18.671104 30833 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:44747
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460596631409-20401-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460596631409-20401-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.236.126:37431
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:37431
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.236.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30833
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460596631409-20401-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:04:18.672236 30833 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:04:18.673806 30833 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:04:18.682852 30840 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:04:18.682950 30833 server_base.cc:1034] running on GCE node
W20260811 15:04:18.682886 30843 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:04:18.682940 30839 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:04:18.683773 30833 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:04:18.684968 30833 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:04:18.686180 30833 hybrid_clock.cc:648] HybridClock initialized: now 1786460658686146 us; error 43 us; skew 500 ppm
I20260811 15:04:18.688225 30833 webserver.cc:460] Webserver started at http://127.19.236.126:37265/ using document root <none> and password file <none>
I20260811 15:04:18.688934 30833 fs_manager.cc:359] Metadata directory not provided
I20260811 15:04:18.689035 30833 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:04:18.689291 30833 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:04:18.691555 30833 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460596631409-20401-0/minicluster-data/master-0/data/instance:
uuid: "d7894f59727845189dbf3b5bb96c8050"
format_stamp: "Formatted at 2026-08-11 15:04:18 on dist-test-slave-8n49"
server_key: "7895c3c90db9430708d0b382282fa4b5"
server_key_iv: "fcbeffecf8bf63d602de403341e66ed6"
server_key_version: "encryptionkey@0"
I20260811 15:04:18.692142 30833 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460596631409-20401-0/minicluster-data/master-0/wal/instance:
uuid: "d7894f59727845189dbf3b5bb96c8050"
format_stamp: "Formatted at 2026-08-11 15:04:18 on dist-test-slave-8n49"
server_key: "7895c3c90db9430708d0b382282fa4b5"
server_key_iv: "fcbeffecf8bf63d602de403341e66ed6"
server_key_version: "encryptionkey@0"
I20260811 15:04:18.695938 30833 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260811 15:04:18.698446 30850 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:04:18.699676 30833 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 15:04:18.699826 30833 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460596631409-20401-0/minicluster-data/master-0/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460596631409-20401-0/minicluster-data/master-0/wal
uuid: "d7894f59727845189dbf3b5bb96c8050"
format_stamp: "Formatted at 2026-08-11 15:04:18 on dist-test-slave-8n49"
server_key: "7895c3c90db9430708d0b382282fa4b5"
server_key_iv: "fcbeffecf8bf63d602de403341e66ed6"
server_key_version: "encryptionkey@0"
I20260811 15:04:18.699950 30833 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460596631409-20401-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460596631409-20401-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460596631409-20401-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:04:18.712970 30833 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:04:18.713658 30833 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:04:18.713864 30833 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:04:18.721045 30833 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.126:37431
I20260811 15:04:18.721053 30910 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.126:37431 every 8 connection(s)
I20260811 15:04:18.722066 30833 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
I20260811 15:04:18.725412 30911 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:04:18.730991 30911 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d7894f59727845189dbf3b5bb96c8050: Bootstrap starting.
I20260811 15:04:18.731707 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 30833
I20260811 15:04:18.731853 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460596631409-20401-0/minicluster-data/master-0/wal/instance
I20260811 15:04:18.732151 20401 external_mini_cluster.cc:1428] Setting key 52bfe9e32793692d22fa99a802058e9f
I20260811 15:04:18.733908 30911 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d7894f59727845189dbf3b5bb96c8050: Neither blocks nor log segments found. Creating new log.
I20260811 15:04:18.734694 30911 log.cc:824] T 00000000000000000000000000000000 P d7894f59727845189dbf3b5bb96c8050: Log is configured to *not* fsync() on all Append() calls
I20260811 15:04:18.736730 30911 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d7894f59727845189dbf3b5bb96c8050: No bootstrap required, opened a new log
I20260811 15:04:18.740166 30911 raft_consensus.cc:348] T 00000000000000000000000000000000 P d7894f59727845189dbf3b5bb96c8050 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7894f59727845189dbf3b5bb96c8050" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 37431 } }
I20260811 15:04:18.740419 30911 raft_consensus.cc:374] T 00000000000000000000000000000000 P d7894f59727845189dbf3b5bb96c8050 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:04:18.740495 30911 raft_consensus.cc:729] T 00000000000000000000000000000000 P d7894f59727845189dbf3b5bb96c8050 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7894f59727845189dbf3b5bb96c8050, State: Initialized, Role: FOLLOWER
I20260811 15:04:18.740996 30911 consensus_queue.cc:260] T 00000000000000000000000000000000 P d7894f59727845189dbf3b5bb96c8050 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7894f59727845189dbf3b5bb96c8050" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 37431 } }
I20260811 15:04:18.741163 30911 raft_consensus.cc:388] T 00000000000000000000000000000000 P d7894f59727845189dbf3b5bb96c8050 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 15:04:18.741261 30911 raft_consensus.cc:482] T 00000000000000000000000000000000 P d7894f59727845189dbf3b5bb96c8050 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 15:04:18.741394 30911 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d7894f59727845189dbf3b5bb96c8050 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:04:18.741677 30914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:18.733322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55416 (local address 127.19.236.126:37431)
0811 15:04:18.734028 (+ 706us) server_negotiation.cc:206] Beginning negotiation
0811 15:04:18.734049 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0811 15:04:18.734087 (+ 38us) server_negotiation.cc:407] Connection header received
0811 15:04:18.734727 (+ 640us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:04:18.734744 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:04:18.735295 (+ 551us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:04:18.735695 (+ 400us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:04:18.736129 (+ 434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:18.737266 (+ 1137us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:18.738180 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:18.738664 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:18.738836 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:18.739727 (+ 891us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:04:18.739732 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:04:18.739745 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:04:18.740136 (+ 391us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:04:18.740190 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:04:18.740210 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:04:18.740321 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0811 15:04:18.740458 (+ 137us) server_negotiation.cc:299] Negotiation successful
0811 15:04:18.740779 (+ 321us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":313,"thread_start_us":140,"threads_started":1}
I20260811 15:04:18.742403 30911 raft_consensus.cc:504] T 00000000000000000000000000000000 P d7894f59727845189dbf3b5bb96c8050 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7894f59727845189dbf3b5bb96c8050" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 37431 } }
I20260811 15:04:18.742775 30911 leader_election.cc:302] T 00000000000000000000000000000000 P d7894f59727845189dbf3b5bb96c8050 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d7894f59727845189dbf3b5bb96c8050; no voters:
I20260811 15:04:18.743126 30911 leader_election.cc:288] T 00000000000000000000000000000000 P d7894f59727845189dbf3b5bb96c8050 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 15:04:18.743229 30916 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d7894f59727845189dbf3b5bb96c8050 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:04:18.743526 30916 raft_consensus.cc:686] T 00000000000000000000000000000000 P d7894f59727845189dbf3b5bb96c8050 [term 1 LEADER]: Becoming Leader. State: Replica: d7894f59727845189dbf3b5bb96c8050, State: Running, Role: LEADER
I20260811 15:04:18.743880 30916 consensus_queue.cc:237] T 00000000000000000000000000000000 P d7894f59727845189dbf3b5bb96c8050 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7894f59727845189dbf3b5bb96c8050" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 37431 } }
I20260811 15:04:18.744407 30911 sys_catalog.cc:564] T 00000000000000000000000000000000 P d7894f59727845189dbf3b5bb96c8050 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:04:18.745604 30918 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7894f59727845189dbf3b5bb96c8050 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d7894f59727845189dbf3b5bb96c8050. Latest consensus state: current_term: 1 leader_uuid: "d7894f59727845189dbf3b5bb96c8050" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7894f59727845189dbf3b5bb96c8050" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 37431 } } }
I20260811 15:04:18.745735 30918 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7894f59727845189dbf3b5bb96c8050 [sys.catalog]: This master's current role is: LEADER
I20260811 15:04:18.746021 30917 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7894f59727845189dbf3b5bb96c8050 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d7894f59727845189dbf3b5bb96c8050" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7894f59727845189dbf3b5bb96c8050" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 37431 } } }
I20260811 15:04:18.746109 30917 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7894f59727845189dbf3b5bb96c8050 [sys.catalog]: This master's current role is: LEADER
I20260811 15:04:18.746138 30926 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:04:18.749389 30926 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:04:18.755165 30926 catalog_manager.cc:1347] Generated new cluster ID: 00e07b5b0048481db26b52cf986cb681
I20260811 15:04:18.755244 30926 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:04:18.782968 30926 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 15:04:18.783968 30926 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:04:18.789724 30926 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d7894f59727845189dbf3b5bb96c8050: Generated new TSK 0
I20260811 15:04:18.790401 30926 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 15:04:18.799233 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.65:0
--local_ip_for_outbound_sockets=127.19.236.65
--webserver_interface=127.19.236.65
--webserver_port=0
--tserver_master_addrs=127.19.236.126:37431
--builtin_ntp_servers=127.19.236.84:44747
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260811 15:04:18.922938 30937 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:04:18.923210 30937 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:04:18.923249 30937 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:04:18.927433 30937 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:04:18.927488 30937 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:04:18.927572 30937 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.65
I20260811 15:04:18.932296 30937 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:44747
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.65:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.236.65
--webserver_port=0
--tserver_master_addrs=127.19.236.126:37431
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30937
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.65
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:04:18.933477 30937 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:04:18.934914 30937 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:04:18.944774 30947 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:04:18.944754 30943 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:04:18.944749 30945 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:04:18.944831 30937 server_base.cc:1034] running on GCE node
I20260811 15:04:18.945537 30937 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:04:18.946262 30937 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:04:18.947453 30937 hybrid_clock.cc:648] HybridClock initialized: now 1786460658947422 us; error 44 us; skew 500 ppm
I20260811 15:04:18.949353 30937 webserver.cc:460] Webserver started at http://127.19.236.65:42243/ using document root <none> and password file <none>
I20260811 15:04:18.949961 30937 fs_manager.cc:359] Metadata directory not provided
I20260811 15:04:18.950058 30937 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:04:18.950312 30937 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:04:18.952451 30937 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-0/data/instance:
uuid: "886bea961c984596ac5d7365817f4c60"
format_stamp: "Formatted at 2026-08-11 15:04:18 on dist-test-slave-8n49"
server_key: "7a92cda70650c65ee5f016c101612790"
server_key_iv: "74d48f9dd81cb91baf26e9414abb4d91"
server_key_version: "encryptionkey@0"
I20260811 15:04:18.953115 30937 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-0/wal/instance:
uuid: "886bea961c984596ac5d7365817f4c60"
format_stamp: "Formatted at 2026-08-11 15:04:18 on dist-test-slave-8n49"
server_key: "7a92cda70650c65ee5f016c101612790"
server_key_iv: "74d48f9dd81cb91baf26e9414abb4d91"
server_key_version: "encryptionkey@0"
I20260811 15:04:18.956941 30937 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 15:04:18.959666 30954 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:04:18.961051 30937 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 15:04:18.961194 30937 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-0/wal
uuid: "886bea961c984596ac5d7365817f4c60"
format_stamp: "Formatted at 2026-08-11 15:04:18 on dist-test-slave-8n49"
server_key: "7a92cda70650c65ee5f016c101612790"
server_key_iv: "74d48f9dd81cb91baf26e9414abb4d91"
server_key_version: "encryptionkey@0"
I20260811 15:04:18.961323 30937 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:04:18.971333 30937 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:04:18.972013 30937 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:04:18.972218 30937 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:04:18.972901 30937 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:04:18.973867 30937 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:04:18.973945 30937 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:04:18.974018 30937 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:04:18.974062 30937 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:04:18.983289 30937 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.65:39471
I20260811 15:04:18.983367 31078 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.65:39471 every 8 connection(s)
I20260811 15:04:18.984287 30937 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
I20260811 15:04:18.987192 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 30937
I20260811 15:04:18.987319 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-0/wal/instance
I20260811 15:04:18.987686 20401 external_mini_cluster.cc:1428] Setting key 50b8e78d2c7aec74cfda3ceb2b4b0dba
I20260811 15:04:18.989943 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.66:0
--local_ip_for_outbound_sockets=127.19.236.66
--webserver_interface=127.19.236.66
--webserver_port=0
--tserver_master_addrs=127.19.236.126:37431
--builtin_ntp_servers=127.19.236.84:44747
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260811 15:04:18.994903 30914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:18.986257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.65:51479 (local address 127.19.236.126:37431)
0811 15:04:18.986403 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0811 15:04:18.986407 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:04:18.987680 (+ 1273us) server_negotiation.cc:407] Connection header received
0811 15:04:18.989432 (+ 1752us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:04:18.989435 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:04:18.989477 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:04:18.989553 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:04:18.990745 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:18.991275 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:18.992597 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:18.993003 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:18.993131 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:18.994233 (+ 1102us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:04:18.994241 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:04:18.994247 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:04:18.994267 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:04:18.994294 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:04:18.994308 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:04:18.994397 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 15:04:18.994599 (+ 202us) server_negotiation.cc:299] Negotiation successful
0811 15:04:18.994683 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 15:04:18.995669 31081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:18.986658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:37431 (local address 127.19.236.65:51479)
0811 15:04:18.987489 (+ 831us) negotiation.cc:107] Waiting for socket to connect
0811 15:04:18.987553 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0811 15:04:18.989191 (+ 1638us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:04:18.989731 (+ 540us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:04:18.989742 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:04:18.989853 (+ 111us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:04:18.990577 (+ 724us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:18.990599 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:18.991417 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:18.991424 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:18.992426 (+ 1002us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:18.992436 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:18.993164 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:18.993167 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:18.993312 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:18.993961 (+ 649us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 15:04:18.993962 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:04:18.994002 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 15:04:18.994067 (+ 65us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:04:18.994403 (+ 336us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:04:18.994421 (+ 18us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:04:18.994426 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 15:04:18.994573 (+ 147us) client_negotiation.cc:240] Negotiation successful
0811 15:04:18.994807 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":289,"thread_start_us":110,"threads_started":1}
I20260811 15:04:18.996969 31079 heartbeater.cc:347] Connected to a master server at 127.19.236.126:37431
I20260811 15:04:18.997221 31079 heartbeater.cc:464] Registering TS with master...
I20260811 15:04:18.997741 31079 heartbeater.cc:511] Master 127.19.236.126:37431 requested a full tablet report, sending...
I20260811 15:04:18.999264 30871 ts_manager.cc:194] Registered new tserver with Master: 886bea961c984596ac5d7365817f4c60 (127.19.236.65:39471)
I20260811 15:04:19.000422 30871 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.19.236.65:51479
W20260811 15:04:19.109714 31082 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:04:19.110021 31082 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:04:19.110091 31082 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:04:19.114136 31082 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:04:19.114228 31082 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:04:19.114315 31082 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.66
I20260811 15:04:19.119251 31082 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:44747
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.66:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.236.66
--webserver_port=0
--tserver_master_addrs=127.19.236.126:37431
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31082
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.66
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:04:19.120389 31082 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:04:19.121837 31082 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:04:19.131656 31092 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:04:19.131656 31088 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:04:19.131673 31089 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:04:19.131862 31082 server_base.cc:1034] running on GCE node
I20260811 15:04:19.132346 31082 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:04:19.133096 31082 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:04:19.134263 31082 hybrid_clock.cc:648] HybridClock initialized: now 1786460659134243 us; error 31 us; skew 500 ppm
I20260811 15:04:19.136150 31082 webserver.cc:460] Webserver started at http://127.19.236.66:36603/ using document root <none> and password file <none>
I20260811 15:04:19.136848 31082 fs_manager.cc:359] Metadata directory not provided
I20260811 15:04:19.136919 31082 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:04:19.137145 31082 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:04:19.139292 31082 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-1/data/instance:
uuid: "c5d286c27b2040f1829c9aa4e7c63c19"
format_stamp: "Formatted at 2026-08-11 15:04:19 on dist-test-slave-8n49"
server_key: "5e346449e88c0d4b531fd38feb271772"
server_key_iv: "70cd1aea31cd2b7d41e4906ea6a2ff5b"
server_key_version: "encryptionkey@0"
I20260811 15:04:19.139879 31082 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-1/wal/instance:
uuid: "c5d286c27b2040f1829c9aa4e7c63c19"
format_stamp: "Formatted at 2026-08-11 15:04:19 on dist-test-slave-8n49"
server_key: "5e346449e88c0d4b531fd38feb271772"
server_key_iv: "70cd1aea31cd2b7d41e4906ea6a2ff5b"
server_key_version: "encryptionkey@0"
I20260811 15:04:19.143653 31082 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260811 15:04:19.146476 31100 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:04:19.147773 31082 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260811 15:04:19.147871 31082 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-1/wal
uuid: "c5d286c27b2040f1829c9aa4e7c63c19"
format_stamp: "Formatted at 2026-08-11 15:04:19 on dist-test-slave-8n49"
server_key: "5e346449e88c0d4b531fd38feb271772"
server_key_iv: "70cd1aea31cd2b7d41e4906ea6a2ff5b"
server_key_version: "encryptionkey@0"
I20260811 15:04:19.147971 31082 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:04:19.160894 31082 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:04:19.161520 31082 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:04:19.161680 31082 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:04:19.162209 31082 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:04:19.163112 31082 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:04:19.163161 31082 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:04:19.163200 31082 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:04:19.163223 31082 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:04:19.172196 31082 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.66:39555
I20260811 15:04:19.172223 31225 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.66:39555 every 8 connection(s)
I20260811 15:04:19.173189 31082 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
I20260811 15:04:19.177712 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 31082
I20260811 15:04:19.177845 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-1/wal/instance
I20260811 15:04:19.178234 20401 external_mini_cluster.cc:1428] Setting key 741e4e63c2a627617935f9a5c10d3d58
I20260811 15:04:19.180495 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.67:0
--local_ip_for_outbound_sockets=127.19.236.67
--webserver_interface=127.19.236.67
--webserver_port=0
--tserver_master_addrs=127.19.236.126:37431
--builtin_ntp_servers=127.19.236.84:44747
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260811 15:04:19.183955 30914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:19.175117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.66:50215 (local address 127.19.236.126:37431)
0811 15:04:19.175305 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0811 15:04:19.175310 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:04:19.176332 (+ 1022us) server_negotiation.cc:407] Connection header received
0811 15:04:19.177953 (+ 1621us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:04:19.177959 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:04:19.178019 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:04:19.178100 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:04:19.179249 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:19.179993 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:19.181834 (+ 1841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:19.182057 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:19.182142 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:19.183420 (+ 1278us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:04:19.183424 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:04:19.183429 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:04:19.183446 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:04:19.183472 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:04:19.183486 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:04:19.183571 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0811 15:04:19.183738 (+ 167us) server_negotiation.cc:299] Negotiation successful
0811 15:04:19.183807 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260811 15:04:19.184953 31228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:19.175484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:37431 (local address 127.19.236.66:50215)
0811 15:04:19.176169 (+ 685us) negotiation.cc:107] Waiting for socket to connect
0811 15:04:19.176211 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 15:04:19.177667 (+ 1456us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:04:19.178314 (+ 647us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:04:19.178324 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:04:19.178444 (+ 120us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:04:19.179095 (+ 651us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:19.179112 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:19.180148 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:19.180152 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:19.181673 (+ 1521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:19.181688 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:19.182224 (+ 536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:19.182231 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:19.182451 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:19.183118 (+ 667us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 15:04:19.183120 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:04:19.183159 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 15:04:19.183222 (+ 63us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:04:19.183579 (+ 357us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:04:19.183586 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:04:19.183597 (+ 11us) client_negotiation.cc:769] Sending connection context
0811 15:04:19.183729 (+ 132us) client_negotiation.cc:240] Negotiation successful
0811 15:04:19.184008 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":280,"thread_start_us":118,"threads_started":1}
I20260811 15:04:19.186151 31226 heartbeater.cc:347] Connected to a master server at 127.19.236.126:37431
I20260811 15:04:19.186410 31226 heartbeater.cc:464] Registering TS with master...
I20260811 15:04:19.186934 31226 heartbeater.cc:511] Master 127.19.236.126:37431 requested a full tablet report, sending...
I20260811 15:04:19.188073 30871 ts_manager.cc:194] Registered new tserver with Master: c5d286c27b2040f1829c9aa4e7c63c19 (127.19.236.66:39555)
I20260811 15:04:19.189024 30871 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.19.236.66:50215
W20260811 15:04:19.296340 31229 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:04:19.296614 31229 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:04:19.296653 31229 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:04:19.300540 31229 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:04:19.300604 31229 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:04:19.300655 31229 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.67
I20260811 15:04:19.305511 31229 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:44747
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.67:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.236.67
--webserver_port=0
--tserver_master_addrs=127.19.236.126:37431
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31229
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.67
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:04:19.306813 31229 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:04:19.308193 31229 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:04:19.318604 31236 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:04:19.318624 31239 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:04:19.318802 31229 server_base.cc:1034] running on GCE node
W20260811 15:04:19.318610 31237 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:04:19.319216 31229 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:04:19.319912 31229 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:04:19.321107 31229 hybrid_clock.cc:648] HybridClock initialized: now 1786460659321093 us; error 27 us; skew 500 ppm
I20260811 15:04:19.323037 31229 webserver.cc:460] Webserver started at http://127.19.236.67:38599/ using document root <none> and password file <none>
I20260811 15:04:19.323648 31229 fs_manager.cc:359] Metadata directory not provided
I20260811 15:04:19.323745 31229 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:04:19.323998 31229 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:04:19.326152 31229 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-2/data/instance:
uuid: "3fb3ca2fc310442f915a64a39b4efee4"
format_stamp: "Formatted at 2026-08-11 15:04:19 on dist-test-slave-8n49"
server_key: "7dea2f4ebab91d96ebf4f3142c42c116"
server_key_iv: "d520fb409c855cf8f6aa05b79d0ad101"
server_key_version: "encryptionkey@0"
I20260811 15:04:19.326726 31229 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-2/wal/instance:
uuid: "3fb3ca2fc310442f915a64a39b4efee4"
format_stamp: "Formatted at 2026-08-11 15:04:19 on dist-test-slave-8n49"
server_key: "7dea2f4ebab91d96ebf4f3142c42c116"
server_key_iv: "d520fb409c855cf8f6aa05b79d0ad101"
server_key_version: "encryptionkey@0"
I20260811 15:04:19.330415 31229 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20260811 15:04:19.333029 31245 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:04:19.334249 31229 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 15:04:19.334384 31229 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-2/wal
uuid: "3fb3ca2fc310442f915a64a39b4efee4"
format_stamp: "Formatted at 2026-08-11 15:04:19 on dist-test-slave-8n49"
server_key: "7dea2f4ebab91d96ebf4f3142c42c116"
server_key_iv: "d520fb409c855cf8f6aa05b79d0ad101"
server_key_version: "encryptionkey@0"
I20260811 15:04:19.334504 31229 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:04:19.345988 31229 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:04:19.346691 31229 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:04:19.346838 31229 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:04:19.347354 31229 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:04:19.348253 31229 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:04:19.348302 31229 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:04:19.348342 31229 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:04:19.348357 31229 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:04:19.357340 31229 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.67:38881
I20260811 15:04:19.357370 31369 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.67:38881 every 8 connection(s)
I20260811 15:04:19.358259 31229 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
I20260811 15:04:19.367300 30914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:19.360162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.67:51313 (local address 127.19.236.126:37431)
0811 15:04:19.360437 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0811 15:04:19.360441 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:04:19.361429 (+ 988us) server_negotiation.cc:407] Connection header received
0811 15:04:19.362781 (+ 1352us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:04:19.362784 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:04:19.362831 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:04:19.362908 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:04:19.363757 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:19.364316 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:19.365540 (+ 1224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:19.365756 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:19.365838 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:19.366872 (+ 1034us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:04:19.366875 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:04:19.366877 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:04:19.366890 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:04:19.366908 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:04:19.366916 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:04:19.366982 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 15:04:19.367124 (+ 142us) server_negotiation.cc:299] Negotiation successful
0811 15:04:19.367177 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162}
I20260811 15:04:19.368146 31372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:19.360543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:37431 (local address 127.19.236.67:51313)
0811 15:04:19.361271 (+ 728us) negotiation.cc:107] Waiting for socket to connect
0811 15:04:19.361311 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 15:04:19.362594 (+ 1283us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:04:19.363074 (+ 480us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:04:19.363081 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:04:19.363162 (+ 81us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:04:19.363627 (+ 465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:19.363639 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:19.364435 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:19.364438 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:19.365432 (+ 994us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:19.365442 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:19.365887 (+ 445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:19.365890 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:19.366040 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:19.366619 (+ 579us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 15:04:19.366620 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:04:19.366660 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 15:04:19.366724 (+ 64us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:04:19.366995 (+ 271us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:04:19.367002 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:04:19.367006 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 15:04:19.367099 (+ 93us) client_negotiation.cc:240] Negotiation successful
0811 15:04:19.367309 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":278,"thread_start_us":116,"threads_started":1}
I20260811 15:04:19.368484 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 31229
I20260811 15:04:19.368613 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-2/wal/instance
I20260811 15:04:19.368979 20401 external_mini_cluster.cc:1428] Setting key 57c00564909337bcc1ded93e0668eb3c
I20260811 15:04:19.369973 31370 heartbeater.cc:347] Connected to a master server at 127.19.236.126:37431
I20260811 15:04:19.370247 31370 heartbeater.cc:464] Registering TS with master...
I20260811 15:04:19.370904 31370 heartbeater.cc:511] Master 127.19.236.126:37431 requested a full tablet report, sending...
I20260811 15:04:19.372009 30871 ts_manager.cc:194] Registered new tserver with Master: 3fb3ca2fc310442f915a64a39b4efee4 (127.19.236.67:38881)
I20260811 15:04:19.372659 30871 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.19.236.67:51313
I20260811 15:04:19.383587 20401 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260811 15:04:19.386576 30914 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:04:19.385636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55430 (local address 127.19.236.126:37431)
0811 15:04:19.385769 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0811 15:04:19.385773 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:04:19.385972 (+ 199us) server_negotiation.cc:407] Connection header received
0811 15:04:19.386066 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:04:19.386068 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:04:19.386116 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:04:19.386184 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:04:19.386429 (+ 245us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55430: BlockingRecv error: recv got EOF from 127.0.0.1:55430 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 15:04:19.386782 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 30937
I20260811 15:04:19.395288 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 31082
I20260811 15:04:19.404433 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 31229
I20260811 15:04:19.413537 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 30833
2026-08-11T15:04:19Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (901 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-11T15:04:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T15:04:19Z Disabled control of system clock
I20260811 15:04:19.447270 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460596631409-20401-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460596631409-20401-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460596631409-20401-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:34703
--webserver_interface=127.19.236.126
--webserver_port=0
--builtin_ntp_servers=127.19.236.84:35741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.236.126:34703
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260811 15:04:19.563043 31381 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:04:19.563323 31381 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:04:19.563364 31381 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:04:19.567433 31381 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:04:19.567500 31381 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:04:19.567515 31381 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:04:19.567533 31381 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:04:19.567548 31381 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:04:19.572858 31381 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:35741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460596631409-20401-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460596631409-20401-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.236.126:34703
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:34703
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.236.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31381
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460596631409-20401-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:04:19.574050 31381 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:04:19.575516 31381 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:04:19.584580 31387 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:04:19.584601 31389 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:04:19.584720 31386 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:04:19.586004 31381 server_base.cc:1034] running on GCE node
I20260811 15:04:19.586598 31381 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:04:19.587754 31381 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:04:19.588941 31381 hybrid_clock.cc:648] HybridClock initialized: now 1786460659588927 us; error 37 us; skew 500 ppm
I20260811 15:04:19.590893 31381 webserver.cc:460] Webserver started at http://127.19.236.126:37167/ using document root <none> and password file <none>
I20260811 15:04:19.591517 31381 fs_manager.cc:359] Metadata directory not provided
I20260811 15:04:19.591614 31381 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:04:19.591856 31381 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:04:19.594189 31381 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460596631409-20401-0/minicluster-data/master-0/data/instance:
uuid: "d50ffc29f2f440d3bc96258a09b78beb"
format_stamp: "Formatted at 2026-08-11 15:04:19 on dist-test-slave-8n49"
server_key: "4e115ab0a2472d792192aa7d737fe276"
server_key_iv: "416455483146fbbe9c422d85ee98f429"
server_key_version: "encryptionkey@0"
I20260811 15:04:19.594810 31381 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460596631409-20401-0/minicluster-data/master-0/wal/instance:
uuid: "d50ffc29f2f440d3bc96258a09b78beb"
format_stamp: "Formatted at 2026-08-11 15:04:19 on dist-test-slave-8n49"
server_key: "4e115ab0a2472d792192aa7d737fe276"
server_key_iv: "416455483146fbbe9c422d85ee98f429"
server_key_version: "encryptionkey@0"
I20260811 15:04:19.598727 31381 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 15:04:19.601400 31395 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:04:19.602722 31381 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 15:04:19.602890 31381 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460596631409-20401-0/minicluster-data/master-0/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460596631409-20401-0/minicluster-data/master-0/wal
uuid: "d50ffc29f2f440d3bc96258a09b78beb"
format_stamp: "Formatted at 2026-08-11 15:04:19 on dist-test-slave-8n49"
server_key: "4e115ab0a2472d792192aa7d737fe276"
server_key_iv: "416455483146fbbe9c422d85ee98f429"
server_key_version: "encryptionkey@0"
I20260811 15:04:19.603022 31381 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460596631409-20401-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460596631409-20401-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460596631409-20401-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:04:19.607862 31381 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:04:19.608495 31381 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:04:19.608739 31381 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:04:19.616101 31381 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.126:34703
I20260811 15:04:19.616117 31449 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.126:34703 every 8 connection(s)
I20260811 15:04:19.617239 31381 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
I20260811 15:04:19.620890 31450 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:04:19.623868 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 31381
I20260811 15:04:19.624007 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460596631409-20401-0/minicluster-data/master-0/wal/instance
I20260811 15:04:19.624369 20401 external_mini_cluster.cc:1428] Setting key 643b709a886d07530bb880575955c85c
I20260811 15:04:19.627843 31450 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d50ffc29f2f440d3bc96258a09b78beb: Bootstrap starting.
I20260811 15:04:19.630488 31453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:19.626057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38158 (local address 127.19.236.126:34703)
0811 15:04:19.626794 (+ 737us) server_negotiation.cc:206] Beginning negotiation
0811 15:04:19.626810 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 15:04:19.626846 (+ 36us) server_negotiation.cc:407] Connection header received
0811 15:04:19.627546 (+ 700us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:04:19.627564 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:04:19.627956 (+ 392us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:04:19.628340 (+ 384us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:04:19.629225 (+ 885us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:04:19.629230 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:04:19.629241 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:04:19.629252 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:04:19.629307 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:04:19.629323 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:04:19.629468 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0811 15:04:19.629544 (+ 76us) server_negotiation.cc:299] Negotiation successful
0811 15:04:19.629791 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":354,"thread_start_us":151,"threads_started":1}
I20260811 15:04:19.630496 31450 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d50ffc29f2f440d3bc96258a09b78beb: Neither blocks nor log segments found. Creating new log.
I20260811 15:04:19.631394 31450 log.cc:824] T 00000000000000000000000000000000 P d50ffc29f2f440d3bc96258a09b78beb: Log is configured to *not* fsync() on all Append() calls
I20260811 15:04:19.633836 31450 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d50ffc29f2f440d3bc96258a09b78beb: No bootstrap required, opened a new log
I20260811 15:04:19.637923 31450 raft_consensus.cc:348] T 00000000000000000000000000000000 P d50ffc29f2f440d3bc96258a09b78beb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d50ffc29f2f440d3bc96258a09b78beb" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 34703 } }
I20260811 15:04:19.638219 31450 raft_consensus.cc:374] T 00000000000000000000000000000000 P d50ffc29f2f440d3bc96258a09b78beb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:04:19.638321 31450 raft_consensus.cc:729] T 00000000000000000000000000000000 P d50ffc29f2f440d3bc96258a09b78beb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d50ffc29f2f440d3bc96258a09b78beb, State: Initialized, Role: FOLLOWER
I20260811 15:04:19.638870 31450 consensus_queue.cc:260] T 00000000000000000000000000000000 P d50ffc29f2f440d3bc96258a09b78beb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d50ffc29f2f440d3bc96258a09b78beb" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 34703 } }
I20260811 15:04:19.639071 31450 raft_consensus.cc:388] T 00000000000000000000000000000000 P d50ffc29f2f440d3bc96258a09b78beb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 15:04:19.639154 31450 raft_consensus.cc:482] T 00000000000000000000000000000000 P d50ffc29f2f440d3bc96258a09b78beb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 15:04:19.639276 31450 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d50ffc29f2f440d3bc96258a09b78beb [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:04:19.640373 31450 raft_consensus.cc:504] T 00000000000000000000000000000000 P d50ffc29f2f440d3bc96258a09b78beb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d50ffc29f2f440d3bc96258a09b78beb" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 34703 } }
I20260811 15:04:19.640780 31450 leader_election.cc:302] T 00000000000000000000000000000000 P d50ffc29f2f440d3bc96258a09b78beb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d50ffc29f2f440d3bc96258a09b78beb; no voters:
I20260811 15:04:19.641150 31450 leader_election.cc:288] T 00000000000000000000000000000000 P d50ffc29f2f440d3bc96258a09b78beb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 15:04:19.641307 31455 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d50ffc29f2f440d3bc96258a09b78beb [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:04:19.641708 31455 raft_consensus.cc:686] T 00000000000000000000000000000000 P d50ffc29f2f440d3bc96258a09b78beb [term 1 LEADER]: Becoming Leader. State: Replica: d50ffc29f2f440d3bc96258a09b78beb, State: Running, Role: LEADER
I20260811 15:04:19.642036 31455 consensus_queue.cc:237] T 00000000000000000000000000000000 P d50ffc29f2f440d3bc96258a09b78beb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d50ffc29f2f440d3bc96258a09b78beb" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 34703 } }
I20260811 15:04:19.642624 31450 sys_catalog.cc:564] T 00000000000000000000000000000000 P d50ffc29f2f440d3bc96258a09b78beb [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:04:19.643716 31456 sys_catalog.cc:455] T 00000000000000000000000000000000 P d50ffc29f2f440d3bc96258a09b78beb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d50ffc29f2f440d3bc96258a09b78beb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d50ffc29f2f440d3bc96258a09b78beb" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 34703 } } }
I20260811 15:04:19.643855 31456 sys_catalog.cc:458] T 00000000000000000000000000000000 P d50ffc29f2f440d3bc96258a09b78beb [sys.catalog]: This master's current role is: LEADER
I20260811 15:04:19.644186 31457 sys_catalog.cc:455] T 00000000000000000000000000000000 P d50ffc29f2f440d3bc96258a09b78beb [sys.catalog]: SysCatalogTable state changed. Reason: New leader d50ffc29f2f440d3bc96258a09b78beb. Latest consensus state: current_term: 1 leader_uuid: "d50ffc29f2f440d3bc96258a09b78beb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d50ffc29f2f440d3bc96258a09b78beb" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 34703 } } }
I20260811 15:04:19.644294 31457 sys_catalog.cc:458] T 00000000000000000000000000000000 P d50ffc29f2f440d3bc96258a09b78beb [sys.catalog]: This master's current role is: LEADER
I20260811 15:04:19.644433 31465 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:04:19.647426 31465 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:04:19.653730 31465 catalog_manager.cc:1347] Generated new cluster ID: a5e0826441884a9b9af80bcddcb921df
I20260811 15:04:19.653805 31465 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:04:19.675470 31465 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 15:04:19.675845 31465 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:04:19.683200 31465 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d50ffc29f2f440d3bc96258a09b78beb: Generated new TSK 0
I20260811 15:04:19.683946 31465 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 15:04:19.693084 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.65:0
--local_ip_for_outbound_sockets=127.19.236.65
--webserver_interface=127.19.236.65
--webserver_port=0
--tserver_master_addrs=127.19.236.126:34703
--builtin_ntp_servers=127.19.236.84:35741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260811 15:04:19.812690 31477 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:04:19.812961 31477 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:04:19.813001 31477 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:04:19.817229 31477 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:04:19.817291 31477 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:04:19.817369 31477 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.65
I20260811 15:04:19.822307 31477 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:35741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.236.65
--webserver_port=0
--tserver_master_addrs=127.19.236.126:34703
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31477
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.65
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:04:19.823467 31477 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:04:19.824970 31477 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:04:19.834975 31482 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:04:19.834957 31483 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:04:19.835018 31477 server_base.cc:1034] running on GCE node
W20260811 15:04:19.834965 31485 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:04:19.835713 31477 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:04:19.836367 31477 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:04:19.837532 31477 hybrid_clock.cc:648] HybridClock initialized: now 1786460659837521 us; error 28 us; skew 500 ppm
I20260811 15:04:19.839452 31477 webserver.cc:460] Webserver started at http://127.19.236.65:36469/ using document root <none> and password file <none>
I20260811 15:04:19.840078 31477 fs_manager.cc:359] Metadata directory not provided
I20260811 15:04:19.840153 31477 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:04:19.840375 31477 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:04:19.842931 31477 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-0/data/instance:
uuid: "8bc0275058ac49b7b5b03a0cdcbb0bf4"
format_stamp: "Formatted at 2026-08-11 15:04:19 on dist-test-slave-8n49"
server_key: "62652bb28d3d4ab8efe3a3f93be3a9f3"
server_key_iv: "e1ea269fb39858f01e938923ebe0de26"
server_key_version: "encryptionkey@0"
I20260811 15:04:19.843611 31477 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-0/wal/instance:
uuid: "8bc0275058ac49b7b5b03a0cdcbb0bf4"
format_stamp: "Formatted at 2026-08-11 15:04:19 on dist-test-slave-8n49"
server_key: "62652bb28d3d4ab8efe3a3f93be3a9f3"
server_key_iv: "e1ea269fb39858f01e938923ebe0de26"
server_key_version: "encryptionkey@0"
I20260811 15:04:19.847673 31477 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.002s
I20260811 15:04:19.850337 31492 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:04:19.851637 31477 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 15:04:19.851766 31477 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-0/wal
uuid: "8bc0275058ac49b7b5b03a0cdcbb0bf4"
format_stamp: "Formatted at 2026-08-11 15:04:19 on dist-test-slave-8n49"
server_key: "62652bb28d3d4ab8efe3a3f93be3a9f3"
server_key_iv: "e1ea269fb39858f01e938923ebe0de26"
server_key_version: "encryptionkey@0"
I20260811 15:04:19.851886 31477 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:04:19.856658 31477 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:04:19.857287 31477 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:04:19.857477 31477 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:04:19.858029 31477 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:04:19.858969 31477 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:04:19.859017 31477 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:04:19.859088 31477 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:04:19.859119 31477 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:04:19.868433 31477 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.65:37501
I20260811 15:04:19.868465 31617 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.65:37501 every 8 connection(s)
I20260811 15:04:19.869383 31477 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
I20260811 15:04:19.870505 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 31477
I20260811 15:04:19.870645 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-0/wal/instance
I20260811 15:04:19.871011 20401 external_mini_cluster.cc:1428] Setting key 484f0198a7176092c5c989d311c983d9
I20260811 15:04:19.873409 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.66:0
--local_ip_for_outbound_sockets=127.19.236.66
--webserver_interface=127.19.236.66
--webserver_port=0
--tserver_master_addrs=127.19.236.126:34703
--builtin_ntp_servers=127.19.236.84:35741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260811 15:04:19.876742 31453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:19.871386 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.65:56813 (local address 127.19.236.126:34703)
0811 15:04:19.871554 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0811 15:04:19.871560 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 15:04:19.872980 (+ 1420us) server_negotiation.cc:407] Connection header received
0811 15:04:19.874899 (+ 1919us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:04:19.874902 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:04:19.874937 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:04:19.875010 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:04:19.876235 (+ 1225us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:04:19.876238 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:04:19.876241 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:04:19.876254 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:04:19.876276 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:04:19.876291 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:04:19.876394 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0811 15:04:19.876539 (+ 145us) server_negotiation.cc:299] Negotiation successful
0811 15:04:19.876607 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 15:04:19.877907 31620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:19.871889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:34703 (local address 127.19.236.65:56813)
0811 15:04:19.872802 (+ 913us) negotiation.cc:107] Waiting for socket to connect
0811 15:04:19.872859 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0811 15:04:19.874659 (+ 1800us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:04:19.875202 (+ 543us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:04:19.875213 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:04:19.875341 (+ 128us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:04:19.875972 (+ 631us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 15:04:19.875974 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:04:19.876016 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 15:04:19.876084 (+ 68us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:04:19.876373 (+ 289us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:04:19.876383 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:04:19.876389 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 15:04:19.876623 (+ 234us) client_negotiation.cc:240] Negotiation successful
0811 15:04:19.876879 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":329,"thread_start_us":137,"threads_started":1}
I20260811 15:04:19.879206 31618 heartbeater.cc:347] Connected to a master server at 127.19.236.126:34703
I20260811 15:04:19.879443 31618 heartbeater.cc:464] Registering TS with master...
I20260811 15:04:19.879851 31618 heartbeater.cc:511] Master 127.19.236.126:34703 requested a full tablet report, sending...
I20260811 15:04:19.881420 31413 ts_manager.cc:194] Registered new tserver with Master: 8bc0275058ac49b7b5b03a0cdcbb0bf4 (127.19.236.65:37501)
W20260811 15:04:19.992084 31621 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:04:19.992393 31621 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:04:19.992475 31621 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:04:19.996538 31621 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:04:19.996681 31621 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:04:19.996770 31621 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.66
I20260811 15:04:20.001623 31621 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:35741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.236.66
--webserver_port=0
--tserver_master_addrs=127.19.236.126:34703
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31621
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.66
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:04:20.002769 31621 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:04:20.004194 31621 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:04:20.014217 31627 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:04:20.014217 31631 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:04:20.014211 31628 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:04:20.014312 31621 server_base.cc:1034] running on GCE node
I20260811 15:04:20.014926 31621 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:04:20.015638 31621 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:04:20.016799 31621 hybrid_clock.cc:648] HybridClock initialized: now 1786460660016786 us; error 24 us; skew 500 ppm
I20260811 15:04:20.018783 31621 webserver.cc:460] Webserver started at http://127.19.236.66:42241/ using document root <none> and password file <none>
I20260811 15:04:20.019404 31621 fs_manager.cc:359] Metadata directory not provided
I20260811 15:04:20.019469 31621 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:04:20.019690 31621 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:04:20.021850 31621 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-1/data/instance:
uuid: "3aad39338b744be3a39d9dbc1699ec70"
format_stamp: "Formatted at 2026-08-11 15:04:20 on dist-test-slave-8n49"
server_key: "323194854ec5bcf79a1ab16d62742fc5"
server_key_iv: "8bbfaef9c4ef4aac15a31e5738bdb178"
server_key_version: "encryptionkey@0"
I20260811 15:04:20.022436 31621 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-1/wal/instance:
uuid: "3aad39338b744be3a39d9dbc1699ec70"
format_stamp: "Formatted at 2026-08-11 15:04:20 on dist-test-slave-8n49"
server_key: "323194854ec5bcf79a1ab16d62742fc5"
server_key_iv: "8bbfaef9c4ef4aac15a31e5738bdb178"
server_key_version: "encryptionkey@0"
I20260811 15:04:20.026198 31621 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260811 15:04:20.028955 31638 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:04:20.030146 31621 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260811 15:04:20.030267 31621 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-1/wal
uuid: "3aad39338b744be3a39d9dbc1699ec70"
format_stamp: "Formatted at 2026-08-11 15:04:20 on dist-test-slave-8n49"
server_key: "323194854ec5bcf79a1ab16d62742fc5"
server_key_iv: "8bbfaef9c4ef4aac15a31e5738bdb178"
server_key_version: "encryptionkey@0"
I20260811 15:04:20.030383 31621 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:04:20.035014 31621 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:04:20.035642 31621 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:04:20.035832 31621 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:04:20.036384 31621 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:04:20.037408 31621 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:04:20.037458 31621 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:04:20.037528 31621 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:04:20.037566 31621 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:04:20.046798 31621 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.66:39207
I20260811 15:04:20.046818 31762 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.66:39207 every 8 connection(s)
I20260811 15:04:20.047761 31621 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
I20260811 15:04:20.052093 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 31621
I20260811 15:04:20.052237 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-1/wal/instance
I20260811 15:04:20.052631 20401 external_mini_cluster.cc:1428] Setting key 181bbeaf64ef96ddb0309b47485e05ef
I20260811 15:04:20.054706 31453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:20.049720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.66:37541 (local address 127.19.236.126:34703)
0811 15:04:20.049907 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0811 15:04:20.049911 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:04:20.050943 (+ 1032us) server_negotiation.cc:407] Connection header received
0811 15:04:20.052732 (+ 1789us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:04:20.052737 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:04:20.052785 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:04:20.052887 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:04:20.054212 (+ 1325us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:04:20.054216 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:04:20.054218 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:04:20.054231 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:04:20.054254 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:04:20.054263 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:04:20.054362 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0811 15:04:20.054521 (+ 159us) server_negotiation.cc:299] Negotiation successful
0811 15:04:20.054569 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260811 15:04:20.054936 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.67:0
--local_ip_for_outbound_sockets=127.19.236.67
--webserver_interface=127.19.236.67
--webserver_port=0
--tserver_master_addrs=127.19.236.126:34703
--builtin_ntp_servers=127.19.236.84:35741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260811 15:04:20.055709 31766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:20.050096 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:34703 (local address 127.19.236.66:37541)
0811 15:04:20.050786 (+ 690us) negotiation.cc:107] Waiting for socket to connect
0811 15:04:20.050827 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 15:04:20.052398 (+ 1571us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:04:20.053105 (+ 707us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:04:20.053114 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:04:20.053219 (+ 105us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:04:20.053898 (+ 679us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 15:04:20.053899 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:04:20.053977 (+ 78us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 15:04:20.054074 (+ 97us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:04:20.054352 (+ 278us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:04:20.054361 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:04:20.054368 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 15:04:20.054571 (+ 203us) client_negotiation.cc:240] Negotiation successful
0811 15:04:20.054825 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":278,"thread_start_us":117,"threads_started":1}
I20260811 15:04:20.056928 31764 heartbeater.cc:347] Connected to a master server at 127.19.236.126:34703
I20260811 15:04:20.057163 31764 heartbeater.cc:464] Registering TS with master...
I20260811 15:04:20.057597 31764 heartbeater.cc:511] Master 127.19.236.126:34703 requested a full tablet report, sending...
I20260811 15:04:20.058693 31413 ts_manager.cc:194] Registered new tserver with Master: 3aad39338b744be3a39d9dbc1699ec70 (127.19.236.66:39207)
W20260811 15:04:20.171145 31767 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:04:20.171478 31767 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:04:20.171571 31767 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:04:20.175674 31767 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:04:20.175773 31767 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:04:20.175873 31767 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.67
I20260811 15:04:20.180833 31767 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:35741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.236.67
--webserver_port=0
--tserver_master_addrs=127.19.236.126:34703
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31767
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.67
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:04:20.182050 31767 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:04:20.183521 31767 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:04:20.193632 31772 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:04:20.193645 31773 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:04:20.193645 31776 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:04:20.194058 31767 server_base.cc:1034] running on GCE node
I20260811 15:04:20.194489 31767 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:04:20.195143 31767 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:04:20.196331 31767 hybrid_clock.cc:648] HybridClock initialized: now 1786460660196306 us; error 49 us; skew 500 ppm
I20260811 15:04:20.198314 31767 webserver.cc:460] Webserver started at http://127.19.236.67:46045/ using document root <none> and password file <none>
I20260811 15:04:20.198925 31767 fs_manager.cc:359] Metadata directory not provided
I20260811 15:04:20.199020 31767 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:04:20.199265 31767 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:04:20.201449 31767 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-2/data/instance:
uuid: "08c3621a84014c64b1a00c7b3ef0bb18"
format_stamp: "Formatted at 2026-08-11 15:04:20 on dist-test-slave-8n49"
server_key: "ee8bcd7b9640539b804ff815b3e2b853"
server_key_iv: "f8abf2d069d710de4a329f78f6aa671c"
server_key_version: "encryptionkey@0"
I20260811 15:04:20.202036 31767 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-2/wal/instance:
uuid: "08c3621a84014c64b1a00c7b3ef0bb18"
format_stamp: "Formatted at 2026-08-11 15:04:20 on dist-test-slave-8n49"
server_key: "ee8bcd7b9640539b804ff815b3e2b853"
server_key_iv: "f8abf2d069d710de4a329f78f6aa671c"
server_key_version: "encryptionkey@0"
I20260811 15:04:20.205754 31767 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 15:04:20.208617 31782 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:04:20.210001 31767 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 15:04:20.210165 31767 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-2/wal
uuid: "08c3621a84014c64b1a00c7b3ef0bb18"
format_stamp: "Formatted at 2026-08-11 15:04:20 on dist-test-slave-8n49"
server_key: "ee8bcd7b9640539b804ff815b3e2b853"
server_key_iv: "f8abf2d069d710de4a329f78f6aa671c"
server_key_version: "encryptionkey@0"
I20260811 15:04:20.210292 31767 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:04:20.215055 31767 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:04:20.215703 31767 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:04:20.215893 31767 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:04:20.216452 31767 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:04:20.217434 31767 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:04:20.217514 31767 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:04:20.217584 31767 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:04:20.217638 31767 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:04:20.226869 31767 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.67:36769
I20260811 15:04:20.226897 31905 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.67:36769 every 8 connection(s)
I20260811 15:04:20.227780 31767 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
I20260811 15:04:20.232816 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 31767
I20260811 15:04:20.232950 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786460596631409-20401-0/minicluster-data/ts-2/wal/instance
I20260811 15:04:20.233282 20401 external_mini_cluster.cc:1428] Setting key c4a1e751bc6a79b1aa65d23f99c89279
I20260811 15:04:20.234596 31453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:20.229678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.67:40625 (local address 127.19.236.126:34703)
0811 15:04:20.229836 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0811 15:04:20.229840 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:04:20.230899 (+ 1059us) server_negotiation.cc:407] Connection header received
0811 15:04:20.232263 (+ 1364us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:04:20.232266 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:04:20.232312 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:04:20.232426 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:04:20.233733 (+ 1307us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:04:20.233737 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:04:20.233740 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:04:20.233755 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:04:20.233778 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:04:20.233789 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:04:20.233918 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0811 15:04:20.234388 (+ 470us) server_negotiation.cc:299] Negotiation successful
0811 15:04:20.234452 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 15:04:20.235361 31908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:20.230077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:34703 (local address 127.19.236.67:40625)
0811 15:04:20.230749 (+ 672us) negotiation.cc:107] Waiting for socket to connect
0811 15:04:20.230788 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 15:04:20.232046 (+ 1258us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:04:20.232666 (+ 620us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:04:20.232675 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:04:20.232788 (+ 113us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:04:20.233374 (+ 586us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 15:04:20.233377 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:04:20.233432 (+ 55us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 15:04:20.233518 (+ 86us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:04:20.234086 (+ 568us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:04:20.234094 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:04:20.234099 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 15:04:20.234280 (+ 181us) client_negotiation.cc:240] Negotiation successful
0811 15:04:20.234518 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":284,"thread_start_us":122,"threads_started":1}
I20260811 15:04:20.236402 31906 heartbeater.cc:347] Connected to a master server at 127.19.236.126:34703
I20260811 15:04:20.236685 31906 heartbeater.cc:464] Registering TS with master...
I20260811 15:04:20.237105 31906 heartbeater.cc:511] Master 127.19.236.126:34703 requested a full tablet report, sending...
I20260811 15:04:20.238161 31413 ts_manager.cc:194] Registered new tserver with Master: 08c3621a84014c64b1a00c7b3ef0bb18 (127.19.236.67:36769)
I20260811 15:04:20.247553 20401 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260811 15:04:20.250553 31453 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:04:20.249638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38168 (local address 127.19.236.126:34703)
0811 15:04:20.249785 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0811 15:04:20.249789 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:04:20.249957 (+ 168us) server_negotiation.cc:407] Connection header received
0811 15:04:20.250070 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:04:20.250073 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:04:20.250109 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:04:20.250186 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:04:20.250412 (+ 226us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38168: BlockingRecv error: recv got EOF from 127.0.0.1:38168 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 15:04:20.250850 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 31477
I20260811 15:04:20.259033 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 31621
I20260811 15:04:20.266284 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 31767
I20260811 15:04:20.275688 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 31381
2026-08-11T15:04:20Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (861 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 15:04:20 dist-test-slave-8n49 krb5kdc[31916](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 15:04:20 dist-test-slave-8n49 krb5kdc[31916](info): set up 2 sockets
Aug 11 15:04:20 dist-test-slave-8n49 krb5kdc[31916](info): commencing operation
krb5kdc: starting...
W20260811 15:04:21.382951 20401 mini_kdc.cc:121] Time spent starting KDC: real 1.083s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/krb5kdc/test-user.keytab.
Aug 11 15:04:21 dist-test-slave-8n49 krb5kdc[31916](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460661, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T15:04:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T15:04:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.236.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.236.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.236.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab.
Entry for principal kudu/127.19.236.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab.
I20260811 15:04:21.515271 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:35037
--webserver_interface=127.19.236.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab
--principal=kudu/127.19.236.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:35899
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.236.126:35037
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:04:21.630098 31930 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:04:21.630378 31930 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:04:21.630419 31930 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:04:21.634553 31930 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:04:21.634613 31930 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:04:21.634634 31930 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:04:21.634649 31930 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:04:21.634665 31930 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:04:21.640003 31930 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:35899
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.236.126:35037
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab
--principal=kudu/127.19.236.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:35037
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.236.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31930
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:04:21.641258 31930 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:04:21.642354 31930 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:04:21.651233 31936 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:04:21.651252 31938 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:04:21.651235 31935 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:04:21.651438 31930 server_base.cc:1034] running on GCE node
I20260811 15:04:21.652168 31930 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:04:21.653334 31930 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:04:21.654506 31930 hybrid_clock.cc:648] HybridClock initialized: now 1786460661654486 us; error 32 us; skew 500 ppm
Aug 11 15:04:21 dist-test-slave-8n49 krb5kdc[31916](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460661, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:04:21.657413 31930 init.cc:377] Logged in from keytab as kudu/127.19.236.126@KRBTEST.COM (short username kudu)
I20260811 15:04:21.658303 31930 webserver.cc:460] Webserver started at http://127.19.236.126:46157/ using document root <none> and password file <none>
I20260811 15:04:21.658887 31930 fs_manager.cc:359] Metadata directory not provided
I20260811 15:04:21.658989 31930 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:04:21.659226 31930 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:04:21.661365 31930 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/minicluster-data/master-0/data/instance:
uuid: "3658d7635d87428a9f6552a12f3fe127"
format_stamp: "Formatted at 2026-08-11 15:04:21 on dist-test-slave-8n49"
server_key: "c3d6c0c99569ac1eb87cb9f524b152ad"
server_key_iv: "411ecdc98434bbf735d3a5aaaf8a7a7b"
server_key_version: "encryptionkey@0"
I20260811 15:04:21.661950 31930 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/minicluster-data/master-0/wal/instance:
uuid: "3658d7635d87428a9f6552a12f3fe127"
format_stamp: "Formatted at 2026-08-11 15:04:21 on dist-test-slave-8n49"
server_key: "c3d6c0c99569ac1eb87cb9f524b152ad"
server_key_iv: "411ecdc98434bbf735d3a5aaaf8a7a7b"
server_key_version: "encryptionkey@0"
I20260811 15:04:21.665671 31930 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.004s
I20260811 15:04:21.667977 31947 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:04:21.669261 31930 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 15:04:21.669404 31930 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/minicluster-data/master-0/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/minicluster-data/master-0/wal
uuid: "3658d7635d87428a9f6552a12f3fe127"
format_stamp: "Formatted at 2026-08-11 15:04:21 on dist-test-slave-8n49"
server_key: "c3d6c0c99569ac1eb87cb9f524b152ad"
server_key_iv: "411ecdc98434bbf735d3a5aaaf8a7a7b"
server_key_version: "encryptionkey@0"
I20260811 15:04:21.669520 31930 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:04:21.692099 31930 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:04:21.695588 31930 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:04:21.695809 31930 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:04:21.703150 31930 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.126:35037
I20260811 15:04:21.703459 32006 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.126:35037 every 8 connection(s)
I20260811 15:04:21.704160 31930 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
I20260811 15:04:21.707050 32007 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:04:21.712250 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 31930
I20260811 15:04:21.712405 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/minicluster-data/master-0/wal/instance
I20260811 15:04:21.712757 20401 external_mini_cluster.cc:1428] Setting key e9fceae3bf438634925693df0e9b7887
I20260811 15:04:21.713070 32007 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3658d7635d87428a9f6552a12f3fe127: Bootstrap starting.
I20260811 15:04:21.715610 32007 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3658d7635d87428a9f6552a12f3fe127: Neither blocks nor log segments found. Creating new log.
I20260811 15:04:21.716593 32007 log.cc:824] T 00000000000000000000000000000000 P 3658d7635d87428a9f6552a12f3fe127: Log is configured to *not* fsync() on all Append() calls
I20260811 15:04:21.718794 32007 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3658d7635d87428a9f6552a12f3fe127: No bootstrap required, opened a new log
Aug 11 15:04:21 dist-test-slave-8n49 krb5kdc[31916](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460661, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
I20260811 15:04:21.723251 32007 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3658d7635d87428a9f6552a12f3fe127 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3658d7635d87428a9f6552a12f3fe127" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 35037 } }
I20260811 15:04:21.723513 32007 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3658d7635d87428a9f6552a12f3fe127 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:04:21.723591 32007 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3658d7635d87428a9f6552a12f3fe127 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3658d7635d87428a9f6552a12f3fe127, State: Initialized, Role: FOLLOWER
I20260811 15:04:21.724035 32007 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3658d7635d87428a9f6552a12f3fe127 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3658d7635d87428a9f6552a12f3fe127" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 35037 } }
I20260811 15:04:21.724196 32007 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3658d7635d87428a9f6552a12f3fe127 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 15:04:21.724290 32007 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3658d7635d87428a9f6552a12f3fe127 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 15:04:21.724416 32007 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3658d7635d87428a9f6552a12f3fe127 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:04:21.725360 32007 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3658d7635d87428a9f6552a12f3fe127 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3658d7635d87428a9f6552a12f3fe127" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 35037 } }
I20260811 15:04:21.725744 32007 leader_election.cc:302] T 00000000000000000000000000000000 P 3658d7635d87428a9f6552a12f3fe127 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3658d7635d87428a9f6552a12f3fe127; no voters:
I20260811 15:04:21.726127 32007 leader_election.cc:288] T 00000000000000000000000000000000 P 3658d7635d87428a9f6552a12f3fe127 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 15:04:21.726197 32014 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3658d7635d87428a9f6552a12f3fe127 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:04:21.726406 32014 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3658d7635d87428a9f6552a12f3fe127 [term 1 LEADER]: Becoming Leader. State: Replica: 3658d7635d87428a9f6552a12f3fe127, State: Running, Role: LEADER
I20260811 15:04:21.726790 32014 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3658d7635d87428a9f6552a12f3fe127 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3658d7635d87428a9f6552a12f3fe127" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 35037 } }
I20260811 15:04:21.727483 32007 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3658d7635d87428a9f6552a12f3fe127 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:04:21.727993 32014 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3658d7635d87428a9f6552a12f3fe127 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3658d7635d87428a9f6552a12f3fe127. Latest consensus state: current_term: 1 leader_uuid: "3658d7635d87428a9f6552a12f3fe127" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3658d7635d87428a9f6552a12f3fe127" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 35037 } } }
I20260811 15:04:21.728186 32014 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3658d7635d87428a9f6552a12f3fe127 [sys.catalog]: This master's current role is: LEADER
I20260811 15:04:21.728431 32015 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3658d7635d87428a9f6552a12f3fe127 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3658d7635d87428a9f6552a12f3fe127" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3658d7635d87428a9f6552a12f3fe127" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 35037 } } }
I20260811 15:04:21.728528 32011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:21.714162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45064 (local address 127.19.236.126:35037)
0811 15:04:21.714585 (+ 423us) server_negotiation.cc:206] Beginning negotiation
0811 15:04:21.714602 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 15:04:21.714639 (+ 37us) server_negotiation.cc:407] Connection header received
0811 15:04:21.715271 (+ 632us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:04:21.715287 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:04:21.715609 (+ 322us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:04:21.715936 (+ 327us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:04:21.716877 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:21.718073 (+ 1196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:21.719190 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:21.719651 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:21.719778 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:21.722597 (+ 2819us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:04:21.722602 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:04:21.722616 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:04:21.722643 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:04:21.724645 (+ 2002us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:04:21.725116 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:04:21.725122 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:04:21.725128 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:04:21.725256 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:04:21.725602 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:04:21.725610 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:04:21.725612 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:04:21.726169 (+ 557us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:04:21.726411 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0811 15:04:21.727195 (+ 784us) server_negotiation.cc:299] Negotiation successful
0811 15:04:21.727475 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":274,"thread_start_us":138,"threads_started":1}
I20260811 15:04:21.728644 32015 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3658d7635d87428a9f6552a12f3fe127 [sys.catalog]: This master's current role is: LEADER
I20260811 15:04:21.728703 32019 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:04:21.732854 32019 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:04:21.738986 32019 catalog_manager.cc:1347] Generated new cluster ID: 077aac3ba78940d1883dd4d4305e4998
I20260811 15:04:21.739092 32019 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:04:21.746989 32019 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 15:04:21.748116 32019 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:04:21.762913 32019 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3658d7635d87428a9f6552a12f3fe127: Generated new TSK 0
I20260811 15:04:21.763870 32019 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.236.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.236.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.236.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.65.keytab.
Entry for principal kudu/127.19.236.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.65.keytab.
I20260811 15:04:21.803870 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.65:0
--local_ip_for_outbound_sockets=127.19.236.65
--webserver_interface=127.19.236.65
--webserver_port=0
--tserver_master_addrs=127.19.236.126:35037
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.65.keytab
--principal=kudu/127.19.236.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:35899
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:04:21.919917 32037 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:04:21.920208 32037 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:04:21.920254 32037 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:04:21.924345 32037 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:04:21.924414 32037 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:04:21.924472 32037 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.65
I20260811 15:04:21.929986 32037 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:35899
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.65.keytab
--principal=kudu/127.19.236.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.236.65
--webserver_port=0
--tserver_master_addrs=127.19.236.126:35037
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32037
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.65
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:04:21.931113 32037 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:04:21.932111 32037 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 15:04:21.941816 32037 server_base.cc:1034] running on GCE node
W20260811 15:04:21.941776 32043 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:04:21.941776 32045 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:04:21.941762 32042 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:04:21.942441 32037 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:04:21.943099 32037 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:04:21.944258 32037 hybrid_clock.cc:648] HybridClock initialized: now 1786460661944228 us; error 44 us; skew 500 ppm
Aug 11 15:04:21 dist-test-slave-8n49 krb5kdc[31916](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460661, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:04:21.947108 32037 init.cc:377] Logged in from keytab as kudu/127.19.236.65@KRBTEST.COM (short username kudu)
I20260811 15:04:21.947983 32037 webserver.cc:460] Webserver started at http://127.19.236.65:39369/ using document root <none> and password file <none>
I20260811 15:04:21.948616 32037 fs_manager.cc:359] Metadata directory not provided
I20260811 15:04:21.948710 32037 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:04:21.948953 32037 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:04:21.951036 32037 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/minicluster-data/ts-0/data/instance:
uuid: "4703eb1cf483481cbc9b08c837b03d99"
format_stamp: "Formatted at 2026-08-11 15:04:21 on dist-test-slave-8n49"
server_key: "757ae7bea424255dc56551744bd4a67f"
server_key_iv: "108054a20c229d234720826735f876cb"
server_key_version: "encryptionkey@0"
I20260811 15:04:21.951619 32037 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/minicluster-data/ts-0/wal/instance:
uuid: "4703eb1cf483481cbc9b08c837b03d99"
format_stamp: "Formatted at 2026-08-11 15:04:21 on dist-test-slave-8n49"
server_key: "757ae7bea424255dc56551744bd4a67f"
server_key_iv: "108054a20c229d234720826735f876cb"
server_key_version: "encryptionkey@0"
I20260811 15:04:21.955804 32037 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260811 15:04:21.958446 32052 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:04:21.959815 32037 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260811 15:04:21.959977 32037 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/minicluster-data/ts-0/wal
uuid: "4703eb1cf483481cbc9b08c837b03d99"
format_stamp: "Formatted at 2026-08-11 15:04:21 on dist-test-slave-8n49"
server_key: "757ae7bea424255dc56551744bd4a67f"
server_key_iv: "108054a20c229d234720826735f876cb"
server_key_version: "encryptionkey@0"
I20260811 15:04:21.960105 32037 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:04:21.977766 32037 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:04:21.981211 32037 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:04:21.981444 32037 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:04:21.982088 32037 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:04:21.982961 32037 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:04:21.983035 32037 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:04:21.983114 32037 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:04:21.983165 32037 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:04:21.992259 32037 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.65:35243
I20260811 15:04:21.992280 32182 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.65:35243 every 8 connection(s)
I20260811 15:04:21.993243 32037 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
I20260811 15:04:22.001569 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 32037
I20260811 15:04:22.001704 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/minicluster-data/ts-0/wal/instance
I20260811 15:04:22.002074 20401 external_mini_cluster.cc:1428] Setting key 5f50cd948e0e0f77ef4f7b5e61fe8c55
Aug 11 15:04:21 dist-test-slave-8n49 krb5kdc[31916](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460661, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.65@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
I20260811 15:04:22.008046 32011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:21.995182 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.65:35069 (local address 127.19.236.126:35037)
0811 15:04:21.995357 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0811 15:04:21.995362 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:04:21.996200 (+ 838us) server_negotiation.cc:407] Connection header received
0811 15:04:21.997660 (+ 1460us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:04:21.997663 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:04:21.997715 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:04:21.997799 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:04:21.998984 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:21.999539 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:22.000830 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:22.001161 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:22.001397 (+ 236us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:22.004316 (+ 2919us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:04:22.004320 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:04:22.004322 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:04:22.004346 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:04:22.005921 (+ 1575us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:04:22.006464 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:04:22.006468 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:04:22.006470 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:04:22.006556 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:04:22.006912 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:04:22.006915 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:04:22.006917 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:04:22.007109 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:04:22.007222 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0811 15:04:22.007734 (+ 512us) server_negotiation.cc:299] Negotiation successful
0811 15:04:22.007873 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260811 15:04:22.008953 32186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:21.995569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:35037 (local address 127.19.236.65:35069)
0811 15:04:21.996040 (+ 471us) negotiation.cc:107] Waiting for socket to connect
0811 15:04:21.996085 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 15:04:21.997432 (+ 1347us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:04:21.997965 (+ 533us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:04:21.997972 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:04:21.998328 (+ 356us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:04:21.998815 (+ 487us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:21.998828 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:21.999659 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:21.999661 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:22.000518 (+ 857us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:22.000527 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:22.001460 (+ 933us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:22.001465 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:22.001691 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:22.002418 (+ 727us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:04:22.002440 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:04:22.004129 (+ 1689us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:04:22.006056 (+ 1927us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:04:22.006062 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:04:22.006078 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:04:22.006346 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:04:22.006654 (+ 308us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:04:22.006658 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:04:22.006660 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:04:22.006806 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:04:22.007223 (+ 417us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:04:22.007231 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:04:22.007486 (+ 255us) client_negotiation.cc:769] Sending connection context
0811 15:04:22.007688 (+ 202us) client_negotiation.cc:240] Negotiation successful
0811 15:04:22.008033 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":277,"thread_start_us":114,"threads_started":1}
I20260811 15:04:22.010285 32183 heartbeater.cc:347] Connected to a master server at 127.19.236.126:35037
I20260811 15:04:22.010561 32183 heartbeater.cc:464] Registering TS with master...
I20260811 15:04:22.011068 32183 heartbeater.cc:511] Master 127.19.236.126:35037 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.19.236.66@KRBTEST.COM; defaulting to no policy
I20260811 15:04:22.012893 31966 ts_manager.cc:194] Registered new tserver with Master: 4703eb1cf483481cbc9b08c837b03d99 (127.19.236.65:35243)
I20260811 15:04:22.014086 31966 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.236.65@KRBTEST.COM'} at 127.19.236.65:35069
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.236.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.236.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.66.keytab.
Entry for principal kudu/127.19.236.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.66.keytab.
I20260811 15:04:22.032326 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.66:0
--local_ip_for_outbound_sockets=127.19.236.66
--webserver_interface=127.19.236.66
--webserver_port=0
--tserver_master_addrs=127.19.236.126:35037
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.66.keytab
--principal=kudu/127.19.236.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:35899
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:04:22.146168 32189 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:04:22.146443 32189 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:04:22.146488 32189 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:04:22.150671 32189 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:04:22.150736 32189 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:04:22.150795 32189 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.66
I20260811 15:04:22.156140 32189 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:35899
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.66.keytab
--principal=kudu/127.19.236.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.236.66
--webserver_port=0
--tserver_master_addrs=127.19.236.126:35037
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32189
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.66
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:04:22.157341 32189 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:04:22.158509 32189 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:04:22.168759 32198 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:04:22.168759 32194 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:04:22.168783 32195 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:04:22.168989 32189 server_base.cc:1034] running on GCE node
I20260811 15:04:22.169389 32189 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:04:22.170076 32189 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:04:22.171239 32189 hybrid_clock.cc:648] HybridClock initialized: now 1786460662171228 us; error 25 us; skew 500 ppm
Aug 11 15:04:22 dist-test-slave-8n49 krb5kdc[31916](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460662, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:04:22.174275 32189 init.cc:377] Logged in from keytab as kudu/127.19.236.66@KRBTEST.COM (short username kudu)
I20260811 15:04:22.175246 32189 webserver.cc:460] Webserver started at http://127.19.236.66:38093/ using document root <none> and password file <none>
I20260811 15:04:22.175848 32189 fs_manager.cc:359] Metadata directory not provided
I20260811 15:04:22.175947 32189 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:04:22.176177 32189 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:04:22.178335 32189 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/minicluster-data/ts-1/data/instance:
uuid: "bb1bd461092c4a55a2e29ac2b791b15a"
format_stamp: "Formatted at 2026-08-11 15:04:22 on dist-test-slave-8n49"
server_key: "9de81ae3b97193c2e4fe34bda7d5f60e"
server_key_iv: "3db8d0d1fc7a71dd55b3b8c42bf830e8"
server_key_version: "encryptionkey@0"
I20260811 15:04:22.178962 32189 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/minicluster-data/ts-1/wal/instance:
uuid: "bb1bd461092c4a55a2e29ac2b791b15a"
format_stamp: "Formatted at 2026-08-11 15:04:22 on dist-test-slave-8n49"
server_key: "9de81ae3b97193c2e4fe34bda7d5f60e"
server_key_iv: "3db8d0d1fc7a71dd55b3b8c42bf830e8"
server_key_version: "encryptionkey@0"
I20260811 15:04:22.182864 32189 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.002s
I20260811 15:04:22.185501 32206 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:04:22.186820 32189 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 15:04:22.186965 32189 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/minicluster-data/ts-1/wal
uuid: "bb1bd461092c4a55a2e29ac2b791b15a"
format_stamp: "Formatted at 2026-08-11 15:04:22 on dist-test-slave-8n49"
server_key: "9de81ae3b97193c2e4fe34bda7d5f60e"
server_key_iv: "3db8d0d1fc7a71dd55b3b8c42bf830e8"
server_key_version: "encryptionkey@0"
I20260811 15:04:22.187084 32189 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:04:22.205169 32189 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:04:22.208480 32189 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:04:22.208734 32189 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:04:22.209372 32189 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:04:22.210250 32189 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:04:22.210323 32189 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:04:22.210407 32189 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:04:22.210458 32189 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:04:22.219537 32189 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.66:32855
I20260811 15:04:22.219614 32334 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.66:32855 every 8 connection(s)
I20260811 15:04:22.220500 32189 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
I20260811 15:04:22.229748 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 32189
I20260811 15:04:22.229882 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/minicluster-data/ts-1/wal/instance
I20260811 15:04:22.230198 20401 external_mini_cluster.cc:1428] Setting key b7c230c9935bb9e8ced41e978dffdc24
Aug 11 15:04:22 dist-test-slave-8n49 krb5kdc[31916](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460662, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.66@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
I20260811 15:04:22.239153 32011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:22.222645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.66:36209 (local address 127.19.236.126:35037)
0811 15:04:22.222791 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0811 15:04:22.222795 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:04:22.223700 (+ 905us) server_negotiation.cc:407] Connection header received
0811 15:04:22.225233 (+ 1533us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:04:22.225236 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:04:22.225286 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:04:22.225369 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:04:22.226553 (+ 1184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:22.227162 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:22.228652 (+ 1490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:22.228886 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:22.228981 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:22.234986 (+ 6005us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:04:22.234993 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:04:22.234999 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:04:22.235034 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:04:22.236810 (+ 1776us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:04:22.237325 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:04:22.237331 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:04:22.237337 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:04:22.237443 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:04:22.237789 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:04:22.237795 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:04:22.237799 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:04:22.238102 (+ 303us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:04:22.238228 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0811 15:04:22.238789 (+ 561us) server_negotiation.cc:299] Negotiation successful
0811 15:04:22.238932 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 15:04:22.239956 32337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:22.223035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:35037 (local address 127.19.236.66:36209)
0811 15:04:22.223535 (+ 500us) negotiation.cc:107] Waiting for socket to connect
0811 15:04:22.223581 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 15:04:22.224973 (+ 1392us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:04:22.225540 (+ 567us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:04:22.225546 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:04:22.225911 (+ 365us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:04:22.226404 (+ 493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:22.226418 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:22.227318 (+ 900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:22.227323 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:22.228460 (+ 1137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:22.228472 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:22.229055 (+ 583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:22.229059 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:22.229203 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:22.233152 (+ 3949us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:04:22.233172 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:04:22.234800 (+ 1628us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:04:22.236938 (+ 2138us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:04:22.236944 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:04:22.236957 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:04:22.237214 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:04:22.237547 (+ 333us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:04:22.237549 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:04:22.237551 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:04:22.237688 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:04:22.238244 (+ 556us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:04:22.238250 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:04:22.238530 (+ 280us) client_negotiation.cc:769] Sending connection context
0811 15:04:22.238707 (+ 177us) client_negotiation.cc:240] Negotiation successful
0811 15:04:22.238994 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":305,"thread_start_us":115,"threads_started":1}
WARNING: no policy specified for kudu/127.19.236.67@KRBTEST.COM; defaulting to no policy
I20260811 15:04:22.241349 32335 heartbeater.cc:347] Connected to a master server at 127.19.236.126:35037
I20260811 15:04:22.241639 32335 heartbeater.cc:464] Registering TS with master...
I20260811 15:04:22.242208 32335 heartbeater.cc:511] Master 127.19.236.126:35037 requested a full tablet report, sending...
I20260811 15:04:22.243479 31966 ts_manager.cc:194] Registered new tserver with Master: bb1bd461092c4a55a2e29ac2b791b15a (127.19.236.66:32855)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.236.67@KRBTEST.COM" created.
I20260811 15:04:22.244333 31966 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.236.66@KRBTEST.COM'} at 127.19.236.66:36209
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.236.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.67.keytab.
Entry for principal kudu/127.19.236.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.67.keytab.
I20260811 15:04:22.260393 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.67:0
--local_ip_for_outbound_sockets=127.19.236.67
--webserver_interface=127.19.236.67
--webserver_port=0
--tserver_master_addrs=127.19.236.126:35037
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.67.keytab
--principal=kudu/127.19.236.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:35899
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:04:22.375377 32340 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:04:22.375649 32340 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:04:22.375694 32340 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:04:22.379923 32340 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:04:22.379990 32340 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:04:22.380077 32340 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.67
I20260811 15:04:22.385591 32340 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:35899
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.67.keytab
--principal=kudu/127.19.236.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.236.67
--webserver_port=0
--tserver_master_addrs=127.19.236.126:35037
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32340
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.67
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:04:22.386711 32340 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:04:22.387791 32340 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:04:22.398294 32348 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:04:22.398289 32346 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:04:22.398451 32340 server_base.cc:1034] running on GCE node
W20260811 15:04:22.398307 32345 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:04:22.398988 32340 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:04:22.399679 32340 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:04:22.400841 32340 hybrid_clock.cc:648] HybridClock initialized: now 1786460662400823 us; error 31 us; skew 500 ppm
Aug 11 15:04:22 dist-test-slave-8n49 krb5kdc[31916](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460662, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:04:22.403689 32340 init.cc:377] Logged in from keytab as kudu/127.19.236.67@KRBTEST.COM (short username kudu)
I20260811 15:04:22.404515 32340 webserver.cc:460] Webserver started at http://127.19.236.67:34303/ using document root <none> and password file <none>
I20260811 15:04:22.405112 32340 fs_manager.cc:359] Metadata directory not provided
I20260811 15:04:22.405174 32340 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:04:22.405342 32340 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:04:22.407442 32340 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/minicluster-data/ts-2/data/instance:
uuid: "1e242a0dcc1e44a7bf84052909d249d8"
format_stamp: "Formatted at 2026-08-11 15:04:22 on dist-test-slave-8n49"
server_key: "bd85ee3967a9cc54f3969adfa2062533"
server_key_iv: "b0ed35ef0048a2aa4163bc6ab2a1b42e"
server_key_version: "encryptionkey@0"
I20260811 15:04:22.407979 32340 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/minicluster-data/ts-2/wal/instance:
uuid: "1e242a0dcc1e44a7bf84052909d249d8"
format_stamp: "Formatted at 2026-08-11 15:04:22 on dist-test-slave-8n49"
server_key: "bd85ee3967a9cc54f3969adfa2062533"
server_key_iv: "b0ed35ef0048a2aa4163bc6ab2a1b42e"
server_key_version: "encryptionkey@0"
I20260811 15:04:22.411754 32340 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.003s
I20260811 15:04:22.414227 32355 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:04:22.415485 32340 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 15:04:22.415583 32340 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/minicluster-data/ts-2/wal
uuid: "1e242a0dcc1e44a7bf84052909d249d8"
format_stamp: "Formatted at 2026-08-11 15:04:22 on dist-test-slave-8n49"
server_key: "bd85ee3967a9cc54f3969adfa2062533"
server_key_iv: "b0ed35ef0048a2aa4163bc6ab2a1b42e"
server_key_version: "encryptionkey@0"
I20260811 15:04:22.415723 32340 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:04:22.432890 32340 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:04:22.436357 32340 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:04:22.436622 32340 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:04:22.437276 32340 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:04:22.438236 32340 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:04:22.438308 32340 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:04:22.438382 32340 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:04:22.438432 32340 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:04:22.447587 32340 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.67:40025
I20260811 15:04:22.447650 32476 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.67:40025 every 8 connection(s)
I20260811 15:04:22.448688 32340 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
I20260811 15:04:22.458228 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 32340
I20260811 15:04:22.458369 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/minicluster-data/ts-2/wal/instance
Aug 11 15:04:22 dist-test-slave-8n49 krb5kdc[31916](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460662, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.67@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
I20260811 15:04:22.458726 20401 external_mini_cluster.cc:1428] Setting key 97afc4134d83e67ed9bcb0f5882c0f19
I20260811 15:04:22.463181 32011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:22.450591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.67:52479 (local address 127.19.236.126:35037)
0811 15:04:22.450732 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0811 15:04:22.450736 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:04:22.451551 (+ 815us) server_negotiation.cc:407] Connection header received
0811 15:04:22.453122 (+ 1571us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:04:22.453126 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:04:22.453188 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:04:22.453289 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:04:22.454480 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:22.455026 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:22.456162 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:22.456384 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:22.456492 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:22.459337 (+ 2845us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:04:22.459341 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:04:22.459344 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:04:22.459371 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:04:22.461048 (+ 1677us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:04:22.461641 (+ 593us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:04:22.461643 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:04:22.461644 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:04:22.461720 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:04:22.462058 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:04:22.462061 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:04:22.462062 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:04:22.462232 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:04:22.462309 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 15:04:22.462887 (+ 578us) server_negotiation.cc:299] Negotiation successful
0811 15:04:22.463043 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 15:04:22.464161 32481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:22.450937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:35037 (local address 127.19.236.67:52479)
0811 15:04:22.451398 (+ 461us) negotiation.cc:107] Waiting for socket to connect
0811 15:04:22.451440 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 15:04:22.452890 (+ 1450us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:04:22.453470 (+ 580us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:04:22.453477 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:04:22.453850 (+ 373us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:04:22.454333 (+ 483us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:22.454347 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:22.455153 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:22.455162 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:22.456035 (+ 873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:22.456045 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:22.456570 (+ 525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:22.456576 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:22.456751 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:22.457340 (+ 589us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:04:22.457357 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:04:22.459111 (+ 1754us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:04:22.461176 (+ 2065us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:04:22.461181 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:04:22.461221 (+ 40us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:04:22.461545 (+ 324us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:04:22.461807 (+ 262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:04:22.461809 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:04:22.461810 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:04:22.461973 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:04:22.462334 (+ 361us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:04:22.462340 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:04:22.462600 (+ 260us) client_negotiation.cc:769] Sending connection context
0811 15:04:22.462777 (+ 177us) client_negotiation.cc:240] Negotiation successful
0811 15:04:22.463112 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":270,"thread_start_us":112,"threads_started":1}
I20260811 15:04:22.465410 32477 heartbeater.cc:347] Connected to a master server at 127.19.236.126:35037
I20260811 15:04:22.465687 32477 heartbeater.cc:464] Registering TS with master...
I20260811 15:04:22.466202 32477 heartbeater.cc:511] Master 127.19.236.126:35037 requested a full tablet report, sending...
I20260811 15:04:22.467267 31966 ts_manager.cc:194] Registered new tserver with Master: 1e242a0dcc1e44a7bf84052909d249d8 (127.19.236.67:40025)
I20260811 15:04:22.467875 31966 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.236.67@KRBTEST.COM'} at 127.19.236.67:52479
I20260811 15:04:22.473104 20401 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 15:04:22.482929 32011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:22.475255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45070 (local address 127.19.236.126:35037)
0811 15:04:22.475399 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0811 15:04:22.475402 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 15:04:22.475562 (+ 160us) server_negotiation.cc:407] Connection header received
0811 15:04:22.475661 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:04:22.475664 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:04:22.475702 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:04:22.475774 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:04:22.476494 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:22.477089 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:22.477898 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:22.478105 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:22.478180 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:22.479516 (+ 1336us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:04:22.479520 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:04:22.479522 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:04:22.479553 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:04:22.481238 (+ 1685us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:04:22.481681 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:04:22.481684 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:04:22.481685 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:04:22.481770 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:04:22.482019 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:04:22.482022 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:04:22.482023 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:04:22.482248 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:04:22.482364 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0811 15:04:22.482578 (+ 214us) server_negotiation.cc:299] Negotiation successful
0811 15:04:22.482678 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 15:04:22.486068 31966 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45070:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 15:04:22.489220 31966 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 15:04:22.504048 32490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:22.498325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.66:32855 (local address 127.0.0.1:54842)
0811 15:04:22.498813 (+ 488us) negotiation.cc:107] Waiting for socket to connect
0811 15:04:22.498863 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 15:04:22.499016 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:04:22.499642 (+ 626us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:04:22.499648 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:04:22.499680 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:04:22.499834 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:22.499845 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:22.501175 (+ 1330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:22.501180 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:22.502292 (+ 1112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:22.502302 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:22.503461 (+ 1159us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:22.503464 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:22.503570 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:22.503607 (+ 37us) client_negotiation.cc:769] Sending connection context
0811 15:04:22.503748 (+ 141us) client_negotiation.cc:240] Negotiation successful
0811 15:04:22.503879 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":323,"mutex_wait_us":25,"thread_start_us":101,"threads_started":1}
I20260811 15:04:22.504053 32492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:22.498504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54842 (local address 127.19.236.66:32855)
0811 15:04:22.499072 (+ 568us) server_negotiation.cc:206] Beginning negotiation
0811 15:04:22.499093 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0811 15:04:22.499119 (+ 26us) server_negotiation.cc:407] Connection header received
0811 15:04:22.499201 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:04:22.499207 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:04:22.499440 (+ 233us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:04:22.499643 (+ 203us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:04:22.499991 (+ 348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:22.501041 (+ 1050us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:22.502468 (+ 1427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:22.503328 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:22.503446 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:22.503605 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0811 15:04:22.503783 (+ 178us) server_negotiation.cc:299] Negotiation successful
0811 15:04:22.503883 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":460,"thread_start_us":144,"threads_started":1}
I20260811 15:04:22.504671 32491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:22.498526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.65:35243 (local address 127.0.0.1:59194)
0811 15:04:22.499254 (+ 728us) negotiation.cc:107] Waiting for socket to connect
0811 15:04:22.499266 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 15:04:22.499339 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:04:22.500466 (+ 1127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:04:22.500470 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:04:22.500487 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:04:22.500622 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:22.500629 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:22.502112 (+ 1483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:22.502118 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:22.503182 (+ 1064us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:22.503192 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:22.504256 (+ 1064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:22.504260 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:22.504354 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:22.504378 (+ 24us) client_negotiation.cc:769] Sending connection context
0811 15:04:22.504430 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 15:04:22.504507 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":670,"mutex_wait_us":1,"thread_start_us":125,"threads_started":1}
I20260811 15:04:22.504925 32493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:22.499038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.67:40025 (local address 127.0.0.1:44774)
0811 15:04:22.499535 (+ 497us) negotiation.cc:107] Waiting for socket to connect
0811 15:04:22.499549 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 15:04:22.499623 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:04:22.500378 (+ 755us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:04:22.500381 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:04:22.500401 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:04:22.500491 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:22.500497 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:22.501921 (+ 1424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:22.501925 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:22.503158 (+ 1233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:22.503170 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:22.504509 (+ 1339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:22.504513 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:22.504628 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:22.504652 (+ 24us) client_negotiation.cc:769] Sending connection context
0811 15:04:22.504736 (+ 84us) client_negotiation.cc:240] Negotiation successful
0811 15:04:22.504801 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":423,"mutex_wait_us":52,"thread_start_us":131,"threads_started":1}
I20260811 15:04:22.505054 32494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:22.499277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44774 (local address 127.19.236.67:40025)
0811 15:04:22.499871 (+ 594us) server_negotiation.cc:206] Beginning negotiation
0811 15:04:22.499883 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 15:04:22.499918 (+ 35us) server_negotiation.cc:407] Connection header received
0811 15:04:22.499994 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:04:22.499999 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:04:22.500193 (+ 194us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:04:22.500392 (+ 199us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:04:22.500630 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:22.501765 (+ 1135us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:22.503295 (+ 1530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:22.504113 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:22.504483 (+ 370us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:22.504659 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0811 15:04:22.504782 (+ 123us) server_negotiation.cc:299] Negotiation successful
0811 15:04:22.504893 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":481,"thread_start_us":88,"threads_started":1}
I20260811 15:04:22.505776 32495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:22.499619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59194 (local address 127.19.236.65:35243)
0811 15:04:22.500017 (+ 398us) server_negotiation.cc:206] Beginning negotiation
0811 15:04:22.500032 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 15:04:22.500051 (+ 19us) server_negotiation.cc:407] Connection header received
0811 15:04:22.500131 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:04:22.500136 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:04:22.500306 (+ 170us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:04:22.500773 (+ 467us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:04:22.500927 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:22.501982 (+ 1055us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:22.503338 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:22.504113 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:22.505348 (+ 1235us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:22.505494 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0811 15:04:22.505543 (+ 49us) server_negotiation.cc:299] Negotiation successful
0811 15:04:22.505641 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":295,"thread_start_us":71,"threads_started":1}
I20260811 15:04:22.507620 32407 tablet_service.cc:1467] Processing CreateTablet for tablet 68f8d78aa22f40e2ab5a5a02aa15e830 (DEFAULT_TABLE table=test-table [id=5289dd359e0a455ba83812a28e12eaee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:04:22.507656 32260 tablet_service.cc:1467] Processing CreateTablet for tablet 68f8d78aa22f40e2ab5a5a02aa15e830 (DEFAULT_TABLE table=test-table [id=5289dd359e0a455ba83812a28e12eaee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:04:22.508726 32407 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 68f8d78aa22f40e2ab5a5a02aa15e830. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:04:22.508740 32260 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 68f8d78aa22f40e2ab5a5a02aa15e830. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:04:22.508442 32104 tablet_service.cc:1467] Processing CreateTablet for tablet 68f8d78aa22f40e2ab5a5a02aa15e830 (DEFAULT_TABLE table=test-table [id=5289dd359e0a455ba83812a28e12eaee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:04:22.509363 32104 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 68f8d78aa22f40e2ab5a5a02aa15e830. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:04:22.514675 32496 tablet_bootstrap.cc:492] T 68f8d78aa22f40e2ab5a5a02aa15e830 P 1e242a0dcc1e44a7bf84052909d249d8: Bootstrap starting.
I20260811 15:04:22.516911 32498 tablet_bootstrap.cc:492] T 68f8d78aa22f40e2ab5a5a02aa15e830 P bb1bd461092c4a55a2e29ac2b791b15a: Bootstrap starting.
I20260811 15:04:22.517104 32496 tablet_bootstrap.cc:654] T 68f8d78aa22f40e2ab5a5a02aa15e830 P 1e242a0dcc1e44a7bf84052909d249d8: Neither blocks nor log segments found. Creating new log.
I20260811 15:04:22.518205 32496 log.cc:824] T 68f8d78aa22f40e2ab5a5a02aa15e830 P 1e242a0dcc1e44a7bf84052909d249d8: Log is configured to *not* fsync() on all Append() calls
I20260811 15:04:22.519125 32498 tablet_bootstrap.cc:654] T 68f8d78aa22f40e2ab5a5a02aa15e830 P bb1bd461092c4a55a2e29ac2b791b15a: Neither blocks nor log segments found. Creating new log.
I20260811 15:04:22.519630 32497 tablet_bootstrap.cc:492] T 68f8d78aa22f40e2ab5a5a02aa15e830 P 4703eb1cf483481cbc9b08c837b03d99: Bootstrap starting.
I20260811 15:04:22.520049 32498 log.cc:824] T 68f8d78aa22f40e2ab5a5a02aa15e830 P bb1bd461092c4a55a2e29ac2b791b15a: Log is configured to *not* fsync() on all Append() calls
I20260811 15:04:22.520350 32496 tablet_bootstrap.cc:492] T 68f8d78aa22f40e2ab5a5a02aa15e830 P 1e242a0dcc1e44a7bf84052909d249d8: No bootstrap required, opened a new log
I20260811 15:04:22.520648 32496 ts_tablet_manager.cc:1397] T 68f8d78aa22f40e2ab5a5a02aa15e830 P 1e242a0dcc1e44a7bf84052909d249d8: Time spent bootstrapping tablet: real 0.006s user 0.006s sys 0.000s
I20260811 15:04:22.521647 32497 tablet_bootstrap.cc:654] T 68f8d78aa22f40e2ab5a5a02aa15e830 P 4703eb1cf483481cbc9b08c837b03d99: Neither blocks nor log segments found. Creating new log.
I20260811 15:04:22.522235 32498 tablet_bootstrap.cc:492] T 68f8d78aa22f40e2ab5a5a02aa15e830 P bb1bd461092c4a55a2e29ac2b791b15a: No bootstrap required, opened a new log
I20260811 15:04:22.522363 32497 log.cc:824] T 68f8d78aa22f40e2ab5a5a02aa15e830 P 4703eb1cf483481cbc9b08c837b03d99: Log is configured to *not* fsync() on all Append() calls
I20260811 15:04:22.522431 32498 ts_tablet_manager.cc:1397] T 68f8d78aa22f40e2ab5a5a02aa15e830 P bb1bd461092c4a55a2e29ac2b791b15a: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260811 15:04:22.524127 32497 tablet_bootstrap.cc:492] T 68f8d78aa22f40e2ab5a5a02aa15e830 P 4703eb1cf483481cbc9b08c837b03d99: No bootstrap required, opened a new log
I20260811 15:04:22.524322 32497 ts_tablet_manager.cc:1397] T 68f8d78aa22f40e2ab5a5a02aa15e830 P 4703eb1cf483481cbc9b08c837b03d99: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260811 15:04:22.524814 32496 raft_consensus.cc:348] T 68f8d78aa22f40e2ab5a5a02aa15e830 P 1e242a0dcc1e44a7bf84052909d249d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb1bd461092c4a55a2e29ac2b791b15a" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 32855 } } peers { permanent_uuid: "4703eb1cf483481cbc9b08c837b03d99" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 35243 } } peers { permanent_uuid: "1e242a0dcc1e44a7bf84052909d249d8" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 40025 } }
I20260811 15:04:22.525103 32496 raft_consensus.cc:374] T 68f8d78aa22f40e2ab5a5a02aa15e830 P 1e242a0dcc1e44a7bf84052909d249d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:04:22.525199 32496 raft_consensus.cc:729] T 68f8d78aa22f40e2ab5a5a02aa15e830 P 1e242a0dcc1e44a7bf84052909d249d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e242a0dcc1e44a7bf84052909d249d8, State: Initialized, Role: FOLLOWER
I20260811 15:04:22.525691 32496 consensus_queue.cc:260] T 68f8d78aa22f40e2ab5a5a02aa15e830 P 1e242a0dcc1e44a7bf84052909d249d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb1bd461092c4a55a2e29ac2b791b15a" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 32855 } } peers { permanent_uuid: "4703eb1cf483481cbc9b08c837b03d99" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 35243 } } peers { permanent_uuid: "1e242a0dcc1e44a7bf84052909d249d8" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 40025 } }
I20260811 15:04:22.526762 32496 ts_tablet_manager.cc:1428] T 68f8d78aa22f40e2ab5a5a02aa15e830 P 1e242a0dcc1e44a7bf84052909d249d8: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260811 15:04:22.527168 32477 heartbeater.cc:503] Master 127.19.236.126:35037 was elected leader, sending a full tablet report...
I20260811 15:04:22.527303 32498 raft_consensus.cc:348] T 68f8d78aa22f40e2ab5a5a02aa15e830 P bb1bd461092c4a55a2e29ac2b791b15a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb1bd461092c4a55a2e29ac2b791b15a" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 32855 } } peers { permanent_uuid: "4703eb1cf483481cbc9b08c837b03d99" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 35243 } } peers { permanent_uuid: "1e242a0dcc1e44a7bf84052909d249d8" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 40025 } }
I20260811 15:04:22.527496 32498 raft_consensus.cc:374] T 68f8d78aa22f40e2ab5a5a02aa15e830 P bb1bd461092c4a55a2e29ac2b791b15a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:04:22.527527 32498 raft_consensus.cc:729] T 68f8d78aa22f40e2ab5a5a02aa15e830 P bb1bd461092c4a55a2e29ac2b791b15a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb1bd461092c4a55a2e29ac2b791b15a, State: Initialized, Role: FOLLOWER
I20260811 15:04:22.527943 32498 consensus_queue.cc:260] T 68f8d78aa22f40e2ab5a5a02aa15e830 P bb1bd461092c4a55a2e29ac2b791b15a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb1bd461092c4a55a2e29ac2b791b15a" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 32855 } } peers { permanent_uuid: "4703eb1cf483481cbc9b08c837b03d99" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 35243 } } peers { permanent_uuid: "1e242a0dcc1e44a7bf84052909d249d8" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 40025 } }
I20260811 15:04:22.528156 32497 raft_consensus.cc:348] T 68f8d78aa22f40e2ab5a5a02aa15e830 P 4703eb1cf483481cbc9b08c837b03d99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb1bd461092c4a55a2e29ac2b791b15a" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 32855 } } peers { permanent_uuid: "4703eb1cf483481cbc9b08c837b03d99" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 35243 } } peers { permanent_uuid: "1e242a0dcc1e44a7bf84052909d249d8" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 40025 } }
I20260811 15:04:22.528460 32497 raft_consensus.cc:374] T 68f8d78aa22f40e2ab5a5a02aa15e830 P 4703eb1cf483481cbc9b08c837b03d99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:04:22.528568 32497 raft_consensus.cc:729] T 68f8d78aa22f40e2ab5a5a02aa15e830 P 4703eb1cf483481cbc9b08c837b03d99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4703eb1cf483481cbc9b08c837b03d99, State: Initialized, Role: FOLLOWER
I20260811 15:04:22.528752 32335 heartbeater.cc:503] Master 127.19.236.126:35037 was elected leader, sending a full tablet report...
I20260811 15:04:22.529027 32498 ts_tablet_manager.cc:1428] T 68f8d78aa22f40e2ab5a5a02aa15e830 P bb1bd461092c4a55a2e29ac2b791b15a: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260811 15:04:22.529065 32497 consensus_queue.cc:260] T 68f8d78aa22f40e2ab5a5a02aa15e830 P 4703eb1cf483481cbc9b08c837b03d99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb1bd461092c4a55a2e29ac2b791b15a" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 32855 } } peers { permanent_uuid: "4703eb1cf483481cbc9b08c837b03d99" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 35243 } } peers { permanent_uuid: "1e242a0dcc1e44a7bf84052909d249d8" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 40025 } }
I20260811 15:04:22.529770 32183 heartbeater.cc:503] Master 127.19.236.126:35037 was elected leader, sending a full tablet report...
I20260811 15:04:22.531013 32497 ts_tablet_manager.cc:1428] T 68f8d78aa22f40e2ab5a5a02aa15e830 P 4703eb1cf483481cbc9b08c837b03d99: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260811 15:04:22.535951 32502 raft_consensus.cc:482] T 68f8d78aa22f40e2ab5a5a02aa15e830 P 1e242a0dcc1e44a7bf84052909d249d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 15:04:22.536146 32502 raft_consensus.cc:504] T 68f8d78aa22f40e2ab5a5a02aa15e830 P 1e242a0dcc1e44a7bf84052909d249d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb1bd461092c4a55a2e29ac2b791b15a" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 32855 } } peers { permanent_uuid: "4703eb1cf483481cbc9b08c837b03d99" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 35243 } } peers { permanent_uuid: "1e242a0dcc1e44a7bf84052909d249d8" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 40025 } }
I20260811 15:04:22.537299 32502 leader_election.cc:288] T 68f8d78aa22f40e2ab5a5a02aa15e830 P 1e242a0dcc1e44a7bf84052909d249d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb1bd461092c4a55a2e29ac2b791b15a (127.19.236.66:32855), 4703eb1cf483481cbc9b08c837b03d99 (127.19.236.65:35243)
I20260811 15:04:22.542224 32481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:22.537465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.66:32855 (local address 127.19.236.67:49505)
0811 15:04:22.537615 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0811 15:04:22.537632 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 15:04:22.537738 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:04:22.538084 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:04:22.538087 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:04:22.538108 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:04:22.538249 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:22.538257 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:22.539399 (+ 1142us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:22.539401 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:22.540689 (+ 1288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:22.540700 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:22.541668 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:22.541671 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:22.541868 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:22.541896 (+ 28us) client_negotiation.cc:769] Sending connection context
0811 15:04:22.541976 (+ 80us) client_negotiation.cc:240] Negotiation successful
0811 15:04:22.542066 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":57,"mutex_wait_us":31}
I20260811 15:04:22.542243 32492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:22.537594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.67:49505 (local address 127.19.236.66:32855)
0811 15:04:22.537722 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0811 15:04:22.537729 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 15:04:22.537746 (+ 17us) server_negotiation.cc:407] Connection header received
0811 15:04:22.537919 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:04:22.537923 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:04:22.537968 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:04:22.538068 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:04:22.538390 (+ 322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:22.539284 (+ 894us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:22.540823 (+ 1539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:22.541534 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:22.541683 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:22.541755 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 15:04:22.542010 (+ 255us) server_negotiation.cc:299] Negotiation successful
0811 15:04:22.542116 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 15:04:22.542243 32506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:22.537595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.65:35243 (local address 127.19.236.67:54325)
0811 15:04:22.537966 (+ 371us) negotiation.cc:107] Waiting for socket to connect
0811 15:04:22.537978 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 15:04:22.538172 (+ 194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:04:22.538531 (+ 359us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:04:22.538533 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:04:22.538547 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:04:22.538679 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:22.538688 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:22.539665 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:22.539668 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:22.540815 (+ 1147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:04:22.540823 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:04:22.541772 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:04:22.541776 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:04:22.541956 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:22.541982 (+ 26us) client_negotiation.cc:769] Sending connection context
0811 15:04:22.542045 (+ 63us) client_negotiation.cc:240] Negotiation successful
0811 15:04:22.542093 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":299,"mutex_wait_us":37,"spinlock_wait_cycles":768,"thread_start_us":138,"threads_started":1}
I20260811 15:04:22.542272 32495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:22.537738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.67:54325 (local address 127.19.236.65:35243)
0811 15:04:22.537850 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0811 15:04:22.537856 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 15:04:22.538087 (+ 231us) server_negotiation.cc:407] Connection header received
0811 15:04:22.538268 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:04:22.538271 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:04:22.538317 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:04:22.538387 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:04:22.538798 (+ 411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:22.539558 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:22.540930 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:22.541642 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:22.541764 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:22.541825 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 15:04:22.542078 (+ 253us) server_negotiation.cc:299] Negotiation successful
0811 15:04:22.542161 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 15:04:22.542888 32286 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68f8d78aa22f40e2ab5a5a02aa15e830" candidate_uuid: "1e242a0dcc1e44a7bf84052909d249d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb1bd461092c4a55a2e29ac2b791b15a" is_pre_election: true
I20260811 15:04:22.542975 32130 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68f8d78aa22f40e2ab5a5a02aa15e830" candidate_uuid: "1e242a0dcc1e44a7bf84052909d249d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4703eb1cf483481cbc9b08c837b03d99" is_pre_election: true
I20260811 15:04:22.543249 32286 raft_consensus.cc:2454] T 68f8d78aa22f40e2ab5a5a02aa15e830 P bb1bd461092c4a55a2e29ac2b791b15a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e242a0dcc1e44a7bf84052909d249d8 in term 0.
I20260811 15:04:22.543249 32130 raft_consensus.cc:2454] T 68f8d78aa22f40e2ab5a5a02aa15e830 P 4703eb1cf483481cbc9b08c837b03d99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e242a0dcc1e44a7bf84052909d249d8 in term 0.
I20260811 15:04:22.543759 32357 leader_election.cc:302] T 68f8d78aa22f40e2ab5a5a02aa15e830 P 1e242a0dcc1e44a7bf84052909d249d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e242a0dcc1e44a7bf84052909d249d8, bb1bd461092c4a55a2e29ac2b791b15a; no voters:
I20260811 15:04:22.544024 32502 raft_consensus.cc:2781] T 68f8d78aa22f40e2ab5a5a02aa15e830 P 1e242a0dcc1e44a7bf84052909d249d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 15:04:22.544127 32502 raft_consensus.cc:482] T 68f8d78aa22f40e2ab5a5a02aa15e830 P 1e242a0dcc1e44a7bf84052909d249d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 15:04:22.544188 32502 raft_consensus.cc:3037] T 68f8d78aa22f40e2ab5a5a02aa15e830 P 1e242a0dcc1e44a7bf84052909d249d8 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:04:22.545331 32502 raft_consensus.cc:504] T 68f8d78aa22f40e2ab5a5a02aa15e830 P 1e242a0dcc1e44a7bf84052909d249d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb1bd461092c4a55a2e29ac2b791b15a" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 32855 } } peers { permanent_uuid: "4703eb1cf483481cbc9b08c837b03d99" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 35243 } } peers { permanent_uuid: "1e242a0dcc1e44a7bf84052909d249d8" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 40025 } }
I20260811 15:04:22.545703 32502 leader_election.cc:288] T 68f8d78aa22f40e2ab5a5a02aa15e830 P 1e242a0dcc1e44a7bf84052909d249d8 [CANDIDATE]: Term 1 election: Requested vote from peers bb1bd461092c4a55a2e29ac2b791b15a (127.19.236.66:32855), 4703eb1cf483481cbc9b08c837b03d99 (127.19.236.65:35243)
I20260811 15:04:22.546105 32286 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68f8d78aa22f40e2ab5a5a02aa15e830" candidate_uuid: "1e242a0dcc1e44a7bf84052909d249d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb1bd461092c4a55a2e29ac2b791b15a"
I20260811 15:04:22.546151 32130 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68f8d78aa22f40e2ab5a5a02aa15e830" candidate_uuid: "1e242a0dcc1e44a7bf84052909d249d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4703eb1cf483481cbc9b08c837b03d99"
I20260811 15:04:22.546211 32286 raft_consensus.cc:3037] T 68f8d78aa22f40e2ab5a5a02aa15e830 P bb1bd461092c4a55a2e29ac2b791b15a [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:04:22.546325 32130 raft_consensus.cc:3037] T 68f8d78aa22f40e2ab5a5a02aa15e830 P 4703eb1cf483481cbc9b08c837b03d99 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:04:22.547569 32286 raft_consensus.cc:2454] T 68f8d78aa22f40e2ab5a5a02aa15e830 P bb1bd461092c4a55a2e29ac2b791b15a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e242a0dcc1e44a7bf84052909d249d8 in term 1.
I20260811 15:04:22.547840 32130 raft_consensus.cc:2454] T 68f8d78aa22f40e2ab5a5a02aa15e830 P 4703eb1cf483481cbc9b08c837b03d99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e242a0dcc1e44a7bf84052909d249d8 in term 1.
I20260811 15:04:22.547859 32357 leader_election.cc:302] T 68f8d78aa22f40e2ab5a5a02aa15e830 P 1e242a0dcc1e44a7bf84052909d249d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e242a0dcc1e44a7bf84052909d249d8, bb1bd461092c4a55a2e29ac2b791b15a; no voters:
I20260811 15:04:22.548053 32502 raft_consensus.cc:2781] T 68f8d78aa22f40e2ab5a5a02aa15e830 P 1e242a0dcc1e44a7bf84052909d249d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:04:22.548314 32502 raft_consensus.cc:686] T 68f8d78aa22f40e2ab5a5a02aa15e830 P 1e242a0dcc1e44a7bf84052909d249d8 [term 1 LEADER]: Becoming Leader. State: Replica: 1e242a0dcc1e44a7bf84052909d249d8, State: Running, Role: LEADER
I20260811 15:04:22.548760 32502 consensus_queue.cc:237] T 68f8d78aa22f40e2ab5a5a02aa15e830 P 1e242a0dcc1e44a7bf84052909d249d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb1bd461092c4a55a2e29ac2b791b15a" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 32855 } } peers { permanent_uuid: "4703eb1cf483481cbc9b08c837b03d99" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 35243 } } peers { permanent_uuid: "1e242a0dcc1e44a7bf84052909d249d8" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 40025 } }
I20260811 15:04:22.552088 31962 catalog_manager.cc:5495] T 68f8d78aa22f40e2ab5a5a02aa15e830 P 1e242a0dcc1e44a7bf84052909d249d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e242a0dcc1e44a7bf84052909d249d8 (127.19.236.67). New cstate: current_term: 1 leader_uuid: "1e242a0dcc1e44a7bf84052909d249d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb1bd461092c4a55a2e29ac2b791b15a" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 32855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4703eb1cf483481cbc9b08c837b03d99" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 35243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e242a0dcc1e44a7bf84052909d249d8" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 40025 } health_report { overall_health: HEALTHY } } }
I20260811 15:04:22.567118 32494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:22.563127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44786 (local address 127.19.236.67:40025)
0811 15:04:22.563273 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0811 15:04:22.563278 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:04:22.563343 (+ 65us) server_negotiation.cc:407] Connection header received
0811 15:04:22.563486 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:04:22.563489 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:04:22.563558 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:04:22.563654 (+ 96us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 15:04:22.563931 (+ 277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:22.564707 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:22.565594 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:04:22.565813 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:04:22.565920 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:04:22.566288 (+ 368us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 15:04:22.566721 (+ 433us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 15:04:22.566823 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0811 15:04:22.566920 (+ 97us) server_negotiation.cc:299] Negotiation successful
0811 15:04:22.566983 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 15:04:22.573748 32130 raft_consensus.cc:1261] T 68f8d78aa22f40e2ab5a5a02aa15e830 P 4703eb1cf483481cbc9b08c837b03d99 [term 1 FOLLOWER]: Refusing update from remote peer 1e242a0dcc1e44a7bf84052909d249d8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:04:22.573752 32286 raft_consensus.cc:1261] T 68f8d78aa22f40e2ab5a5a02aa15e830 P bb1bd461092c4a55a2e29ac2b791b15a [term 1 FOLLOWER]: Refusing update from remote peer 1e242a0dcc1e44a7bf84052909d249d8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:04:22.574542 32502 consensus_queue.cc:1035] T 68f8d78aa22f40e2ab5a5a02aa15e830 P 1e242a0dcc1e44a7bf84052909d249d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4703eb1cf483481cbc9b08c837b03d99" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 35243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:04:22.574822 32507 consensus_queue.cc:1035] T 68f8d78aa22f40e2ab5a5a02aa15e830 P 1e242a0dcc1e44a7bf84052909d249d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb1bd461092c4a55a2e29ac2b791b15a" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 32855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:04:22.581458 32511 mvcc.cc:205] Tried to move back new op lower bound from 7317342873892917248 to 7317342873803034624. Current Snapshot: MvccSnapshot[applied={T|T < 7317342873892917248}]
I20260811 15:04:22.582245 32513 mvcc.cc:205] Tried to move back new op lower bound from 7317342873892917248 to 7317342873803034624. Current Snapshot: MvccSnapshot[applied={T|T < 7317342873892917248}]
I20260811 15:04:22.585173 32512 mvcc.cc:205] Tried to move back new op lower bound from 7317342873892917248 to 7317342873803034624. Current Snapshot: MvccSnapshot[applied={T|T < 7317342873892917248}]
I20260811 15:04:22.591807 31966 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45070:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 15:04:22.592031 31966 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45070:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 15:04:22.595829 31966 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3658d7635d87428a9f6552a12f3fe127: Sending DeleteTablet for 3 replicas of tablet 68f8d78aa22f40e2ab5a5a02aa15e830
I20260811 15:04:22.596808 32104 tablet_service.cc:1514] Processing DeleteTablet for tablet 68f8d78aa22f40e2ab5a5a02aa15e830 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:04:22 UTC) from {username='kudu', principal='kudu/127.19.236.126@KRBTEST.COM'} at 127.0.0.1:59194
I20260811 15:04:22.597173 32260 tablet_service.cc:1514] Processing DeleteTablet for tablet 68f8d78aa22f40e2ab5a5a02aa15e830 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:04:22 UTC) from {username='kudu', principal='kudu/127.19.236.126@KRBTEST.COM'} at 127.0.0.1:54842
I20260811 15:04:22.597426 32520 tablet_replica.cc:330] T 68f8d78aa22f40e2ab5a5a02aa15e830 P 4703eb1cf483481cbc9b08c837b03d99: stopping tablet replica
I20260811 15:04:22.597795 32520 raft_consensus.cc:2229] T 68f8d78aa22f40e2ab5a5a02aa15e830 P 4703eb1cf483481cbc9b08c837b03d99 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 15:04:22.597873 32407 tablet_service.cc:1514] Processing DeleteTablet for tablet 68f8d78aa22f40e2ab5a5a02aa15e830 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:04:22 UTC) from {username='kudu', principal='kudu/127.19.236.126@KRBTEST.COM'} at 127.0.0.1:44774
I20260811 15:04:22.598184 32520 raft_consensus.cc:2258] T 68f8d78aa22f40e2ab5a5a02aa15e830 P 4703eb1cf483481cbc9b08c837b03d99 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:04:22.598471 32522 tablet_replica.cc:330] T 68f8d78aa22f40e2ab5a5a02aa15e830 P 1e242a0dcc1e44a7bf84052909d249d8: stopping tablet replica
I20260811 15:04:22.598548 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 32037
I20260811 15:04:22.600492 32522 raft_consensus.cc:2229] T 68f8d78aa22f40e2ab5a5a02aa15e830 P 1e242a0dcc1e44a7bf84052909d249d8 [term 1 LEADER]: Raft consensus shutting down.
I20260811 15:04:22.600914 32522 raft_consensus.cc:2258] T 68f8d78aa22f40e2ab5a5a02aa15e830 P 1e242a0dcc1e44a7bf84052909d249d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:04:22.602716 32522 ts_tablet_manager.cc:1905] T 68f8d78aa22f40e2ab5a5a02aa15e830 P 1e242a0dcc1e44a7bf84052909d249d8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 15:04:22.605368 32522 ts_tablet_manager.cc:1918] T 68f8d78aa22f40e2ab5a5a02aa15e830 P 1e242a0dcc1e44a7bf84052909d249d8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 15:04:22.605505 32522 log.cc:1196] T 68f8d78aa22f40e2ab5a5a02aa15e830 P 1e242a0dcc1e44a7bf84052909d249d8: Deleting WAL directory at /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/minicluster-data/ts-2/wal/wals/68f8d78aa22f40e2ab5a5a02aa15e830
I20260811 15:04:22.605850 32522 ts_tablet_manager.cc:1939] T 68f8d78aa22f40e2ab5a5a02aa15e830 P 1e242a0dcc1e44a7bf84052909d249d8: Deleting consensus metadata
I20260811 15:04:22.607100 31950 catalog_manager.cc:4841] TS 1e242a0dcc1e44a7bf84052909d249d8 (127.19.236.67:40025): tablet 68f8d78aa22f40e2ab5a5a02aa15e830 (table test-table [id=5289dd359e0a455ba83812a28e12eaee]) successfully deleted
I20260811 15:04:22.607151 32521 tablet_replica.cc:330] T 68f8d78aa22f40e2ab5a5a02aa15e830 P bb1bd461092c4a55a2e29ac2b791b15a: stopping tablet replica
I20260811 15:04:22.607493 32521 raft_consensus.cc:2229] T 68f8d78aa22f40e2ab5a5a02aa15e830 P bb1bd461092c4a55a2e29ac2b791b15a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 15:04:22.607825 32521 raft_consensus.cc:2258] T 68f8d78aa22f40e2ab5a5a02aa15e830 P bb1bd461092c4a55a2e29ac2b791b15a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:04:22.609222 32521 ts_tablet_manager.cc:1905] T 68f8d78aa22f40e2ab5a5a02aa15e830 P bb1bd461092c4a55a2e29ac2b791b15a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 15:04:22.611521 32521 ts_tablet_manager.cc:1918] T 68f8d78aa22f40e2ab5a5a02aa15e830 P bb1bd461092c4a55a2e29ac2b791b15a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 15:04:22.611662 32521 log.cc:1196] T 68f8d78aa22f40e2ab5a5a02aa15e830 P bb1bd461092c4a55a2e29ac2b791b15a: Deleting WAL directory at /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786460596631409-20401-0/minicluster-data/ts-1/wal/wals/68f8d78aa22f40e2ab5a5a02aa15e830
W20260811 15:04:22.611755 31950 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.19.236.65:35243 (error 108)
I20260811 15:04:22.611953 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 32189
I20260811 15:04:22.616789 32493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:22.616424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.65:35243 (local address 127.0.0.1:59206)
0811 15:04:22.616609 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0811 15:04:22.616691 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.65:35243: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
W20260811 15:04:22.617086 31950 catalog_manager.cc:4584] TS 4703eb1cf483481cbc9b08c837b03d99 (127.19.236.65:35243): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 68f8d78aa22f40e2ab5a5a02aa15e830: Network error: Client connection negotiation failed: client connection to 127.19.236.65:35243: connect: Connection refused (error 111)
I20260811 15:04:22.621716 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 32340
I20260811 15:04:22.621927 32493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:04:22.621602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.66:32855 (local address 127.0.0.1:54846)
0811 15:04:22.621742 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0811 15:04:22.621829 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.66:32855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260811 15:04:22.633571 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 31930
2026-08-11T15:04:22Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2358 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 15:04:22 dist-test-slave-8n49 krb5kdc[32527](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 15:04:22 dist-test-slave-8n49 krb5kdc[32527](info): set up 2 sockets
Aug 11 15:04:22 dist-test-slave-8n49 krb5kdc[32527](info): commencing operation
krb5kdc: starting...
W20260811 15:04:23.761500 20401 mini_kdc.cc:121] Time spent starting KDC: real 1.103s user 0.006s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/krb5kdc/test-user.keytab.
Aug 11 15:04:23 dist-test-slave-8n49 krb5kdc[32527](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460663, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T15:04:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T15:04:23Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.19.236.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.19.236.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.19.236.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/krb5kdc/rangeradmin_127.19.236.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.19.236.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/krb5kdc/rangeradmin_127.19.236.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.19.236.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.19.236.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.19.236.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/krb5kdc/rangerlookup_127.19.236.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.19.236.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/krb5kdc/rangerlookup_127.19.236.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.19.236.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.19.236.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.19.236.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/krb5kdc/HTTP_127.19.236.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.19.236.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/krb5kdc/HTTP_127.19.236.84@KRBTEST.COM.keytab.
I20260811 15:04:23.963904 20401 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskAUi0lq/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/minicluster-data/postgres -l logfile start
2026-08-11 15:04:26.652 UTC [32557] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-11 15:04:26.653 UTC [32557] LOG: listening on IPv4 address "127.19.236.84", port 38637
2026-08-11 15:04:26.657 UTC [32557] LOG: listening on Unix socket "/tmp/.s.PGSQL.38637"
2026-08-11 15:04:26.688 UTC [32560] LOG: database system was shut down at 2026-08-11 15:04:25 UTC
2026-08-11 15:04:26.692 UTC [32557] LOG: database system is ready to accept connections
I20260811 15:04:27.750394 20401 mini_postgres.cc:96] Postgres bound to 38637
2026-08-11 15:04:27.761 UTC [32570] FATAL: database "slave" does not exist
127.19.236.84:38637 - accepting connections
I20260811 15:04:27.762472 20401 mini_ranger.cc:161] Starting Ranger...
I20260811 15:04:27.779949 20401 mini_ranger.cc:84] Created miniranger Postgres user
I20260811 15:04:28.307716 20401 mini_ranger.cc:87] Created ranger Postgres database
I20260811 15:04:28.307824 20401 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/minicluster-data/ranger-admin
2026-08-11 15:04:28,711 [I] DB FLAVOR :POSTGRES
2026-08-11 15:04:28,711 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 15:04:28,711 [I] Checking connection..
2026-08-11 15:04:28,711 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAUi0lq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAUi0lq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.236.84:38637/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-11 15:04:29,005 [I] Checking connection passed.
2026-08-11 15:04:29,005 [I] --------- Verifying version history table ---------
2026-08-11 15:04:29,005 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAUi0lq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAUi0lq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.236.84:38637/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 15:04:29,252 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 15:04:29,253 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAUi0lq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAUi0lq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.236.84:38637/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 15:04:29,496 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 15:04:29,497 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-11 15:04:29,497 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAUi0lq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAUi0lq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.236.84:38637/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskAUi0lq/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-11 15:04:29.743 UTC [32644] WARNING: there is no transaction in progress
2026-08-11 15:04:29,751 [I] create_dbversion_catalog.sql file imported successfully
2026-08-11 15:04:29,751 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAUi0lq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAUi0lq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.236.84:38637/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 15:04:30,003 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-11 15:04:30,003 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 15:04:30,004 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAUi0lq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAUi0lq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.236.84:38637/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-11 15:04:30,266 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAUi0lq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAUi0lq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.236.84:38637/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-11 15:04:30,515 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAUi0lq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAUi0lq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.236.84:38637/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-8n49.c.gcp-upstream.internal','N') ;"
2026-08-11 15:04:30,777 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAUi0lq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAUi0lq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.236.84:38637/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 15:04:31,030 [I] Table x_portal_user does not exist in database ranger
2026-08-11 15:04:31,031 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAUi0lq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAUi0lq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.236.84:38637/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 15:04:31,286 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-11 15:04:31,286 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAUi0lq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAUi0lq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.236.84:38637/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 15:04:31,543 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAUi0lq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAUi0lq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.236.84:38637/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 15:04:31,795 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-11 15:04:31,795 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAUi0lq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAUi0lq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.236.84:38637/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskAUi0lq/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-11 15:04:32.791 UTC [32766] WARNING: there is no transaction in progress
2026-08-11 15:04:32.808 UTC [32766] WARNING: there is no transaction in progress
2026-08-11 15:04:32.825 UTC [32766] WARNING: there is no transaction in progress
2026-08-11 15:04:32.842 UTC [32766] WARNING: there is no transaction in progress
2026-08-11 15:04:32.859 UTC [32766] WARNING: there is no transaction in progress
2026-08-11 15:04:32.879 UTC [32766] WARNING: there is no transaction in progress
2026-08-11 15:04:32.941 UTC [32766] WARNING: there is no transaction in progress
2026-08-11 15:04:32.949 UTC [32766] WARNING: there is no transaction in progress
2026-08-11 15:04:32.965 UTC [32766] WARNING: there is no transaction in progress
2026-08-11 15:04:32.977 UTC [32766] WARNING: there is no transaction in progress
2026-08-11 15:04:32.989 UTC [32766] WARNING: there is no transaction in progress
2026-08-11 15:04:33.003 UTC [32766] WARNING: there is no transaction in progress
2026-08-11 15:04:33.013 UTC [32766] WARNING: there is no transaction in progress
2026-08-11 15:04:33.020 UTC [32766] WARNING: there is no transaction in progress
2026-08-11 15:04:33.027 UTC [32766] WARNING: there is no transaction in progress
2026-08-11 15:04:33.035 UTC [32766] WARNING: there is no transaction in progress
2026-08-11 15:04:33,737 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-11 15:04:33,737 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAUi0lq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAUi0lq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.236.84:38637/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-11 15:04:33,980 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-11 15:04:33,980 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAUi0lq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAUi0lq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.236.84:38637/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 15:04:34,231 [I] Table x_portal_user already exists in database 'ranger'
2026-08-11 15:04:34,232 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAUi0lq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAUi0lq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.236.84:38637/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 15:04:34,462 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-11 15:04:34,462 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAUi0lq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAUi0lq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.236.84:38637/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 15:04:34,695 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAUi0lq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAUi0lq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.236.84:38637/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 15:04:34,927 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAUi0lq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAUi0lq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.236.84:38637/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-8n49.c.gcp-upstream.internal';"
2026-08-11 15:04:35,164 [I] CORE_DB_SCHEMA import status has been updated
2026-08-11 15:04:35,165 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAUi0lq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAUi0lq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.236.84:38637/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-11 15:04:35,433 [I] DB_PATCHES have already been applied
I20260811 15:04:35.439131 20401 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/minicluster-data/ranger-admin:/tmp/dist-test-taskAUi0lq/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskAUi0lq/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskAUi0lq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAUi0lq/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260811 15:04:35.439234 20401 mini_ranger.cc:193] Using host: 127.19.236.84
I20260811 15:04:35.443573 20401 mini_ranger.cc:227] Ranger admin URL: http://127.19.236.84:53549
Aug 11, 2026 3:04:35 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 3:04:35 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 3:04:36 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/minicluster-data/ranger-admin/ews/webapp
Aug 11, 2026 3:04:36 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 11, 2026 3:04:36 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 11, 2026 3:04:36 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/minicluster-data/ranger-admin/ews/webapp].
Aug 11, 2026 3:04:36 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260811 15:04:36.683468 20401 mini_ranger.cc:160] Time spent starting Ranger: real 8.921s user 0.001s sys 0.013s
Aug 11, 2026 3:04:57 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 11, 2026 3:04:57 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Aug 11, 2026 3:04:57 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 11, 2026 3:04:57 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 11, 2026 3:04:57 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 11, 2026 3:04:57 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 11, 2026 3:04:57 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 11, 2026 3:04:57 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 11, 2026 3:04:57 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 11, 2026 3:04:57 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 11, 2026 3:04:57 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 11, 2026 3:04:57 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 11, 2026 3:04:57 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 11, 2026 3:04:57 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 11, 2026 3:04:57 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 11, 2026 3:04:57 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 11, 2026 3:04:57 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 11, 2026 3:04:58 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260811 15:04:58.833465 20401 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.19.236.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.19.236.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.19.236.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/krb5kdc/rangerkms_127.19.236.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.19.236.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/krb5kdc/rangerkms_127.19.236.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.19.236.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.19.236.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.19.236.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/krb5kdc/HTTP_127.19.236.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.19.236.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/krb5kdc/HTTP_127.19.236.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 11 15:04:58 dist-test-slave-8n49 krb5kdc[32527](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460698, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260811 15:04:58.945948 20401 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260811 15:04:58.957950 20401 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260811 15:04:59.884948 20401 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260811 15:04:59.885053 20401 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/minicluster-data/ranger-kms
I20260811 15:04:59.885157 20401 mini_ranger_kms.cc:227] Using postgres at 127.19.236.84:38637
2026-08-11 15:05:00,131 [I] DB FLAVOR :POSTGRES
2026-08-11 15:05:00,131 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 15:05:00,132 [I] Checking connection
2026-08-11 15:05:00,132 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAUi0lq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.236.84:38637/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-11 15:05:00,393 [I] connection success
2026-08-11 15:05:00,393 [I] --------- Verifying Ranger DB tables ---------
2026-08-11 15:05:00,393 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-11 15:05:00,393 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAUi0lq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.236.84:38637/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-11 15:05:00,635 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-11 15:05:00,635 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 15:05:00,636 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-11 15:05:00,636 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAUi0lq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.236.84:38637/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-11 15:05:00,900 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260811 15:05:01.355537 20401 mini_ranger_kms.cc:310] Created kms service
I20260811 15:05:01.575290 20401 mini_ranger_kms.cc:326] Created kudu user
I20260811 15:05:01.619676 20401 mini_ranger_kms.cc:343] Created rangerkms user
Aug 11 15:05:01 dist-test-slave-8n49 krb5kdc[32527](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460698, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.19.236.84@KRBTEST.COM
I20260811 15:05:02.015386 20401 mini_ranger_kms.cc:384] Added ranger policy
I20260811 15:05:02.015551 20401 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/minicluster-data/ranger-kms:/tmp/dist-test-taskAUi0lq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAUi0lq/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskAUi0lq/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260811 15:05:02.015578 20401 mini_ranger_kms.cc:240] Using host: 127.19.236.84
I20260811 15:05:02.020781 20401 mini_ranger_kms.cc:276] Ranger KMS PID: 498
I20260811 15:05:02.020923 20401 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.19.236.84:44959
Aug 11, 2026 3:05:03 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 3:05:03 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 3:05:03 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 11, 2026 3:05:03 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 11, 2026 3:05:03 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/minicluster-data/ranger-kms/ews/webapp].
Aug 11, 2026 3:05:03 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260811 15:05:04.487911 20401 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.542s user 0.017s sys 0.214s
I20260811 15:05:04.488062 20401 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260811 15:05:04.488176 20401 mini_ranger_kms.cc:401] 127.19.236.84:44959/kms/v1/keys
Aug 11 15:05:04 dist-test-slave-8n49 krb5kdc[32527](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786460704, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.19.236.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 11 15:05:05 dist-test-slave-8n49 krb5kdc[32527](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460704, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.19.236.84@KRBTEST.COM for HTTP/127.19.236.84@KRBTEST.COM
Aug 11 15:05:05 dist-test-slave-8n49 krb5kdc[32527](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460704, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.19.236.84@KRBTEST.COM for HTTP/127.19.236.84@KRBTEST.COM
Aug 11 15:05:07 dist-test-slave-8n49 krb5kdc[32527](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460707, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.19.236.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.236.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.236.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab.
Entry for principal kudu/127.19.236.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab.
I20260811 15:05:07.741955 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:34777
--webserver_interface=127.19.236.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab
--principal=kudu/127.19.236.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:33179
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.236.126:34777
--ranger_config_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.19.236.84:44959/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:05:07.862528 554 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:05:07.862804 554 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:05:07.862845 554 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:05:07.867028 554 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:05:07.867100 554 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:05:07.867120 554 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:05:07.867137 554 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:05:07.867152 554 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:05:07.872959 554 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:33179
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/minicluster-data/master-0/wal
--ranger_kms_url=127.19.236.84:44959/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.19.236.126:34777
--ranger_config_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab
--principal=kudu/127.19.236.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:34777
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.236.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.554
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:05:07.874099 554 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:05:07.875187 554 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:05:07.884593 560 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:05:07.884618 559 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:05:07.884608 562 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:05:07.884661 554 server_base.cc:1034] running on GCE node
I20260811 15:05:07.885453 554 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:05:07.886634 554 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:05:07.887816 554 hybrid_clock.cc:648] HybridClock initialized: now 1786460707887791 us; error 38 us; skew 500 ppm
Aug 11 15:05:07 dist-test-slave-8n49 krb5kdc[32527](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460707, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:05:07.890741 554 init.cc:377] Logged in from keytab as kudu/127.19.236.126@KRBTEST.COM (short username kudu)
I20260811 15:05:07.891750 554 webserver.cc:460] Webserver started at http://127.19.236.126:39817/ using document root <none> and password file <none>
I20260811 15:05:07.892304 554 fs_manager.cc:359] Metadata directory not provided
I20260811 15:05:07.892359 554 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:05:07.892655 554 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 15:05:07 dist-test-slave-8n49 krb5kdc[32527](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460707, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.126@KRBTEST.COM for HTTP/127.19.236.84@KRBTEST.COM
I20260811 15:05:07.953370 554 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/minicluster-data/master-0/data/instance:
uuid: "6bbdddb63b3d4a03bc5fe2cafc58bcbf"
format_stamp: "Formatted at 2026-08-11 15:05:07 on dist-test-slave-8n49"
server_key: "360230e517168dd7c09ec69318d7f663"
server_key_iv: "91abaaec037e0c36cd0a3944533bf62d"
server_key_version: "kuduclusterkey@0"
I20260811 15:05:07.954125 554 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/minicluster-data/master-0/wal/instance:
uuid: "6bbdddb63b3d4a03bc5fe2cafc58bcbf"
format_stamp: "Formatted at 2026-08-11 15:05:07 on dist-test-slave-8n49"
server_key: "360230e517168dd7c09ec69318d7f663"
server_key_iv: "91abaaec037e0c36cd0a3944533bf62d"
server_key_version: "kuduclusterkey@0"
I20260811 15:05:07.958349 554 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260811 15:05:07.976822 570 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:05:07.978264 554 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 15:05:07.978405 554 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/minicluster-data/master-0/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/minicluster-data/master-0/wal
uuid: "6bbdddb63b3d4a03bc5fe2cafc58bcbf"
format_stamp: "Formatted at 2026-08-11 15:05:07 on dist-test-slave-8n49"
server_key: "360230e517168dd7c09ec69318d7f663"
server_key_iv: "91abaaec037e0c36cd0a3944533bf62d"
server_key_version: "kuduclusterkey@0"
I20260811 15:05:07.978552 554 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:05:07.991091 554 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:05:07.993989 554 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:05:07.994190 554 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:05:08.002707 554 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.126:34777
I20260811 15:05:08.002759 628 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.126:34777 every 8 connection(s)
I20260811 15:05:08.003778 554 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
I20260811 15:05:08.007352 629 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:05:08.011894 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 554
I20260811 15:05:08.012050 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/minicluster-data/master-0/wal/instance
I20260811 15:05:08.012349 20401 external_mini_cluster.cc:1428] Setting key 1c281acf3d3ca7fdeab4ecb932fddc49
I20260811 15:05:08.014879 629 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6bbdddb63b3d4a03bc5fe2cafc58bcbf: Bootstrap starting.
I20260811 15:05:08.017613 629 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6bbdddb63b3d4a03bc5fe2cafc58bcbf: Neither blocks nor log segments found. Creating new log.
I20260811 15:05:08.018522 629 log.cc:824] T 00000000000000000000000000000000 P 6bbdddb63b3d4a03bc5fe2cafc58bcbf: Log is configured to *not* fsync() on all Append() calls
I20260811 15:05:08.020597 629 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6bbdddb63b3d4a03bc5fe2cafc58bcbf: No bootstrap required, opened a new log
Aug 11 15:05:08 dist-test-slave-8n49 krb5kdc[32527](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460707, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
I20260811 15:05:08.025424 629 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6bbdddb63b3d4a03bc5fe2cafc58bcbf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6bbdddb63b3d4a03bc5fe2cafc58bcbf" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 34777 } }
I20260811 15:05:08.025720 629 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6bbdddb63b3d4a03bc5fe2cafc58bcbf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:05:08.025808 629 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6bbdddb63b3d4a03bc5fe2cafc58bcbf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6bbdddb63b3d4a03bc5fe2cafc58bcbf, State: Initialized, Role: FOLLOWER
I20260811 15:05:08.026307 629 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6bbdddb63b3d4a03bc5fe2cafc58bcbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6bbdddb63b3d4a03bc5fe2cafc58bcbf" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 34777 } }
I20260811 15:05:08.026614 629 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6bbdddb63b3d4a03bc5fe2cafc58bcbf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 15:05:08.026743 629 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6bbdddb63b3d4a03bc5fe2cafc58bcbf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 15:05:08.026896 629 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6bbdddb63b3d4a03bc5fe2cafc58bcbf [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:05:08.027802 632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:05:08.013901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39472 (local address 127.19.236.126:34777)
0811 15:05:08.014332 (+ 431us) server_negotiation.cc:206] Beginning negotiation
0811 15:05:08.014350 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 15:05:08.014386 (+ 36us) server_negotiation.cc:407] Connection header received
0811 15:05:08.015065 (+ 679us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:05:08.015090 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:05:08.015414 (+ 324us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:05:08.015745 (+ 331us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:05:08.016525 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:05:08.017556 (+ 1031us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:05:08.018413 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:05:08.018986 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:05:08.019168 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:05:08.022395 (+ 3227us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:05:08.022405 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:05:08.022427 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:05:08.022467 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:05:08.024585 (+ 2118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:05:08.025113 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:05:08.025119 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:05:08.025125 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:05:08.025255 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:05:08.025552 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:05:08.025556 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:05:08.025557 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:05:08.026091 (+ 534us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:05:08.026294 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0811 15:05:08.026557 (+ 263us) server_negotiation.cc:299] Negotiation successful
0811 15:05:08.026850 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":280,"thread_start_us":152,"threads_started":1}
I20260811 15:05:08.028018 629 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6bbdddb63b3d4a03bc5fe2cafc58bcbf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6bbdddb63b3d4a03bc5fe2cafc58bcbf" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 34777 } }
I20260811 15:05:08.028400 629 leader_election.cc:302] T 00000000000000000000000000000000 P 6bbdddb63b3d4a03bc5fe2cafc58bcbf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6bbdddb63b3d4a03bc5fe2cafc58bcbf; no voters:
I20260811 15:05:08.028784 629 leader_election.cc:288] T 00000000000000000000000000000000 P 6bbdddb63b3d4a03bc5fe2cafc58bcbf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 15:05:08.028928 634 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6bbdddb63b3d4a03bc5fe2cafc58bcbf [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:05:08.029193 634 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6bbdddb63b3d4a03bc5fe2cafc58bcbf [term 1 LEADER]: Becoming Leader. State: Replica: 6bbdddb63b3d4a03bc5fe2cafc58bcbf, State: Running, Role: LEADER
I20260811 15:05:08.029532 634 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6bbdddb63b3d4a03bc5fe2cafc58bcbf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6bbdddb63b3d4a03bc5fe2cafc58bcbf" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 34777 } }
I20260811 15:05:08.030141 629 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6bbdddb63b3d4a03bc5fe2cafc58bcbf [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:05:08.031042 634 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6bbdddb63b3d4a03bc5fe2cafc58bcbf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6bbdddb63b3d4a03bc5fe2cafc58bcbf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6bbdddb63b3d4a03bc5fe2cafc58bcbf" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 34777 } } }
I20260811 15:05:08.031225 634 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6bbdddb63b3d4a03bc5fe2cafc58bcbf [sys.catalog]: This master's current role is: LEADER
I20260811 15:05:08.031427 634 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6bbdddb63b3d4a03bc5fe2cafc58bcbf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6bbdddb63b3d4a03bc5fe2cafc58bcbf. Latest consensus state: current_term: 1 leader_uuid: "6bbdddb63b3d4a03bc5fe2cafc58bcbf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6bbdddb63b3d4a03bc5fe2cafc58bcbf" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 34777 } } }
I20260811 15:05:08.031558 634 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6bbdddb63b3d4a03bc5fe2cafc58bcbf [sys.catalog]: This master's current role is: LEADER
I20260811 15:05:08.031596 643 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:05:08.034957 643 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:05:08.035495 629 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260811 15:05:08.051697 643 catalog_manager.cc:1347] Generated new cluster ID: 20eef2dc6fd541069bceae4c2e413ca7
I20260811 15:05:08.051911 643 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:05:08.071230 643 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 15:05:08.072854 643 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:05:08.080511 643 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6bbdddb63b3d4a03bc5fe2cafc58bcbf: Generated new TSK 0
I20260811 15:05:08.081570 643 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.236.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.236.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.236.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.65.keytab.
Entry for principal kudu/127.19.236.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.65.keytab.
I20260811 15:05:08.788059 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.19.236.84:44959/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.65:0
--local_ip_for_outbound_sockets=127.19.236.65
--webserver_interface=127.19.236.65
--webserver_port=0
--tserver_master_addrs=127.19.236.126:34777
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.65.keytab
--principal=kudu/127.19.236.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:33179
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:05:08.944114 676 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:05:08.944526 676 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:05:08.944618 676 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:05:08.951027 676 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:05:08.951141 676 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:05:08.951237 676 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.65
I20260811 15:05:08.959699 676 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:33179
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.19.236.84:44959/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.65.keytab
--principal=kudu/127.19.236.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.236.65
--webserver_port=0
--tserver_master_addrs=127.19.236.126:34777
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.676
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.65
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:05:08.961262 676 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:05:08.962726 676 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:05:08.974870 683 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:05:08.974884 684 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:05:08.975036 686 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:05:08.975278 676 server_base.cc:1034] running on GCE node
I20260811 15:05:08.975818 676 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:05:08.976625 676 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:05:08.977859 676 hybrid_clock.cc:648] HybridClock initialized: now 1786460708977833 us; error 53 us; skew 500 ppm
Aug 11 15:05:08 dist-test-slave-8n49 krb5kdc[32527](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460708, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:05:08.980939 676 init.cc:377] Logged in from keytab as kudu/127.19.236.65@KRBTEST.COM (short username kudu)
I20260811 15:05:08.981948 676 webserver.cc:460] Webserver started at http://127.19.236.65:44087/ using document root <none> and password file <none>
I20260811 15:05:08.982650 676 fs_manager.cc:359] Metadata directory not provided
I20260811 15:05:08.982741 676 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:05:08.982976 676 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 15:05:08 dist-test-slave-8n49 krb5kdc[32527](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460708, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.65@KRBTEST.COM for HTTP/127.19.236.84@KRBTEST.COM
I20260811 15:05:09.027097 676 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/minicluster-data/ts-0/data/instance:
uuid: "7732dccc881d49d0b42e040677995555"
format_stamp: "Formatted at 2026-08-11 15:05:09 on dist-test-slave-8n49"
server_key: "ae2b919b8b7decdc454f47be123493c9"
server_key_iv: "7911cac45dd6d9d28fae64a15389c2fa"
server_key_version: "kuduclusterkey@0"
I20260811 15:05:09.028093 676 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/minicluster-data/ts-0/wal/instance:
uuid: "7732dccc881d49d0b42e040677995555"
format_stamp: "Formatted at 2026-08-11 15:05:09 on dist-test-slave-8n49"
server_key: "ae2b919b8b7decdc454f47be123493c9"
server_key_iv: "7911cac45dd6d9d28fae64a15389c2fa"
server_key_version: "kuduclusterkey@0"
I20260811 15:05:09.033830 676 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.003s
I20260811 15:05:09.050238 695 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:05:09.051913 676 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 15:05:09.052048 676 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/minicluster-data/ts-0/wal
uuid: "7732dccc881d49d0b42e040677995555"
format_stamp: "Formatted at 2026-08-11 15:05:09 on dist-test-slave-8n49"
server_key: "ae2b919b8b7decdc454f47be123493c9"
server_key_iv: "7911cac45dd6d9d28fae64a15389c2fa"
server_key_version: "kuduclusterkey@0"
I20260811 15:05:09.052189 676 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:05:09.078578 676 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:05:09.082243 676 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:05:09.082479 676 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:05:09.083211 676 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:05:09.084287 676 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:05:09.084363 676 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:05:09.084466 676 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:05:09.084502 676 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:05:09.097260 676 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.65:42387
I20260811 15:05:09.097280 820 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.65:42387 every 8 connection(s)
I20260811 15:05:09.098654 676 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
I20260811 15:05:09.098923 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 676
I20260811 15:05:09.099071 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/minicluster-data/ts-0/wal/instance
I20260811 15:05:09.099437 20401 external_mini_cluster.cc:1428] Setting key 8401bbb1a157c6f66f656d94381eb9e3
Aug 11 15:05:09 dist-test-slave-8n49 krb5kdc[32527](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460708, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.65@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
Aug 11 15:05:09 dist-test-slave-8n49 krb5kdc[32527](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786460709, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
WARNING: no policy specified for kudu/127.19.236.66@KRBTEST.COM; defaulting to no policy
I20260811 15:05:09.117291 824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:05:09.101501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.65:54223 (local address 127.19.236.126:34777)
0811 15:05:09.101823 (+ 322us) server_negotiation.cc:206] Beginning negotiation
0811 15:05:09.101829 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 15:05:09.102710 (+ 881us) server_negotiation.cc:407] Connection header received
0811 15:05:09.103879 (+ 1169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:05:09.103883 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:05:09.103949 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:05:09.104039 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:05:09.105562 (+ 1523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:05:09.106481 (+ 919us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:05:09.107764 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:05:09.108171 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:05:09.108295 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:05:09.112004 (+ 3709us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:05:09.112011 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:05:09.112017 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:05:09.112057 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:05:09.114273 (+ 2216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:05:09.115160 (+ 887us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:05:09.115164 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:05:09.115166 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:05:09.115283 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:05:09.115814 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:05:09.115818 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:05:09.115820 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:05:09.116038 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:05:09.116177 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0811 15:05:09.116941 (+ 764us) server_negotiation.cc:299] Negotiation successful
0811 15:05:09.117099 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":232,"thread_start_us":110,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.236.66@KRBTEST.COM" created.
I20260811 15:05:09.118440 825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:05:09.102041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:34777 (local address 127.19.236.65:54223)
0811 15:05:09.102553 (+ 512us) negotiation.cc:107] Waiting for socket to connect
0811 15:05:09.102609 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0811 15:05:09.103614 (+ 1005us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:05:09.104247 (+ 633us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:05:09.104255 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:05:09.104544 (+ 289us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:05:09.105362 (+ 818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:05:09.105387 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:05:09.106674 (+ 1287us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:05:09.106680 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:05:09.107625 (+ 945us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:05:09.107634 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:05:09.108520 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:05:09.108526 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:05:09.108816 (+ 290us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:05:09.109632 (+ 816us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:05:09.109663 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:05:09.111730 (+ 2067us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:05:09.114579 (+ 2849us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:05:09.114590 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:05:09.114614 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:05:09.115028 (+ 414us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:05:09.115427 (+ 399us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:05:09.115433 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:05:09.115436 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:05:09.115677 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:05:09.116177 (+ 500us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:05:09.116185 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:05:09.116663 (+ 478us) client_negotiation.cc:769] Sending connection context
0811 15:05:09.116899 (+ 236us) client_negotiation.cc:240] Negotiation successful
0811 15:05:09.117266 (+ 367us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":291,"thread_start_us":147,"threads_started":1}
I20260811 15:05:09.120311 821 heartbeater.cc:347] Connected to a master server at 127.19.236.126:34777
I20260811 15:05:09.120676 821 heartbeater.cc:464] Registering TS with master...
I20260811 15:05:09.121330 821 heartbeater.cc:511] Master 127.19.236.126:34777 requested a full tablet report, sending...
I20260811 15:05:09.123155 588 ts_manager.cc:194] Registered new tserver with Master: 7732dccc881d49d0b42e040677995555 (127.19.236.65:42387)
I20260811 15:05:09.124943 588 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.236.65@KRBTEST.COM'} at 127.19.236.65:54223
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.236.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.66.keytab.
Entry for principal kudu/127.19.236.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.66.keytab.
I20260811 15:05:09.145454 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.19.236.84:44959/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.66:0
--local_ip_for_outbound_sockets=127.19.236.66
--webserver_interface=127.19.236.66
--webserver_port=0
--tserver_master_addrs=127.19.236.126:34777
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.66.keytab
--principal=kudu/127.19.236.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:33179
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:05:09.306670 828 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:05:09.307017 828 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:05:09.307121 828 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:05:09.311700 828 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:05:09.311817 828 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:05:09.311916 828 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.66
I20260811 15:05:09.318198 828 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:33179
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.19.236.84:44959/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.66.keytab
--principal=kudu/127.19.236.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.236.66
--webserver_port=0
--tserver_master_addrs=127.19.236.126:34777
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.828
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.66
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:05:09.319495 828 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:05:09.320699 828 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:05:09.332829 836 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:05:09.333494 838 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:05:09.333698 828 server_base.cc:1034] running on GCE node
W20260811 15:05:09.333936 834 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:05:09.334539 828 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:05:09.335366 828 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:05:09.338709 828 hybrid_clock.cc:648] HybridClock initialized: now 1786460709338657 us; error 51 us; skew 500 ppm
Aug 11 15:05:09 dist-test-slave-8n49 krb5kdc[32527](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460709, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:05:09.342859 828 init.cc:377] Logged in from keytab as kudu/127.19.236.66@KRBTEST.COM (short username kudu)
I20260811 15:05:09.344131 828 webserver.cc:460] Webserver started at http://127.19.236.66:35397/ using document root <none> and password file <none>
I20260811 15:05:09.344967 828 fs_manager.cc:359] Metadata directory not provided
I20260811 15:05:09.345079 828 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:05:09.345417 828 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 15:05:09 dist-test-slave-8n49 krb5kdc[32527](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460709, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.66@KRBTEST.COM for HTTP/127.19.236.84@KRBTEST.COM
I20260811 15:05:09.362659 828 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/minicluster-data/ts-1/data/instance:
uuid: "eefc04eee0f242078caf492bd2a2ccc6"
format_stamp: "Formatted at 2026-08-11 15:05:09 on dist-test-slave-8n49"
server_key: "ae9305f5e23fed6df512817448bc8068"
server_key_iv: "e55c6a717347929aa308b721d58455e6"
server_key_version: "kuduclusterkey@0"
I20260811 15:05:09.363540 828 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/minicluster-data/ts-1/wal/instance:
uuid: "eefc04eee0f242078caf492bd2a2ccc6"
format_stamp: "Formatted at 2026-08-11 15:05:09 on dist-test-slave-8n49"
server_key: "ae9305f5e23fed6df512817448bc8068"
server_key_iv: "e55c6a717347929aa308b721d58455e6"
server_key_version: "kuduclusterkey@0"
I20260811 15:05:09.369053 828 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s
I20260811 15:05:09.387176 845 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:05:09.388834 828 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.004s sys 0.000s
I20260811 15:05:09.388996 828 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/minicluster-data/ts-1/wal
uuid: "eefc04eee0f242078caf492bd2a2ccc6"
format_stamp: "Formatted at 2026-08-11 15:05:09 on dist-test-slave-8n49"
server_key: "ae9305f5e23fed6df512817448bc8068"
server_key_iv: "e55c6a717347929aa308b721d58455e6"
server_key_version: "kuduclusterkey@0"
I20260811 15:05:09.389154 828 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:05:09.410136 828 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:05:09.414393 828 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:05:09.414680 828 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:05:09.415504 828 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:05:09.416692 828 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:05:09.416812 828 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:05:09.416915 828 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:05:09.416989 828 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:05:09.428921 828 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.66:43519
I20260811 15:05:09.430222 828 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
I20260811 15:05:09.431269 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 828
I20260811 15:05:09.431430 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/minicluster-data/ts-1/wal/instance
I20260811 15:05:09.431756 20401 external_mini_cluster.cc:1428] Setting key 84b92fdfc815c747df38ab5e6296aa42
I20260811 15:05:09.429005 971 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.66:43519 every 8 connection(s)
Aug 11 15:05:09 dist-test-slave-8n49 krb5kdc[32527](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460709, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.66@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.19.236.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.236.67@KRBTEST.COM" created.
I20260811 15:05:09.461022 824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:05:09.444827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.66:46259 (local address 127.19.236.126:34777)
0811 15:05:09.444983 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0811 15:05:09.444988 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:05:09.445246 (+ 258us) server_negotiation.cc:407] Connection header received
0811 15:05:09.446482 (+ 1236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:05:09.446486 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:05:09.446559 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:05:09.446643 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:05:09.448307 (+ 1664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:05:09.449394 (+ 1087us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:05:09.451229 (+ 1835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:05:09.451631 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:05:09.451749 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:05:09.455954 (+ 4205us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:05:09.455959 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:05:09.455963 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:05:09.455996 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:05:09.458221 (+ 2225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:05:09.459001 (+ 780us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:05:09.459006 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:05:09.459008 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:05:09.459103 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:05:09.459560 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:05:09.459564 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:05:09.459566 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:05:09.459811 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:05:09.459887 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 15:05:09.460693 (+ 806us) server_negotiation.cc:299] Negotiation successful
0811 15:05:09.460842 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260811 15:05:09.462829 975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:05:09.443548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:34777 (local address 127.19.236.66:46259)
0811 15:05:09.445072 (+ 1524us) negotiation.cc:107] Waiting for socket to connect
0811 15:05:09.445135 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0811 15:05:09.446229 (+ 1094us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:05:09.446985 (+ 756us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:05:09.446997 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:05:09.447390 (+ 393us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:05:09.448113 (+ 723us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:05:09.448137 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:05:09.449601 (+ 1464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:05:09.449605 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:05:09.451061 (+ 1456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:05:09.451076 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:05:09.452623 (+ 1547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:05:09.452629 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:05:09.452847 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:05:09.453606 (+ 759us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:05:09.453630 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:05:09.455701 (+ 2071us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:05:09.458369 (+ 2668us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:05:09.458377 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:05:09.458397 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:05:09.458805 (+ 408us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:05:09.459223 (+ 418us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:05:09.459226 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:05:09.459228 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:05:09.459424 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:05:09.459977 (+ 553us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:05:09.459984 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:05:09.460340 (+ 356us) client_negotiation.cc:769] Sending connection context
0811 15:05:09.461276 (+ 936us) client_negotiation.cc:240] Negotiation successful
0811 15:05:09.461664 (+ 388us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1271,"thread_start_us":169,"threads_started":1}
I20260811 15:05:09.464236 972 heartbeater.cc:347] Connected to a master server at 127.19.236.126:34777
I20260811 15:05:09.464522 972 heartbeater.cc:464] Registering TS with master...
I20260811 15:05:09.465219 972 heartbeater.cc:511] Master 127.19.236.126:34777 requested a full tablet report, sending...
I20260811 15:05:09.466512 588 ts_manager.cc:194] Registered new tserver with Master: eefc04eee0f242078caf492bd2a2ccc6 (127.19.236.66:43519)
I20260811 15:05:09.467415 588 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.236.66@KRBTEST.COM'} at 127.19.236.66:46259
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.236.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.67.keytab.
Entry for principal kudu/127.19.236.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.67.keytab.
I20260811 15:05:09.483736 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.19.236.84:44959/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.67:0
--local_ip_for_outbound_sockets=127.19.236.67
--webserver_interface=127.19.236.67
--webserver_port=0
--tserver_master_addrs=127.19.236.126:34777
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.67.keytab
--principal=kudu/127.19.236.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:33179
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 15:05:09 dist-test-slave-8n49 krb5kdc[32527](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460709, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.126@KRBTEST.COM for HTTP/127.19.236.84@KRBTEST.COM
W20260811 15:05:09.645591 977 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:05:09.646021 977 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:05:09.646111 977 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:05:09.652341 977 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:05:09.652460 977 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:05:09.652577 977 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.67
I20260811 15:05:09.660708 977 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:33179
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.19.236.84:44959/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.67.keytab
--principal=kudu/127.19.236.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.236.67
--webserver_port=0
--tserver_master_addrs=127.19.236.126:34777
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.977
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.67
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:05:09.662272 977 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:05:09.663812 977 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:05:09.677909 983 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:05:09.678452 977 server_base.cc:1034] running on GCE node
W20260811 15:05:09.678818 982 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:05:09.679091 985 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:05:09.679600 977 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:05:09.680485 977 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:05:09.681677 977 hybrid_clock.cc:648] HybridClock initialized: now 1786460709681607 us; error 85 us; skew 500 ppm
Aug 11 15:05:09 dist-test-slave-8n49 krb5kdc[32527](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460709, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:05:09.685696 977 init.cc:377] Logged in from keytab as kudu/127.19.236.67@KRBTEST.COM (short username kudu)
I20260811 15:05:09.686842 977 webserver.cc:460] Webserver started at http://127.19.236.67:39783/ using document root <none> and password file <none>
I20260811 15:05:09.687608 977 fs_manager.cc:359] Metadata directory not provided
I20260811 15:05:09.687716 977 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:05:09.687966 977 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 15:05:09 dist-test-slave-8n49 krb5kdc[32527](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460709, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.67@KRBTEST.COM for HTTP/127.19.236.84@KRBTEST.COM
I20260811 15:05:09.708004 977 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/minicluster-data/ts-2/data/instance:
uuid: "a9e243d1020b400b8a133bcd77ef756a"
format_stamp: "Formatted at 2026-08-11 15:05:09 on dist-test-slave-8n49"
server_key: "95ef4e1d297e2478ff31ab176064cfc5"
server_key_iv: "c8e53768b2ff9703ed7e021b23147f19"
server_key_version: "kuduclusterkey@0"
I20260811 15:05:09.708863 977 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/minicluster-data/ts-2/wal/instance:
uuid: "a9e243d1020b400b8a133bcd77ef756a"
format_stamp: "Formatted at 2026-08-11 15:05:09 on dist-test-slave-8n49"
server_key: "95ef4e1d297e2478ff31ab176064cfc5"
server_key_iv: "c8e53768b2ff9703ed7e021b23147f19"
server_key_version: "kuduclusterkey@0"
I20260811 15:05:09.714278 977 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260811 15:05:09.737025 993 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:05:09.738777 977 fs_manager.cc:725] Time spent opening block manager: real 0.009s user 0.002s sys 0.000s
I20260811 15:05:09.738926 977 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/minicluster-data/ts-2/wal
uuid: "a9e243d1020b400b8a133bcd77ef756a"
format_stamp: "Formatted at 2026-08-11 15:05:09 on dist-test-slave-8n49"
server_key: "95ef4e1d297e2478ff31ab176064cfc5"
server_key_iv: "c8e53768b2ff9703ed7e021b23147f19"
server_key_version: "kuduclusterkey@0"
I20260811 15:05:09.739096 977 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:05:09.759804 977 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:05:09.763659 977 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:05:09.763859 977 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:05:09.764616 977 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:05:09.765669 977 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:05:09.765730 977 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:05:09.765782 977 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:05:09.765811 977 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:05:09.780892 977 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.67:45487
I20260811 15:05:09.780979 1119 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.67:45487 every 8 connection(s)
I20260811 15:05:09.782194 977 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
I20260811 15:05:09.787367 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 977
I20260811 15:05:09.787544 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/minicluster-data/ts-2/wal/instance
I20260811 15:05:09.787868 20401 external_mini_cluster.cc:1428] Setting key bfc5643703540e52d51b813d4a4ee5ef
Aug 11 15:05:09 dist-test-slave-8n49 krb5kdc[32527](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460709, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.67@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
I20260811 15:05:09.799747 824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:05:09.786724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.67:43197 (local address 127.19.236.126:34777)
0811 15:05:09.786852 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0811 15:05:09.786855 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 15:05:09.786871 (+ 16us) server_negotiation.cc:407] Connection header received
0811 15:05:09.787507 (+ 636us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:05:09.787511 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:05:09.787569 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:05:09.787622 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:05:09.789322 (+ 1700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:05:09.790135 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:05:09.791778 (+ 1643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:05:09.792138 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:05:09.792267 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:05:09.795214 (+ 2947us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:05:09.795219 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:05:09.795224 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:05:09.795255 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:05:09.797094 (+ 1839us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:05:09.797745 (+ 651us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:05:09.797749 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:05:09.797751 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:05:09.797847 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:05:09.798347 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:05:09.798351 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:05:09.798353 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:05:09.798609 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:05:09.798721 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0811 15:05:09.799376 (+ 655us) server_negotiation.cc:299] Negotiation successful
0811 15:05:09.799572 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 15:05:09.800791 1122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:05:09.785558 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:34777 (local address 127.19.236.67:43197)
0811 15:05:09.786158 (+ 600us) negotiation.cc:107] Waiting for socket to connect
0811 15:05:09.786214 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0811 15:05:09.787236 (+ 1022us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:05:09.788036 (+ 800us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:05:09.788047 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:05:09.788441 (+ 394us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:05:09.789148 (+ 707us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:05:09.789167 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:05:09.790292 (+ 1125us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:05:09.790295 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:05:09.791633 (+ 1338us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:05:09.791645 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:05:09.792323 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:05:09.792329 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:05:09.792577 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:05:09.793300 (+ 723us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:05:09.793320 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:05:09.795015 (+ 1695us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:05:09.797227 (+ 2212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:05:09.797236 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:05:09.797253 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:05:09.797622 (+ 369us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:05:09.797961 (+ 339us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:05:09.797966 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:05:09.797970 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:05:09.798194 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:05:09.798740 (+ 546us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:05:09.798747 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:05:09.799071 (+ 324us) client_negotiation.cc:769] Sending connection context
0811 15:05:09.799301 (+ 230us) client_negotiation.cc:240] Negotiation successful
0811 15:05:09.799655 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":354,"thread_start_us":160,"threads_started":1}
I20260811 15:05:09.802294 1120 heartbeater.cc:347] Connected to a master server at 127.19.236.126:34777
I20260811 15:05:09.802567 1120 heartbeater.cc:464] Registering TS with master...
I20260811 15:05:09.803169 1120 heartbeater.cc:511] Master 127.19.236.126:34777 requested a full tablet report, sending...
I20260811 15:05:09.804425 587 ts_manager.cc:194] Registered new tserver with Master: a9e243d1020b400b8a133bcd77ef756a (127.19.236.67:45487)
I20260811 15:05:09.805207 587 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.236.67@KRBTEST.COM'} at 127.19.236.67:43197
I20260811 15:05:09.813958 20401 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 15:05:09.826383 824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:05:09.816394 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39478 (local address 127.19.236.126:34777)
0811 15:05:09.816512 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0811 15:05:09.816517 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:05:09.816813 (+ 296us) server_negotiation.cc:407] Connection header received
0811 15:05:09.816991 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:05:09.816994 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:05:09.817045 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:05:09.817099 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:05:09.818144 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:05:09.819015 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:05:09.820272 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:05:09.820647 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:05:09.820727 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:05:09.822658 (+ 1931us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:05:09.822662 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:05:09.822665 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:05:09.822694 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:05:09.824471 (+ 1777us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:05:09.825001 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:05:09.825005 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:05:09.825007 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:05:09.825098 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:05:09.825423 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:05:09.825429 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:05:09.825431 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:05:09.825678 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:05:09.825812 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0811 15:05:09.826081 (+ 269us) server_negotiation.cc:299] Negotiation successful
0811 15:05:09.826212 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 15:05:09.832181 587 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39478:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 15:05:09.836937 587 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 15:05:09.856386 1133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:05:09.848052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.67:45487 (local address 127.0.0.1:60406)
0811 15:05:09.850258 (+ 2206us) negotiation.cc:107] Waiting for socket to connect
0811 15:05:09.850334 (+ 76us) client_negotiation.cc:174] Beginning negotiation
0811 15:05:09.850470 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:05:09.851100 (+ 630us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:05:09.851107 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:05:09.851135 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:05:09.851315 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:05:09.851325 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:05:09.852999 (+ 1674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:05:09.853002 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:05:09.854425 (+ 1423us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:05:09.854437 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:05:09.855801 (+ 1364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:05:09.855804 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:05:09.855935 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:05:09.855978 (+ 43us) client_negotiation.cc:769] Sending connection context
0811 15:05:09.856094 (+ 116us) client_negotiation.cc:240] Negotiation successful
0811 15:05:09.856222 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1666,"thread_start_us":116,"threads_started":1}
I20260811 15:05:09.857069 1135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:05:09.848789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60406 (local address 127.19.236.67:45487)
0811 15:05:09.849631 (+ 842us) server_negotiation.cc:206] Beginning negotiation
0811 15:05:09.849644 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 15:05:09.850610 (+ 966us) server_negotiation.cc:407] Connection header received
0811 15:05:09.850693 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:05:09.850699 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:05:09.850907 (+ 208us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:05:09.851059 (+ 152us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:05:09.851496 (+ 437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:05:09.852858 (+ 1362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:05:09.854601 (+ 1743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:05:09.855443 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:05:09.855528 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:05:09.855691 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0811 15:05:09.856805 (+ 1114us) server_negotiation.cc:299] Negotiation successful
0811 15:05:09.856918 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":725,"thread_start_us":87,"threads_started":1}
I20260811 15:05:09.861241 1134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:05:09.849752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.66:43519 (local address 127.0.0.1:58014)
0811 15:05:09.852539 (+ 2787us) negotiation.cc:107] Waiting for socket to connect
0811 15:05:09.852570 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0811 15:05:09.852653 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:05:09.853286 (+ 633us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:05:09.853289 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:05:09.853305 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:05:09.853401 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:05:09.853406 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:05:09.856341 (+ 2935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:05:09.856344 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:05:09.857492 (+ 1148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:05:09.857503 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:05:09.860841 (+ 3338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:05:09.860845 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:05:09.860939 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:05:09.860963 (+ 24us) client_negotiation.cc:769] Sending connection context
0811 15:05:09.861040 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 15:05:09.861111 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2729,"thread_start_us":96,"threads_started":1}
I20260811 15:05:09.861258 1023 tablet_service.cc:1467] Processing CreateTablet for tablet 31f69f74a3d547eb9f2f36a983f5227c (DEFAULT_TABLE table=test-table [id=1e98ef1293684b22ac5d3bb01137d07c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:05:09.861912 1138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:05:09.849903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58014 (local address 127.19.236.66:43519)
0811 15:05:09.852328 (+ 2425us) server_negotiation.cc:206] Beginning negotiation
0811 15:05:09.852339 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 15:05:09.852741 (+ 402us) server_negotiation.cc:407] Connection header received
0811 15:05:09.852820 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:05:09.852825 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:05:09.853004 (+ 179us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:05:09.853153 (+ 149us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:05:09.853520 (+ 367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:05:09.854606 (+ 1086us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:05:09.857733 (+ 3127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:05:09.860535 (+ 2802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:05:09.860643 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:05:09.860782 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0811 15:05:09.861669 (+ 887us) server_negotiation.cc:299] Negotiation successful
0811 15:05:09.861777 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2321,"thread_start_us":115,"threads_started":1}
I20260811 15:05:09.862632 1023 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 31f69f74a3d547eb9f2f36a983f5227c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:05:09.866719 1137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:05:09.848134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.65:42387 (local address 127.0.0.1:53890)
0811 15:05:09.851298 (+ 3164us) negotiation.cc:107] Waiting for socket to connect
0811 15:05:09.851311 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 15:05:09.851387 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:05:09.856049 (+ 4662us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:05:09.856052 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:05:09.856069 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:05:09.856149 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:05:09.856154 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:05:09.862184 (+ 6030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:05:09.862188 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:05:09.864171 (+ 1983us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:05:09.864183 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:05:09.866190 (+ 2007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:05:09.866194 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:05:09.866323 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:05:09.866364 (+ 41us) client_negotiation.cc:769] Sending connection context
0811 15:05:09.866428 (+ 64us) client_negotiation.cc:240] Negotiation successful
0811 15:05:09.866524 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3100,"thread_start_us":175,"threads_started":1}
I20260811 15:05:09.867204 879 tablet_service.cc:1467] Processing CreateTablet for tablet 31f69f74a3d547eb9f2f36a983f5227c (DEFAULT_TABLE table=test-table [id=1e98ef1293684b22ac5d3bb01137d07c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:05:09.867687 1136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:05:09.848906 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53890 (local address 127.19.236.65:42387)
0811 15:05:09.855494 (+ 6588us) server_negotiation.cc:206] Beginning negotiation
0811 15:05:09.855500 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 15:05:09.855524 (+ 24us) server_negotiation.cc:407] Connection header received
0811 15:05:09.855599 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:05:09.855604 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:05:09.855776 (+ 172us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:05:09.855904 (+ 128us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:05:09.859222 (+ 3318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:05:09.860319 (+ 1097us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:05:09.865107 (+ 4788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:05:09.865951 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:05:09.867225 (+ 1274us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:05:09.867379 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0811 15:05:09.867440 (+ 61us) server_negotiation.cc:299] Negotiation successful
0811 15:05:09.867545 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6473,"thread_start_us":134,"threads_started":1}
I20260811 15:05:09.870571 751 tablet_service.cc:1467] Processing CreateTablet for tablet 31f69f74a3d547eb9f2f36a983f5227c (DEFAULT_TABLE table=test-table [id=1e98ef1293684b22ac5d3bb01137d07c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:05:09.871389 879 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 31f69f74a3d547eb9f2f36a983f5227c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:05:09.871680 751 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 31f69f74a3d547eb9f2f36a983f5227c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:05:09.881925 1140 tablet_bootstrap.cc:492] T 31f69f74a3d547eb9f2f36a983f5227c P eefc04eee0f242078caf492bd2a2ccc6: Bootstrap starting.
I20260811 15:05:09.885601 1140 tablet_bootstrap.cc:654] T 31f69f74a3d547eb9f2f36a983f5227c P eefc04eee0f242078caf492bd2a2ccc6: Neither blocks nor log segments found. Creating new log.
I20260811 15:05:09.886684 1140 log.cc:824] T 31f69f74a3d547eb9f2f36a983f5227c P eefc04eee0f242078caf492bd2a2ccc6: Log is configured to *not* fsync() on all Append() calls
I20260811 15:05:09.887221 1139 tablet_bootstrap.cc:492] T 31f69f74a3d547eb9f2f36a983f5227c P 7732dccc881d49d0b42e040677995555: Bootstrap starting.
I20260811 15:05:09.889247 1141 tablet_bootstrap.cc:492] T 31f69f74a3d547eb9f2f36a983f5227c P a9e243d1020b400b8a133bcd77ef756a: Bootstrap starting.
I20260811 15:05:09.890391 1139 tablet_bootstrap.cc:654] T 31f69f74a3d547eb9f2f36a983f5227c P 7732dccc881d49d0b42e040677995555: Neither blocks nor log segments found. Creating new log.
I20260811 15:05:09.891412 1139 log.cc:824] T 31f69f74a3d547eb9f2f36a983f5227c P 7732dccc881d49d0b42e040677995555: Log is configured to *not* fsync() on all Append() calls
I20260811 15:05:09.892073 1141 tablet_bootstrap.cc:654] T 31f69f74a3d547eb9f2f36a983f5227c P a9e243d1020b400b8a133bcd77ef756a: Neither blocks nor log segments found. Creating new log.
I20260811 15:05:09.894042 1139 tablet_bootstrap.cc:492] T 31f69f74a3d547eb9f2f36a983f5227c P 7732dccc881d49d0b42e040677995555: No bootstrap required, opened a new log
I20260811 15:05:09.894250 1139 ts_tablet_manager.cc:1397] T 31f69f74a3d547eb9f2f36a983f5227c P 7732dccc881d49d0b42e040677995555: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260811 15:05:09.894594 1140 tablet_bootstrap.cc:492] T 31f69f74a3d547eb9f2f36a983f5227c P eefc04eee0f242078caf492bd2a2ccc6: No bootstrap required, opened a new log
I20260811 15:05:09.894781 1140 ts_tablet_manager.cc:1397] T 31f69f74a3d547eb9f2f36a983f5227c P eefc04eee0f242078caf492bd2a2ccc6: Time spent bootstrapping tablet: real 0.013s user 0.006s sys 0.000s
I20260811 15:05:09.898604 1140 raft_consensus.cc:348] T 31f69f74a3d547eb9f2f36a983f5227c P eefc04eee0f242078caf492bd2a2ccc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9e243d1020b400b8a133bcd77ef756a" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 45487 } } peers { permanent_uuid: "7732dccc881d49d0b42e040677995555" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 42387 } } peers { permanent_uuid: "eefc04eee0f242078caf492bd2a2ccc6" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 43519 } }
I20260811 15:05:09.898901 1140 raft_consensus.cc:374] T 31f69f74a3d547eb9f2f36a983f5227c P eefc04eee0f242078caf492bd2a2ccc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:05:09.898954 1140 raft_consensus.cc:729] T 31f69f74a3d547eb9f2f36a983f5227c P eefc04eee0f242078caf492bd2a2ccc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eefc04eee0f242078caf492bd2a2ccc6, State: Initialized, Role: FOLLOWER
I20260811 15:05:09.899423 1140 consensus_queue.cc:260] T 31f69f74a3d547eb9f2f36a983f5227c P eefc04eee0f242078caf492bd2a2ccc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9e243d1020b400b8a133bcd77ef756a" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 45487 } } peers { permanent_uuid: "7732dccc881d49d0b42e040677995555" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 42387 } } peers { permanent_uuid: "eefc04eee0f242078caf492bd2a2ccc6" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 43519 } }
I20260811 15:05:09.899367 1139 raft_consensus.cc:348] T 31f69f74a3d547eb9f2f36a983f5227c P 7732dccc881d49d0b42e040677995555 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9e243d1020b400b8a133bcd77ef756a" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 45487 } } peers { permanent_uuid: "7732dccc881d49d0b42e040677995555" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 42387 } } peers { permanent_uuid: "eefc04eee0f242078caf492bd2a2ccc6" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 43519 } }
I20260811 15:05:09.899825 1139 raft_consensus.cc:374] T 31f69f74a3d547eb9f2f36a983f5227c P 7732dccc881d49d0b42e040677995555 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:05:09.899924 1139 raft_consensus.cc:729] T 31f69f74a3d547eb9f2f36a983f5227c P 7732dccc881d49d0b42e040677995555 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7732dccc881d49d0b42e040677995555, State: Initialized, Role: FOLLOWER
I20260811 15:05:09.900483 1140 ts_tablet_manager.cc:1428] T 31f69f74a3d547eb9f2f36a983f5227c P eefc04eee0f242078caf492bd2a2ccc6: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260811 15:05:09.900509 1139 consensus_queue.cc:260] T 31f69f74a3d547eb9f2f36a983f5227c P 7732dccc881d49d0b42e040677995555 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9e243d1020b400b8a133bcd77ef756a" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 45487 } } peers { permanent_uuid: "7732dccc881d49d0b42e040677995555" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 42387 } } peers { permanent_uuid: "eefc04eee0f242078caf492bd2a2ccc6" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 43519 } }
I20260811 15:05:09.901657 1139 ts_tablet_manager.cc:1428] T 31f69f74a3d547eb9f2f36a983f5227c P 7732dccc881d49d0b42e040677995555: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260811 15:05:09.902005 821 heartbeater.cc:503] Master 127.19.236.126:34777 was elected leader, sending a full tablet report...
I20260811 15:05:09.902004 972 heartbeater.cc:503] Master 127.19.236.126:34777 was elected leader, sending a full tablet report...
I20260811 15:05:09.902010 1141 log.cc:824] T 31f69f74a3d547eb9f2f36a983f5227c P a9e243d1020b400b8a133bcd77ef756a: Log is configured to *not* fsync() on all Append() calls
I20260811 15:05:09.904183 1141 tablet_bootstrap.cc:492] T 31f69f74a3d547eb9f2f36a983f5227c P a9e243d1020b400b8a133bcd77ef756a: No bootstrap required, opened a new log
I20260811 15:05:09.904366 1141 ts_tablet_manager.cc:1397] T 31f69f74a3d547eb9f2f36a983f5227c P a9e243d1020b400b8a133bcd77ef756a: Time spent bootstrapping tablet: real 0.015s user 0.005s sys 0.000s
I20260811 15:05:09.908322 1141 raft_consensus.cc:348] T 31f69f74a3d547eb9f2f36a983f5227c P a9e243d1020b400b8a133bcd77ef756a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9e243d1020b400b8a133bcd77ef756a" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 45487 } } peers { permanent_uuid: "7732dccc881d49d0b42e040677995555" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 42387 } } peers { permanent_uuid: "eefc04eee0f242078caf492bd2a2ccc6" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 43519 } }
I20260811 15:05:09.908746 1141 raft_consensus.cc:374] T 31f69f74a3d547eb9f2f36a983f5227c P a9e243d1020b400b8a133bcd77ef756a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:05:09.908879 1141 raft_consensus.cc:729] T 31f69f74a3d547eb9f2f36a983f5227c P a9e243d1020b400b8a133bcd77ef756a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9e243d1020b400b8a133bcd77ef756a, State: Initialized, Role: FOLLOWER
I20260811 15:05:09.909511 1141 consensus_queue.cc:260] T 31f69f74a3d547eb9f2f36a983f5227c P a9e243d1020b400b8a133bcd77ef756a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9e243d1020b400b8a133bcd77ef756a" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 45487 } } peers { permanent_uuid: "7732dccc881d49d0b42e040677995555" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 42387 } } peers { permanent_uuid: "eefc04eee0f242078caf492bd2a2ccc6" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 43519 } }
I20260811 15:05:09.910583 1141 ts_tablet_manager.cc:1428] T 31f69f74a3d547eb9f2f36a983f5227c P a9e243d1020b400b8a133bcd77ef756a: Time spent starting tablet: real 0.006s user 0.003s sys 0.004s
I20260811 15:05:09.910969 1120 heartbeater.cc:503] Master 127.19.236.126:34777 was elected leader, sending a full tablet report...
Aug 11 15:05:09 dist-test-slave-8n49 krb5kdc[32527](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460709, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.126@KRBTEST.COM for HTTP/127.19.236.84@KRBTEST.COM
W20260811 15:05:09.941623 973 tablet.cc:2369] T 31f69f74a3d547eb9f2f36a983f5227c P eefc04eee0f242078caf492bd2a2ccc6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 15:05:10.023100 1148 raft_consensus.cc:482] T 31f69f74a3d547eb9f2f36a983f5227c P a9e243d1020b400b8a133bcd77ef756a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 15:05:10.023361 1148 raft_consensus.cc:504] T 31f69f74a3d547eb9f2f36a983f5227c P a9e243d1020b400b8a133bcd77ef756a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9e243d1020b400b8a133bcd77ef756a" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 45487 } } peers { permanent_uuid: "7732dccc881d49d0b42e040677995555" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 42387 } } peers { permanent_uuid: "eefc04eee0f242078caf492bd2a2ccc6" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 43519 } }
I20260811 15:05:10.025017 1148 leader_election.cc:288] T 31f69f74a3d547eb9f2f36a983f5227c P a9e243d1020b400b8a133bcd77ef756a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7732dccc881d49d0b42e040677995555 (127.19.236.65:42387), eefc04eee0f242078caf492bd2a2ccc6 (127.19.236.66:43519)
I20260811 15:05:10.030213 1122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:05:10.025583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.66:43519 (local address 127.19.236.67:40933)
0811 15:05:10.025867 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0811 15:05:10.025889 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 15:05:10.026018 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:05:10.026398 (+ 380us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:05:10.026401 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:05:10.026419 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:05:10.026565 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:05:10.026576 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:05:10.027599 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:05:10.027603 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:05:10.028787 (+ 1184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:05:10.028798 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:05:10.029747 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:05:10.029751 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:05:10.029862 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:05:10.029905 (+ 43us) client_negotiation.cc:769] Sending connection context
0811 15:05:10.029975 (+ 70us) client_negotiation.cc:240] Negotiation successful
0811 15:05:10.030069 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":212}
I20260811 15:05:10.030877 1138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:05:10.025639 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.67:40933 (local address 127.19.236.66:43519)
0811 15:05:10.025783 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0811 15:05:10.025788 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:05:10.025957 (+ 169us) server_negotiation.cc:407] Connection header received
0811 15:05:10.026143 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:05:10.026147 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:05:10.026202 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:05:10.026271 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:05:10.026711 (+ 440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:05:10.027441 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:05:10.028937 (+ 1496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:05:10.029490 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:05:10.029625 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:05:10.029682 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 15:05:10.030662 (+ 980us) server_negotiation.cc:299] Negotiation successful
0811 15:05:10.030757 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 15:05:10.034864 915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31f69f74a3d547eb9f2f36a983f5227c" candidate_uuid: "a9e243d1020b400b8a133bcd77ef756a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eefc04eee0f242078caf492bd2a2ccc6" is_pre_election: true
W20260811 15:05:10.034972 1121 tablet.cc:2369] T 31f69f74a3d547eb9f2f36a983f5227c P a9e243d1020b400b8a133bcd77ef756a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 15:05:10.035259 915 raft_consensus.cc:2454] T 31f69f74a3d547eb9f2f36a983f5227c P eefc04eee0f242078caf492bd2a2ccc6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9e243d1020b400b8a133bcd77ef756a in term 0.
I20260811 15:05:10.035841 995 leader_election.cc:302] T 31f69f74a3d547eb9f2f36a983f5227c P a9e243d1020b400b8a133bcd77ef756a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9e243d1020b400b8a133bcd77ef756a, eefc04eee0f242078caf492bd2a2ccc6; no voters:
I20260811 15:05:10.036186 1148 raft_consensus.cc:2781] T 31f69f74a3d547eb9f2f36a983f5227c P a9e243d1020b400b8a133bcd77ef756a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 15:05:10.036285 1148 raft_consensus.cc:482] T 31f69f74a3d547eb9f2f36a983f5227c P a9e243d1020b400b8a133bcd77ef756a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 15:05:10.036336 1148 raft_consensus.cc:3037] T 31f69f74a3d547eb9f2f36a983f5227c P a9e243d1020b400b8a133bcd77ef756a [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:05:10.037812 1148 raft_consensus.cc:504] T 31f69f74a3d547eb9f2f36a983f5227c P a9e243d1020b400b8a133bcd77ef756a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9e243d1020b400b8a133bcd77ef756a" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 45487 } } peers { permanent_uuid: "7732dccc881d49d0b42e040677995555" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 42387 } } peers { permanent_uuid: "eefc04eee0f242078caf492bd2a2ccc6" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 43519 } }
I20260811 15:05:10.038136 1122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:05:10.026455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.65:42387 (local address 127.19.236.67:47239)
0811 15:05:10.030391 (+ 3936us) negotiation.cc:107] Waiting for socket to connect
0811 15:05:10.030406 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 15:05:10.030490 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:05:10.033968 (+ 3478us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:05:10.033971 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:05:10.033995 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:05:10.034079 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:05:10.034085 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:05:10.035483 (+ 1398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:05:10.035486 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:05:10.036612 (+ 1126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:05:10.036624 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:05:10.037671 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:05:10.037676 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:05:10.037768 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:05:10.037794 (+ 26us) client_negotiation.cc:769] Sending connection context
0811 15:05:10.037874 (+ 80us) client_negotiation.cc:240] Negotiation successful
0811 15:05:10.037954 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3878,"thread_start_us":134,"threads_started":1}
I20260811 15:05:10.038254 1148 leader_election.cc:288] T 31f69f74a3d547eb9f2f36a983f5227c P a9e243d1020b400b8a133bcd77ef756a [CANDIDATE]: Term 1 election: Requested vote from peers 7732dccc881d49d0b42e040677995555 (127.19.236.65:42387), eefc04eee0f242078caf492bd2a2ccc6 (127.19.236.66:43519)
I20260811 15:05:10.038539 1136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:05:10.026228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.67:47239 (local address 127.19.236.65:42387)
0811 15:05:10.026371 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0811 15:05:10.026376 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:05:10.032653 (+ 6277us) server_negotiation.cc:407] Connection header received
0811 15:05:10.032728 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:05:10.032732 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:05:10.032794 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:05:10.032884 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:05:10.034593 (+ 1709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:05:10.035335 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:05:10.036765 (+ 1430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:05:10.037383 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:05:10.037528 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:05:10.037597 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 15:05:10.038302 (+ 705us) server_negotiation.cc:299] Negotiation successful
0811 15:05:10.038391 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 15:05:10.038854 915 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31f69f74a3d547eb9f2f36a983f5227c" candidate_uuid: "a9e243d1020b400b8a133bcd77ef756a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eefc04eee0f242078caf492bd2a2ccc6"
I20260811 15:05:10.038995 915 raft_consensus.cc:3037] T 31f69f74a3d547eb9f2f36a983f5227c P eefc04eee0f242078caf492bd2a2ccc6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:05:10.039316 773 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31f69f74a3d547eb9f2f36a983f5227c" candidate_uuid: "a9e243d1020b400b8a133bcd77ef756a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7732dccc881d49d0b42e040677995555" is_pre_election: true
I20260811 15:05:10.039635 773 raft_consensus.cc:2454] T 31f69f74a3d547eb9f2f36a983f5227c P 7732dccc881d49d0b42e040677995555 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9e243d1020b400b8a133bcd77ef756a in term 0.
I20260811 15:05:10.040030 772 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31f69f74a3d547eb9f2f36a983f5227c" candidate_uuid: "a9e243d1020b400b8a133bcd77ef756a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7732dccc881d49d0b42e040677995555"
I20260811 15:05:10.040151 772 raft_consensus.cc:3037] T 31f69f74a3d547eb9f2f36a983f5227c P 7732dccc881d49d0b42e040677995555 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:05:10.040310 915 raft_consensus.cc:2454] T 31f69f74a3d547eb9f2f36a983f5227c P eefc04eee0f242078caf492bd2a2ccc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9e243d1020b400b8a133bcd77ef756a in term 1.
I20260811 15:05:10.040683 995 leader_election.cc:302] T 31f69f74a3d547eb9f2f36a983f5227c P a9e243d1020b400b8a133bcd77ef756a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9e243d1020b400b8a133bcd77ef756a, eefc04eee0f242078caf492bd2a2ccc6; no voters:
I20260811 15:05:10.040863 1148 raft_consensus.cc:2781] T 31f69f74a3d547eb9f2f36a983f5227c P a9e243d1020b400b8a133bcd77ef756a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:05:10.041085 1148 raft_consensus.cc:686] T 31f69f74a3d547eb9f2f36a983f5227c P a9e243d1020b400b8a133bcd77ef756a [term 1 LEADER]: Becoming Leader. State: Replica: a9e243d1020b400b8a133bcd77ef756a, State: Running, Role: LEADER
I20260811 15:05:10.041479 1148 consensus_queue.cc:237] T 31f69f74a3d547eb9f2f36a983f5227c P a9e243d1020b400b8a133bcd77ef756a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9e243d1020b400b8a133bcd77ef756a" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 45487 } } peers { permanent_uuid: "7732dccc881d49d0b42e040677995555" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 42387 } } peers { permanent_uuid: "eefc04eee0f242078caf492bd2a2ccc6" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 43519 } }
I20260811 15:05:10.041539 772 raft_consensus.cc:2454] T 31f69f74a3d547eb9f2f36a983f5227c P 7732dccc881d49d0b42e040677995555 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9e243d1020b400b8a133bcd77ef756a in term 1.
I20260811 15:05:10.044876 588 catalog_manager.cc:5495] T 31f69f74a3d547eb9f2f36a983f5227c P a9e243d1020b400b8a133bcd77ef756a reported cstate change: term changed from 0 to 1, leader changed from <none> to a9e243d1020b400b8a133bcd77ef756a (127.19.236.67). New cstate: current_term: 1 leader_uuid: "a9e243d1020b400b8a133bcd77ef756a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9e243d1020b400b8a133bcd77ef756a" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 45487 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7732dccc881d49d0b42e040677995555" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 42387 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eefc04eee0f242078caf492bd2a2ccc6" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 43519 } health_report { overall_health: UNKNOWN } } }
I20260811 15:05:10.095875 1135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:05:10.091164 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60412 (local address 127.19.236.67:45487)
0811 15:05:10.091572 (+ 408us) server_negotiation.cc:206] Beginning negotiation
0811 15:05:10.091577 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:05:10.091591 (+ 14us) server_negotiation.cc:407] Connection header received
0811 15:05:10.091686 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:05:10.091689 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:05:10.091770 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:05:10.091904 (+ 134us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 15:05:10.092362 (+ 458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:05:10.093055 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:05:10.094204 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:05:10.094427 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:05:10.094547 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:05:10.094978 (+ 431us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 15:05:10.095424 (+ 446us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 15:05:10.095586 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0811 15:05:10.095629 (+ 43us) server_negotiation.cc:299] Negotiation successful
0811 15:05:10.095692 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":297}
W20260811 15:05:10.100685 822 tablet.cc:2369] T 31f69f74a3d547eb9f2f36a983f5227c P 7732dccc881d49d0b42e040677995555: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 15:05:10.103561 915 raft_consensus.cc:1261] T 31f69f74a3d547eb9f2f36a983f5227c P eefc04eee0f242078caf492bd2a2ccc6 [term 1 FOLLOWER]: Refusing update from remote peer a9e243d1020b400b8a133bcd77ef756a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:05:10.104434 1152 consensus_queue.cc:1035] T 31f69f74a3d547eb9f2f36a983f5227c P a9e243d1020b400b8a133bcd77ef756a [LEADER]: Connected to new peer: Peer: permanent_uuid: "eefc04eee0f242078caf492bd2a2ccc6" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 43519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:05:10.109972 772 raft_consensus.cc:1261] T 31f69f74a3d547eb9f2f36a983f5227c P 7732dccc881d49d0b42e040677995555 [term 1 FOLLOWER]: Refusing update from remote peer a9e243d1020b400b8a133bcd77ef756a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:05:10.110652 1152 consensus_queue.cc:1035] T 31f69f74a3d547eb9f2f36a983f5227c P a9e243d1020b400b8a133bcd77ef756a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7732dccc881d49d0b42e040677995555" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 42387 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:05:10.119940 1156 mvcc.cc:205] Tried to move back new op lower bound from 7317343068574859264 to 7317343068332589056. Current Snapshot: MvccSnapshot[applied={T|T < 7317343068574859264}]
I20260811 15:05:10.121790 1157 mvcc.cc:205] Tried to move back new op lower bound from 7317343068574859264 to 7317343068332589056. Current Snapshot: MvccSnapshot[applied={T|T < 7317343068574859264}]
I20260811 15:05:10.129482 1159 mvcc.cc:205] Tried to move back new op lower bound from 7317343068574859264 to 7317343068332589056. Current Snapshot: MvccSnapshot[applied={T|T < 7317343068574859264}]
I20260811 15:05:10.132100 587 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39478:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 15:05:10.132272 587 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39478:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 15:05:10.135035 587 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6bbdddb63b3d4a03bc5fe2cafc58bcbf: Sending DeleteTablet for 3 replicas of tablet 31f69f74a3d547eb9f2f36a983f5227c
I20260811 15:05:10.136171 1023 tablet_service.cc:1514] Processing DeleteTablet for tablet 31f69f74a3d547eb9f2f36a983f5227c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:05:10 UTC) from {username='kudu', principal='kudu/127.19.236.126@KRBTEST.COM'} at 127.0.0.1:60406
I20260811 15:05:10.136760 879 tablet_service.cc:1514] Processing DeleteTablet for tablet 31f69f74a3d547eb9f2f36a983f5227c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:05:10 UTC) from {username='kudu', principal='kudu/127.19.236.126@KRBTEST.COM'} at 127.0.0.1:58014
I20260811 15:05:10.136798 751 tablet_service.cc:1514] Processing DeleteTablet for tablet 31f69f74a3d547eb9f2f36a983f5227c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:05:10 UTC) from {username='kudu', principal='kudu/127.19.236.126@KRBTEST.COM'} at 127.0.0.1:53890
I20260811 15:05:10.137285 1167 tablet_replica.cc:330] T 31f69f74a3d547eb9f2f36a983f5227c P eefc04eee0f242078caf492bd2a2ccc6: stopping tablet replica
I20260811 15:05:10.137542 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 676
I20260811 15:05:10.138832 1167 raft_consensus.cc:2229] T 31f69f74a3d547eb9f2f36a983f5227c P eefc04eee0f242078caf492bd2a2ccc6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 15:05:10.139205 1167 raft_consensus.cc:2258] T 31f69f74a3d547eb9f2f36a983f5227c P eefc04eee0f242078caf492bd2a2ccc6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:05:10.141558 1167 ts_tablet_manager.cc:1905] T 31f69f74a3d547eb9f2f36a983f5227c P eefc04eee0f242078caf492bd2a2ccc6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 15:05:10.145500 1165 tablet_replica.cc:330] T 31f69f74a3d547eb9f2f36a983f5227c P a9e243d1020b400b8a133bcd77ef756a: stopping tablet replica
I20260811 15:05:10.145856 1165 raft_consensus.cc:2229] T 31f69f74a3d547eb9f2f36a983f5227c P a9e243d1020b400b8a133bcd77ef756a [term 1 LEADER]: Raft consensus shutting down.
I20260811 15:05:10.145864 1167 ts_tablet_manager.cc:1918] T 31f69f74a3d547eb9f2f36a983f5227c P eefc04eee0f242078caf492bd2a2ccc6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 15:05:10.146015 1167 log.cc:1196] T 31f69f74a3d547eb9f2f36a983f5227c P eefc04eee0f242078caf492bd2a2ccc6: Deleting WAL directory at /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/minicluster-data/ts-1/wal/wals/31f69f74a3d547eb9f2f36a983f5227c
I20260811 15:05:10.146267 1165 raft_consensus.cc:2258] T 31f69f74a3d547eb9f2f36a983f5227c P a9e243d1020b400b8a133bcd77ef756a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:05:10.146800 1167 ts_tablet_manager.cc:1939] T 31f69f74a3d547eb9f2f36a983f5227c P eefc04eee0f242078caf492bd2a2ccc6: Deleting consensus metadata
I20260811 15:05:10.155918 572 catalog_manager.cc:4841] TS eefc04eee0f242078caf492bd2a2ccc6 (127.19.236.66:43519): tablet 31f69f74a3d547eb9f2f36a983f5227c (table test-table [id=1e98ef1293684b22ac5d3bb01137d07c]) successfully deleted
I20260811 15:05:10.158183 1165 ts_tablet_manager.cc:1905] T 31f69f74a3d547eb9f2f36a983f5227c P a9e243d1020b400b8a133bcd77ef756a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 15:05:10.162299 1165 ts_tablet_manager.cc:1918] T 31f69f74a3d547eb9f2f36a983f5227c P a9e243d1020b400b8a133bcd77ef756a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 15:05:10.162501 1165 log.cc:1196] T 31f69f74a3d547eb9f2f36a983f5227c P a9e243d1020b400b8a133bcd77ef756a: Deleting WAL directory at /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786460596631409-20401-0/minicluster-data/ts-2/wal/wals/31f69f74a3d547eb9f2f36a983f5227c
I20260811 15:05:10.162945 1165 ts_tablet_manager.cc:1939] T 31f69f74a3d547eb9f2f36a983f5227c P a9e243d1020b400b8a133bcd77ef756a: Deleting consensus metadata
I20260811 15:05:10.164455 572 catalog_manager.cc:4841] TS a9e243d1020b400b8a133bcd77ef756a (127.19.236.67:45487): tablet 31f69f74a3d547eb9f2f36a983f5227c (table test-table [id=1e98ef1293684b22ac5d3bb01137d07c]) successfully deleted
W20260811 15:05:10.165401 571 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.19.236.65:42387 (error 108)
I20260811 15:05:10.166329 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 828
I20260811 15:05:10.171195 1133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:05:10.170811 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.65:42387 (local address 127.0.0.1:53904)
0811 15:05:10.171022 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0811 15:05:10.171094 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.65:42387: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126}
W20260811 15:05:10.171408 571 catalog_manager.cc:4584] TS 7732dccc881d49d0b42e040677995555 (127.19.236.65:42387): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 31f69f74a3d547eb9f2f36a983f5227c: Network error: Client connection negotiation failed: client connection to 127.19.236.65:42387: connect: Connection refused (error 111)
I20260811 15:05:10.196887 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 977
I20260811 15:05:10.211238 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 554
I20260811 15:05:10.220660 20401 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260811 15:05:10.566076 20401 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260811 15:05:10.566256 20401 mini_ranger.cc:66] Stopping Ranger...
I20260811 15:05:10.911314 20401 mini_ranger.cc:68] Stopped Ranger
2026-08-11 15:05:10.911 UTC [32557] LOG: received smart shutdown request
2026-08-11 15:05:10.915 UTC [32557] LOG: background worker "logical replication launcher" (PID 32568) exited with exit code 1
2026-08-11 15:05:10.916 UTC [32561] LOG: shutting down
2026-08-11 15:05:11.070 UTC [32557] LOG: database system is shut down
2026-08-11T15:05:11Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (48556 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 15:05:11 dist-test-slave-8n49 krb5kdc[1180](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 15:05:11 dist-test-slave-8n49 krb5kdc[1180](info): set up 2 sockets
Aug 11 15:05:11 dist-test-slave-8n49 krb5kdc[1180](info): commencing operation
krb5kdc: starting...
W20260811 15:05:12.294821 20401 mini_kdc.cc:121] Time spent starting KDC: real 1.079s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/krb5kdc/test-user.keytab.
Aug 11 15:05:12 dist-test-slave-8n49 krb5kdc[1180](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460712, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T15:05:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T15:05:12Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.19.236.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.19.236.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.19.236.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/krb5kdc/rangeradmin_127.19.236.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.19.236.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/krb5kdc/rangeradmin_127.19.236.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.19.236.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.19.236.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.19.236.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/krb5kdc/rangerlookup_127.19.236.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.19.236.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/krb5kdc/rangerlookup_127.19.236.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.19.236.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.19.236.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.19.236.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/krb5kdc/HTTP_127.19.236.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.19.236.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/krb5kdc/HTTP_127.19.236.84@KRBTEST.COM.keytab.
I20260811 15:05:12.471028 20401 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskAUi0lq/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/postgres -l logfile start
2026-08-11 15:05:14.929 UTC [1215] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-11 15:05:14.929 UTC [1215] LOG: listening on IPv4 address "127.19.236.84", port 36613
2026-08-11 15:05:14.932 UTC [1215] LOG: listening on Unix socket "/tmp/.s.PGSQL.36613"
2026-08-11 15:05:14.953 UTC [1218] LOG: database system was shut down at 2026-08-11 15:05:13 UTC
2026-08-11 15:05:14.957 UTC [1215] LOG: database system is ready to accept connections
I20260811 15:05:15.975541 20401 mini_postgres.cc:96] Postgres bound to 36613
2026-08-11 15:05:15.983 UTC [1227] FATAL: database "slave" does not exist
127.19.236.84:36613 - accepting connections
I20260811 15:05:15.983762 20401 mini_ranger.cc:161] Starting Ranger...
I20260811 15:05:16.000041 20401 mini_ranger.cc:84] Created miniranger Postgres user
I20260811 15:05:16.465641 20401 mini_ranger.cc:87] Created ranger Postgres database
I20260811 15:05:16.465732 20401 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ranger-admin
2026-08-11 15:05:16,751 [I] DB FLAVOR :POSTGRES
2026-08-11 15:05:16,752 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 15:05:16,752 [I] Checking connection..
2026-08-11 15:05:16,752 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAUi0lq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAUi0lq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.236.84:36613/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-11 15:05:17,021 [I] Checking connection passed.
2026-08-11 15:05:17,022 [I] --------- Verifying version history table ---------
2026-08-11 15:05:17,022 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAUi0lq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAUi0lq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.236.84:36613/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 15:05:17,301 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 15:05:17,302 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAUi0lq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAUi0lq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.236.84:36613/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 15:05:17,565 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 15:05:17,565 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-11 15:05:17,566 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAUi0lq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAUi0lq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.236.84:36613/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskAUi0lq/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-11 15:05:17.810 UTC [1298] WARNING: there is no transaction in progress
2026-08-11 15:05:17,817 [I] create_dbversion_catalog.sql file imported successfully
2026-08-11 15:05:17,818 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAUi0lq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAUi0lq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.236.84:36613/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 15:05:18,081 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-11 15:05:18,082 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 15:05:18,082 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAUi0lq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAUi0lq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.236.84:36613/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-11 15:05:18,333 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAUi0lq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAUi0lq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.236.84:36613/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-11 15:05:18,572 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAUi0lq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAUi0lq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.236.84:36613/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-8n49.c.gcp-upstream.internal','N') ;"
2026-08-11 15:05:18,797 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAUi0lq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAUi0lq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.236.84:36613/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 15:05:19,046 [I] Table x_portal_user does not exist in database ranger
2026-08-11 15:05:19,046 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAUi0lq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAUi0lq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.236.84:36613/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 15:05:19,309 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-11 15:05:19,309 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAUi0lq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAUi0lq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.236.84:36613/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 15:05:19,562 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAUi0lq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAUi0lq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.236.84:36613/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 15:05:19,818 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-11 15:05:19,818 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAUi0lq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAUi0lq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.236.84:36613/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskAUi0lq/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-11 15:05:20.777 UTC [1426] WARNING: there is no transaction in progress
2026-08-11 15:05:20.793 UTC [1426] WARNING: there is no transaction in progress
2026-08-11 15:05:20.809 UTC [1426] WARNING: there is no transaction in progress
2026-08-11 15:05:20.825 UTC [1426] WARNING: there is no transaction in progress
2026-08-11 15:05:20.842 UTC [1426] WARNING: there is no transaction in progress
2026-08-11 15:05:20.860 UTC [1426] WARNING: there is no transaction in progress
2026-08-11 15:05:20.916 UTC [1426] WARNING: there is no transaction in progress
2026-08-11 15:05:20.923 UTC [1426] WARNING: there is no transaction in progress
2026-08-11 15:05:20.937 UTC [1426] WARNING: there is no transaction in progress
2026-08-11 15:05:20.947 UTC [1426] WARNING: there is no transaction in progress
2026-08-11 15:05:20.957 UTC [1426] WARNING: there is no transaction in progress
2026-08-11 15:05:20.971 UTC [1426] WARNING: there is no transaction in progress
2026-08-11 15:05:20.981 UTC [1426] WARNING: there is no transaction in progress
2026-08-11 15:05:20.986 UTC [1426] WARNING: there is no transaction in progress
2026-08-11 15:05:20.992 UTC [1426] WARNING: there is no transaction in progress
2026-08-11 15:05:20.998 UTC [1426] WARNING: there is no transaction in progress
2026-08-11 15:05:21,646 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-11 15:05:21,647 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAUi0lq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAUi0lq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.236.84:36613/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-11 15:05:21,907 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-11 15:05:21,907 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAUi0lq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAUi0lq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.236.84:36613/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 15:05:22,150 [I] Table x_portal_user already exists in database 'ranger'
2026-08-11 15:05:22,151 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAUi0lq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAUi0lq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.236.84:36613/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 15:05:22,386 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-11 15:05:22,386 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAUi0lq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAUi0lq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.236.84:36613/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 15:05:22,635 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAUi0lq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAUi0lq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.236.84:36613/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 15:05:22,884 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAUi0lq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAUi0lq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.236.84:36613/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-8n49.c.gcp-upstream.internal';"
2026-08-11 15:05:23,114 [I] CORE_DB_SCHEMA import status has been updated
2026-08-11 15:05:23,114 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAUi0lq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAUi0lq/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.236.84:36613/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-11 15:05:23,360 [I] DB_PATCHES have already been applied
I20260811 15:05:23.366080 20401 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ranger-admin:/tmp/dist-test-taskAUi0lq/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskAUi0lq/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskAUi0lq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAUi0lq/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260811 15:05:23.366180 20401 mini_ranger.cc:193] Using host: 127.19.236.84
I20260811 15:05:23.372539 20401 mini_ranger.cc:227] Ranger admin URL: http://127.19.236.84:59529
Aug 11, 2026 3:05:23 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 3:05:23 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 3:05:23 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ranger-admin/ews/webapp
Aug 11, 2026 3:05:23 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 11, 2026 3:05:23 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 11, 2026 3:05:24 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ranger-admin/ews/webapp].
Aug 11, 2026 3:05:24 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260811 15:05:24.641644 20401 mini_ranger.cc:160] Time spent starting Ranger: real 8.658s user 0.003s sys 0.010s
Aug 11, 2026 3:05:44 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 11, 2026 3:05:44 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 11, 2026 3:05:44 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 11, 2026 3:05:44 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 11, 2026 3:05:44 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 11, 2026 3:05:44 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 11, 2026 3:05:44 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 11, 2026 3:05:44 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 11, 2026 3:05:44 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 11, 2026 3:05:44 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 11, 2026 3:05:44 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 11, 2026 3:05:44 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 11, 2026 3:05:44 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 11, 2026 3:05:44 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 11, 2026 3:05:44 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 11, 2026 3:05:44 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 11, 2026 3:05:44 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 11, 2026 3:05:45 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260811 15:05:45.794811 20401 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.19.236.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.19.236.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.19.236.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/krb5kdc/rangerkms_127.19.236.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.19.236.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/krb5kdc/rangerkms_127.19.236.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.19.236.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.19.236.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.19.236.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/krb5kdc/HTTP_127.19.236.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.19.236.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/krb5kdc/HTTP_127.19.236.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 11 15:05:45 dist-test-slave-8n49 krb5kdc[1180](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460745, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260811 15:05:45.887856 20401 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260811 15:05:45.897933 20401 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260811 15:05:46.796459 20401 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260811 15:05:46.796581 20401 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ranger-kms
I20260811 15:05:46.796607 20401 mini_ranger_kms.cc:227] Using postgres at 127.19.236.84:36613
2026-08-11 15:05:46,975 [I] DB FLAVOR :POSTGRES
2026-08-11 15:05:46,975 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 15:05:46,976 [I] Checking connection
2026-08-11 15:05:46,976 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAUi0lq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.236.84:36613/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-11 15:05:47,210 [I] connection success
2026-08-11 15:05:47,211 [I] --------- Verifying Ranger DB tables ---------
2026-08-11 15:05:47,211 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-11 15:05:47,211 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAUi0lq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.236.84:36613/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-11 15:05:47,461 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-11 15:05:47,462 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 15:05:47,462 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-11 15:05:47,462 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskAUi0lq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.236.84:36613/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-11 15:05:47,732 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260811 15:05:48.212167 20401 mini_ranger_kms.cc:310] Created kms service
I20260811 15:05:48.371140 20401 mini_ranger_kms.cc:326] Created kudu user
I20260811 15:05:48.416100 20401 mini_ranger_kms.cc:343] Created rangerkms user
Aug 11 15:05:48 dist-test-slave-8n49 krb5kdc[1180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460745, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.19.236.84@KRBTEST.COM
I20260811 15:05:48.813300 20401 mini_ranger_kms.cc:384] Added ranger policy
I20260811 15:05:48.813571 20401 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ranger-kms:/tmp/dist-test-taskAUi0lq/build/debug/bin/postgresql.jar:/tmp/dist-test-taskAUi0lq/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskAUi0lq/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260811 15:05:48.813598 20401 mini_ranger_kms.cc:240] Using host: 127.19.236.84
I20260811 15:05:48.818329 20401 mini_ranger_kms.cc:276] Ranger KMS PID: 1638
I20260811 15:05:48.818418 20401 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.19.236.84:56277
Aug 11, 2026 3:05:49 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 3:05:49 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 3:05:49 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 11, 2026 3:05:49 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 11, 2026 3:05:50 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ranger-kms/ews/webapp].
Aug 11, 2026 3:05:50 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 11 15:05:51 dist-test-slave-8n49 krb5kdc[1180](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786460751, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.19.236.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:05:51.240188 20401 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.352s user 0.009s sys 0.153s
I20260811 15:05:51.240334 20401 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260811 15:05:51.240419 20401 mini_ranger_kms.cc:401] 127.19.236.84:56277/kms/v1/keys
Aug 11 15:05:51 dist-test-slave-8n49 krb5kdc[1180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460751, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.19.236.84@KRBTEST.COM for HTTP/127.19.236.84@KRBTEST.COM
Aug 11 15:05:52 dist-test-slave-8n49 krb5kdc[1180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460751, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.19.236.84@KRBTEST.COM for HTTP/127.19.236.84@KRBTEST.COM
Aug 11 15:05:54 dist-test-slave-8n49 krb5kdc[1180](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460754, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.19.236.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.236.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.236.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab.
Entry for principal kudu/127.19.236.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab.
I20260811 15:05:54.322338 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:38237
--webserver_interface=127.19.236.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab
--principal=kudu/127.19.236.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:39275
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.236.126:38237
--ranger_config_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.19.236.84:56277/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:05:54.439924 1697 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:05:54.440198 1697 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:05:54.440238 1697 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:05:54.444247 1697 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:05:54.444308 1697 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:05:54.444327 1697 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:05:54.444344 1697 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:05:54.444394 1697 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:05:54.449874 1697 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:39275
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/master-0/wal
--ranger_kms_url=127.19.236.84:56277/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.19.236.126:38237
--ranger_config_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab
--principal=kudu/127.19.236.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:38237
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.236.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1697
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:05:54.450990 1697 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:05:54.452065 1697 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:05:54.460907 1705 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:05:54.460882 1702 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:05:54.460947 1697 server_base.cc:1034] running on GCE node
W20260811 15:05:54.460876 1703 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:05:54.461756 1697 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:05:54.462891 1697 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:05:54.464059 1697 hybrid_clock.cc:648] HybridClock initialized: now 1786460754464037 us; error 36 us; skew 500 ppm
Aug 11 15:05:54 dist-test-slave-8n49 krb5kdc[1180](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460754, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:05:54.471658 1697 init.cc:377] Logged in from keytab as kudu/127.19.236.126@KRBTEST.COM (short username kudu)
I20260811 15:05:54.472702 1697 webserver.cc:460] Webserver started at http://127.19.236.126:43053/ using document root <none> and password file <none>
I20260811 15:05:54.473253 1697 fs_manager.cc:359] Metadata directory not provided
I20260811 15:05:54.473307 1697 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:05:54.473495 1697 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 15:05:54 dist-test-slave-8n49 krb5kdc[1180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460754, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.126@KRBTEST.COM for HTTP/127.19.236.84@KRBTEST.COM
I20260811 15:05:54.522444 1697 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/master-0/data/instance:
uuid: "da1a7f01325c44ceb3d4df91e9f34424"
format_stamp: "Formatted at 2026-08-11 15:05:54 on dist-test-slave-8n49"
server_key: "4c8f4e86162ac06d4e303ab0c3f76e0c"
server_key_iv: "3cf37dd1e1b56a72f799e8a967d2451d"
server_key_version: "kuduclusterkey@0"
I20260811 15:05:54.523139 1697 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/master-0/wal/instance:
uuid: "da1a7f01325c44ceb3d4df91e9f34424"
format_stamp: "Formatted at 2026-08-11 15:05:54 on dist-test-slave-8n49"
server_key: "4c8f4e86162ac06d4e303ab0c3f76e0c"
server_key_iv: "3cf37dd1e1b56a72f799e8a967d2451d"
server_key_version: "kuduclusterkey@0"
I20260811 15:05:54.527374 1697 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 15:05:54.542260 1714 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:05:54.543725 1697 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 15:05:54.543889 1697 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/master-0/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/master-0/wal
uuid: "da1a7f01325c44ceb3d4df91e9f34424"
format_stamp: "Formatted at 2026-08-11 15:05:54 on dist-test-slave-8n49"
server_key: "4c8f4e86162ac06d4e303ab0c3f76e0c"
server_key_iv: "3cf37dd1e1b56a72f799e8a967d2451d"
server_key_version: "kuduclusterkey@0"
I20260811 15:05:54.544035 1697 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:05:54.578891 1697 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:05:54.582285 1697 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:05:54.582523 1697 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:05:54.590593 1697 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.126:38237
I20260811 15:05:54.590621 1774 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.126:38237 every 8 connection(s)
I20260811 15:05:54.591667 1697 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
I20260811 15:05:54.594655 1775 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:05:54.600751 1775 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P da1a7f01325c44ceb3d4df91e9f34424: Bootstrap starting.
I20260811 15:05:54.601279 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 1697
I20260811 15:05:54.601440 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/master-0/wal/instance
I20260811 15:05:54.601747 20401 external_mini_cluster.cc:1428] Setting key 66a564ac3c00ea47641a109ae9dd4426
I20260811 15:05:54.603763 1775 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P da1a7f01325c44ceb3d4df91e9f34424: Neither blocks nor log segments found. Creating new log.
I20260811 15:05:54.604637 1775 log.cc:824] T 00000000000000000000000000000000 P da1a7f01325c44ceb3d4df91e9f34424: Log is configured to *not* fsync() on all Append() calls
I20260811 15:05:54.606680 1775 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P da1a7f01325c44ceb3d4df91e9f34424: No bootstrap required, opened a new log
I20260811 15:05:54.610730 1775 raft_consensus.cc:348] T 00000000000000000000000000000000 P da1a7f01325c44ceb3d4df91e9f34424 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da1a7f01325c44ceb3d4df91e9f34424" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 38237 } }
I20260811 15:05:54.611037 1775 raft_consensus.cc:374] T 00000000000000000000000000000000 P da1a7f01325c44ceb3d4df91e9f34424 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:05:54.611126 1775 raft_consensus.cc:729] T 00000000000000000000000000000000 P da1a7f01325c44ceb3d4df91e9f34424 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da1a7f01325c44ceb3d4df91e9f34424, State: Initialized, Role: FOLLOWER
Aug 11 15:05:54 dist-test-slave-8n49 krb5kdc[1180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460754, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
I20260811 15:05:54.611594 1775 consensus_queue.cc:260] T 00000000000000000000000000000000 P da1a7f01325c44ceb3d4df91e9f34424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da1a7f01325c44ceb3d4df91e9f34424" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 38237 } }
I20260811 15:05:54.611786 1775 raft_consensus.cc:388] T 00000000000000000000000000000000 P da1a7f01325c44ceb3d4df91e9f34424 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 15:05:54.611866 1775 raft_consensus.cc:482] T 00000000000000000000000000000000 P da1a7f01325c44ceb3d4df91e9f34424 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 15:05:54.612011 1775 raft_consensus.cc:3037] T 00000000000000000000000000000000 P da1a7f01325c44ceb3d4df91e9f34424 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:05:54.613225 1775 raft_consensus.cc:504] T 00000000000000000000000000000000 P da1a7f01325c44ceb3d4df91e9f34424 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da1a7f01325c44ceb3d4df91e9f34424" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 38237 } }
I20260811 15:05:54.613598 1775 leader_election.cc:302] T 00000000000000000000000000000000 P da1a7f01325c44ceb3d4df91e9f34424 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: da1a7f01325c44ceb3d4df91e9f34424; no voters:
I20260811 15:05:54.613936 1775 leader_election.cc:288] T 00000000000000000000000000000000 P da1a7f01325c44ceb3d4df91e9f34424 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 15:05:54.614094 1780 raft_consensus.cc:2781] T 00000000000000000000000000000000 P da1a7f01325c44ceb3d4df91e9f34424 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:05:54.614322 1780 raft_consensus.cc:686] T 00000000000000000000000000000000 P da1a7f01325c44ceb3d4df91e9f34424 [term 1 LEADER]: Becoming Leader. State: Replica: da1a7f01325c44ceb3d4df91e9f34424, State: Running, Role: LEADER
I20260811 15:05:54.614763 1780 consensus_queue.cc:237] T 00000000000000000000000000000000 P da1a7f01325c44ceb3d4df91e9f34424 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da1a7f01325c44ceb3d4df91e9f34424" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 38237 } }
I20260811 15:05:54.615424 1775 sys_catalog.cc:564] T 00000000000000000000000000000000 P da1a7f01325c44ceb3d4df91e9f34424 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:05:54.616845 1782 sys_catalog.cc:455] T 00000000000000000000000000000000 P da1a7f01325c44ceb3d4df91e9f34424 [sys.catalog]: SysCatalogTable state changed. Reason: New leader da1a7f01325c44ceb3d4df91e9f34424. Latest consensus state: current_term: 1 leader_uuid: "da1a7f01325c44ceb3d4df91e9f34424" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da1a7f01325c44ceb3d4df91e9f34424" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 38237 } } }
I20260811 15:05:54.617019 1782 sys_catalog.cc:458] T 00000000000000000000000000000000 P da1a7f01325c44ceb3d4df91e9f34424 [sys.catalog]: This master's current role is: LEADER
I20260811 15:05:54.617409 1781 sys_catalog.cc:455] T 00000000000000000000000000000000 P da1a7f01325c44ceb3d4df91e9f34424 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "da1a7f01325c44ceb3d4df91e9f34424" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da1a7f01325c44ceb3d4df91e9f34424" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 38237 } } }
I20260811 15:05:54.617508 1781 sys_catalog.cc:458] T 00000000000000000000000000000000 P da1a7f01325c44ceb3d4df91e9f34424 [sys.catalog]: This master's current role is: LEADER
I20260811 15:05:54.617871 1775 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260811 15:05:54.618829 1793 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:05:54.618847 1778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:05:54.603218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41748 (local address 127.19.236.126:38237)
0811 15:05:54.603717 (+ 499us) server_negotiation.cc:206] Beginning negotiation
0811 15:05:54.603734 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 15:05:54.603773 (+ 39us) server_negotiation.cc:407] Connection header received
0811 15:05:54.604535 (+ 762us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:05:54.604612 (+ 77us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:05:54.605044 (+ 432us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:05:54.605433 (+ 389us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:05:54.606335 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:05:54.607492 (+ 1157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:05:54.608473 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:05:54.609077 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:05:54.609264 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:05:54.612398 (+ 3134us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:05:54.612409 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:05:54.612425 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:05:54.612457 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:05:54.614768 (+ 2311us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:05:54.615369 (+ 601us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:05:54.615375 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:05:54.615382 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:05:54.615536 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:05:54.615880 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:05:54.615884 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:05:54.615886 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:05:54.616451 (+ 565us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:05:54.616693 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0811 15:05:54.617573 (+ 880us) server_negotiation.cc:299] Negotiation successful
0811 15:05:54.617876 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":332,"thread_start_us":171,"threads_started":1}
I20260811 15:05:54.626133 1793 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:05:54.633303 1793 catalog_manager.cc:1347] Generated new cluster ID: 357b9f17585944d19a9734d8b20d4105
I20260811 15:05:54.633365 1793 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:05:54.649184 1793 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 15:05:54.650456 1793 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:05:54.670344 1793 catalog_manager.cc:5868] T 00000000000000000000000000000000 P da1a7f01325c44ceb3d4df91e9f34424: Generated new TSK 0
I20260811 15:05:54.671211 1793 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.236.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.236.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.236.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.65.keytab.
Entry for principal kudu/127.19.236.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.65.keytab.
I20260811 15:05:55.356457 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.19.236.84:56277/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.65:0
--local_ip_for_outbound_sockets=127.19.236.65
--webserver_interface=127.19.236.65
--webserver_port=0
--tserver_master_addrs=127.19.236.126:38237
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.65.keytab
--principal=kudu/127.19.236.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:39275
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:05:55.485886 1825 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:05:55.486182 1825 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:05:55.486299 1825 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:05:55.490789 1825 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:05:55.490883 1825 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:05:55.490990 1825 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.65
I20260811 15:05:55.496991 1825 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:39275
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.19.236.84:56277/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.65.keytab
--principal=kudu/127.19.236.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.236.65
--webserver_port=0
--tserver_master_addrs=127.19.236.126:38237
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1825
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.65
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:05:55.498140 1825 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:05:55.499221 1825 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:05:55.509554 1833 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:05:55.509559 1834 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:05:55.509554 1836 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:05:55.510025 1825 server_base.cc:1034] running on GCE node
I20260811 15:05:55.510478 1825 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:05:55.511216 1825 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:05:55.512410 1825 hybrid_clock.cc:648] HybridClock initialized: now 1786460755512377 us; error 50 us; skew 500 ppm
Aug 11 15:05:55 dist-test-slave-8n49 krb5kdc[1180](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460755, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:05:55.515733 1825 init.cc:377] Logged in from keytab as kudu/127.19.236.65@KRBTEST.COM (short username kudu)
I20260811 15:05:55.517059 1825 webserver.cc:460] Webserver started at http://127.19.236.65:33625/ using document root <none> and password file <none>
I20260811 15:05:55.517935 1825 fs_manager.cc:359] Metadata directory not provided
I20260811 15:05:55.518046 1825 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:05:55.518317 1825 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 15:05:55 dist-test-slave-8n49 krb5kdc[1180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460755, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.65@KRBTEST.COM for HTTP/127.19.236.84@KRBTEST.COM
I20260811 15:05:55.533558 1825 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-0/data/instance:
uuid: "12672a90aa9b45e9a419f5da5f5d8620"
format_stamp: "Formatted at 2026-08-11 15:05:55 on dist-test-slave-8n49"
server_key: "e03c4876adad694773309fc28c97cf45"
server_key_iv: "a1264f519f007d9fc886b6936009ffcd"
server_key_version: "kuduclusterkey@0"
I20260811 15:05:55.534422 1825 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-0/wal/instance:
uuid: "12672a90aa9b45e9a419f5da5f5d8620"
format_stamp: "Formatted at 2026-08-11 15:05:55 on dist-test-slave-8n49"
server_key: "e03c4876adad694773309fc28c97cf45"
server_key_iv: "a1264f519f007d9fc886b6936009ffcd"
server_key_version: "kuduclusterkey@0"
I20260811 15:05:55.542099 1825 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.004s sys 0.000s
I20260811 15:05:55.560950 1846 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:05:55.562762 1825 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 15:05:55.562898 1825 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-0/wal
uuid: "12672a90aa9b45e9a419f5da5f5d8620"
format_stamp: "Formatted at 2026-08-11 15:05:55 on dist-test-slave-8n49"
server_key: "e03c4876adad694773309fc28c97cf45"
server_key_iv: "a1264f519f007d9fc886b6936009ffcd"
server_key_version: "kuduclusterkey@0"
I20260811 15:05:55.563040 1825 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:05:55.584748 1825 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:05:55.588074 1825 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:05:55.588274 1825 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:05:55.589032 1825 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:05:55.590117 1825 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:05:55.590189 1825 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:05:55.590241 1825 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:05:55.590263 1825 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:05:55.603551 1825 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.65:38513
I20260811 15:05:55.603710 1974 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.65:38513 every 8 connection(s)
I20260811 15:05:55.604806 1825 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
I20260811 15:05:55.610242 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 1825
I20260811 15:05:55.610394 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-0/wal/instance
I20260811 15:05:55.610745 20401 external_mini_cluster.cc:1428] Setting key ca16625c8787436d591ab5e8a6bde56f
WARNING: no policy specified for kudu/127.19.236.66@KRBTEST.COM; defaulting to no policy
Aug 11 15:05:55 dist-test-slave-8n49 krb5kdc[1180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460755, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.65@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.236.66@KRBTEST.COM" created.
I20260811 15:05:55.646776 1979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:05:55.610670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:38237 (local address 127.19.236.65:39329)
0811 15:05:55.611244 (+ 574us) negotiation.cc:107] Waiting for socket to connect
0811 15:05:55.611301 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0811 15:05:55.612331 (+ 1030us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:05:55.625912 (+ 13581us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:05:55.625926 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:05:55.626362 (+ 436us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:05:55.627167 (+ 805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:05:55.627190 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:05:55.628599 (+ 1409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:05:55.628606 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:05:55.630285 (+ 1679us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:05:55.630301 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:05:55.631118 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:05:55.631125 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:05:55.631370 (+ 245us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:05:55.632135 (+ 765us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:05:55.632163 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:05:55.634103 (+ 1940us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:05:55.642713 (+ 8610us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:05:55.642722 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:05:55.642746 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:05:55.643205 (+ 459us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:05:55.643627 (+ 422us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:05:55.643631 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:05:55.643636 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:05:55.643858 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:05:55.644424 (+ 566us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:05:55.644432 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:05:55.644883 (+ 451us) client_negotiation.cc:769] Sending connection context
0811 15:05:55.645116 (+ 233us) client_negotiation.cc:240] Negotiation successful
0811 15:05:55.645549 (+ 433us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":346,"thread_start_us":165,"threads_started":1}
I20260811 15:05:55.647704 1978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:05:55.610202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.65:39329 (local address 127.19.236.126:38237)
0811 15:05:55.625227 (+ 15025us) server_negotiation.cc:206] Beginning negotiation
0811 15:05:55.625238 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 15:05:55.625263 (+ 25us) server_negotiation.cc:407] Connection header received
0811 15:05:55.625323 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:05:55.625326 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:05:55.625392 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:05:55.627354 (+ 1962us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:05:55.627480 (+ 126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:05:55.628375 (+ 895us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:05:55.630468 (+ 2093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:05:55.630902 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:05:55.631780 (+ 878us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:05:55.634341 (+ 2561us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:05:55.634345 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:05:55.634348 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:05:55.634380 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:05:55.642512 (+ 8132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:05:55.643370 (+ 858us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:05:55.643373 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:05:55.643375 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:05:55.643483 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:05:55.643996 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:05:55.643999 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:05:55.644002 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:05:55.644276 (+ 274us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:05:55.647253 (+ 2977us) server_negotiation.cc:1035] Waiting for connection context
0811 15:05:55.647347 (+ 94us) server_negotiation.cc:299] Negotiation successful
0811 15:05:55.647522 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14896,"thread_start_us":138,"threads_started":1}
I20260811 15:05:55.649217 1975 heartbeater.cc:347] Connected to a master server at 127.19.236.126:38237
I20260811 15:05:55.649513 1975 heartbeater.cc:464] Registering TS with master...
I20260811 15:05:55.650223 1975 heartbeater.cc:511] Master 127.19.236.126:38237 requested a full tablet report, sending...
I20260811 15:05:55.652138 1735 ts_manager.cc:194] Registered new tserver with Master: 12672a90aa9b45e9a419f5da5f5d8620 (127.19.236.65:38513)
I20260811 15:05:55.653941 1735 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.236.65@KRBTEST.COM'} at 127.19.236.65:39329
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.236.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.66.keytab.
Entry for principal kudu/127.19.236.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.66.keytab.
I20260811 15:05:55.675750 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.19.236.84:56277/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.66:0
--local_ip_for_outbound_sockets=127.19.236.66
--webserver_interface=127.19.236.66
--webserver_port=0
--tserver_master_addrs=127.19.236.126:38237
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.66.keytab
--principal=kudu/127.19.236.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:39275
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 15:05:55 dist-test-slave-8n49 krb5kdc[1180](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786460755, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260811 15:05:55.861753 1985 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:05:55.862151 1985 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:05:55.862237 1985 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:05:55.868826 1985 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:05:55.868916 1985 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:05:55.869038 1985 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.66
I20260811 15:05:55.877660 1985 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:39275
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.19.236.84:56277/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.66.keytab
--principal=kudu/127.19.236.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.236.66
--webserver_port=0
--tserver_master_addrs=127.19.236.126:38237
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1985
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.66
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:05:55.879225 1985 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:05:55.880757 1985 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:05:55.894502 1994 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:05:55.894984 1993 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:05:55.896064 1985 server_base.cc:1034] running on GCE node
W20260811 15:05:55.896335 1996 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:05:55.896888 1985 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:05:55.897789 1985 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:05:55.899017 1985 hybrid_clock.cc:648] HybridClock initialized: now 1786460755898936 us; error 99 us; skew 500 ppm
Aug 11 15:05:55 dist-test-slave-8n49 krb5kdc[1180](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460755, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:05:55.902961 1985 init.cc:377] Logged in from keytab as kudu/127.19.236.66@KRBTEST.COM (short username kudu)
I20260811 15:05:55.904350 1985 webserver.cc:460] Webserver started at http://127.19.236.66:37041/ using document root <none> and password file <none>
I20260811 15:05:55.905264 1985 fs_manager.cc:359] Metadata directory not provided
I20260811 15:05:55.905364 1985 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:05:55.905609 1985 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 15:05:55 dist-test-slave-8n49 krb5kdc[1180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460755, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.66@KRBTEST.COM for HTTP/127.19.236.84@KRBTEST.COM
I20260811 15:05:55.921826 1985 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-1/data/instance:
uuid: "6a2691b26f324f2f909836704b30b1d8"
format_stamp: "Formatted at 2026-08-11 15:05:55 on dist-test-slave-8n49"
server_key: "ccffcc97f45e64fb67f4cba019fd2b68"
server_key_iv: "dbb2a1a1f95d576cdfedcb316ea2c9d3"
server_key_version: "kuduclusterkey@0"
I20260811 15:05:55.922829 1985 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-1/wal/instance:
uuid: "6a2691b26f324f2f909836704b30b1d8"
format_stamp: "Formatted at 2026-08-11 15:05:55 on dist-test-slave-8n49"
server_key: "ccffcc97f45e64fb67f4cba019fd2b68"
server_key_iv: "dbb2a1a1f95d576cdfedcb316ea2c9d3"
server_key_version: "kuduclusterkey@0"
I20260811 15:05:55.928344 1985 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260811 15:05:55.947129 2003 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:05:55.951011 1985 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.002s sys 0.000s
I20260811 15:05:55.951179 1985 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-1/wal
uuid: "6a2691b26f324f2f909836704b30b1d8"
format_stamp: "Formatted at 2026-08-11 15:05:55 on dist-test-slave-8n49"
server_key: "ccffcc97f45e64fb67f4cba019fd2b68"
server_key_iv: "dbb2a1a1f95d576cdfedcb316ea2c9d3"
server_key_version: "kuduclusterkey@0"
I20260811 15:05:55.951331 1985 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:05:55.975539 1985 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:05:55.979324 1985 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:05:55.979539 1985 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:05:55.980361 1985 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:05:55.981482 1985 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:05:55.981550 1985 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:05:55.981624 1985 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:05:55.981659 1985 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:05:55.996162 1985 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.66:45339
I20260811 15:05:55.997431 1985 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
I20260811 15:05:55.998021 2152 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.66:45339 every 8 connection(s)
I20260811 15:05:56.005232 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 1985
I20260811 15:05:56.005349 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-1/wal/instance
I20260811 15:05:56.005702 20401 external_mini_cluster.cc:1428] Setting key e6d5e6bdde744ed14ddee18a33d70142
Aug 11 15:05:56 dist-test-slave-8n49 krb5kdc[1180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460755, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.66@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
I20260811 15:05:56.021364 1978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:05:56.000473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.66:52605 (local address 127.19.236.126:38237)
0811 15:05:56.000645 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0811 15:05:56.000650 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:05:56.001627 (+ 977us) server_negotiation.cc:407] Connection header received
0811 15:05:56.002859 (+ 1232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:05:56.002864 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:05:56.002929 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:05:56.002983 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:05:56.004671 (+ 1688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:05:56.005505 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:05:56.007133 (+ 1628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:05:56.007459 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:05:56.007539 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:05:56.016313 (+ 8774us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:05:56.016318 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:05:56.016321 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:05:56.016357 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:05:56.018339 (+ 1982us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:05:56.019123 (+ 784us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:05:56.019127 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:05:56.019129 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:05:56.019232 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:05:56.019725 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:05:56.019731 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:05:56.019733 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:05:56.020024 (+ 291us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:05:56.020119 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0811 15:05:56.021014 (+ 895us) server_negotiation.cc:299] Negotiation successful
0811 15:05:56.021172 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 15:05:56.023518 2156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:05:56.000951 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:38237 (local address 127.19.236.66:52605)
0811 15:05:56.001461 (+ 510us) negotiation.cc:107] Waiting for socket to connect
0811 15:05:56.001517 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0811 15:05:56.002599 (+ 1082us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:05:56.003422 (+ 823us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:05:56.003431 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:05:56.003774 (+ 343us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:05:56.004454 (+ 680us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:05:56.004472 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:05:56.005674 (+ 1202us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:05:56.005677 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:05:56.006984 (+ 1307us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:05:56.006994 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:05:56.007747 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:05:56.007750 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:05:56.007949 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:05:56.012780 (+ 4831us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:05:56.012805 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:05:56.016021 (+ 3216us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:05:56.018519 (+ 2498us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:05:56.018527 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:05:56.018551 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:05:56.018987 (+ 436us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:05:56.019363 (+ 376us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:05:56.019366 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:05:56.019368 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:05:56.019591 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:05:56.020213 (+ 622us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:05:56.020221 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:05:56.020655 (+ 434us) client_negotiation.cc:769] Sending connection context
0811 15:05:56.021905 (+ 1250us) client_negotiation.cc:240] Negotiation successful
0811 15:05:56.022317 (+ 412us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":297,"thread_start_us":157,"threads_started":1}
I20260811 15:05:56.025341 2153 heartbeater.cc:347] Connected to a master server at 127.19.236.126:38237
I20260811 15:05:56.025604 2153 heartbeater.cc:464] Registering TS with master...
I20260811 15:05:56.026242 2153 heartbeater.cc:511] Master 127.19.236.126:38237 requested a full tablet report, sending...
I20260811 15:05:56.027413 1735 ts_manager.cc:194] Registered new tserver with Master: 6a2691b26f324f2f909836704b30b1d8 (127.19.236.66:45339)
WARNING: no policy specified for kudu/127.19.236.67@KRBTEST.COM; defaulting to no policy
I20260811 15:05:56.028193 1735 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.236.66@KRBTEST.COM'} at 127.19.236.66:52605
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.236.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.236.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.67.keytab.
Entry for principal kudu/127.19.236.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.67.keytab.
I20260811 15:05:56.051149 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.19.236.84:56277/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.67:0
--local_ip_for_outbound_sockets=127.19.236.67
--webserver_interface=127.19.236.67
--webserver_port=0
--tserver_master_addrs=127.19.236.126:38237
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.67.keytab
--principal=kudu/127.19.236.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:39275
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:05:56.205714 2159 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:05:56.206215 2159 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:05:56.206357 2159 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:05:56.212545 2159 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:05:56.212772 2159 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:05:56.212915 2159 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.67
I20260811 15:05:56.220955 2159 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:39275
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.19.236.84:56277/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.67.keytab
--principal=kudu/127.19.236.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.236.67
--webserver_port=0
--tserver_master_addrs=127.19.236.126:38237
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2159
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.67
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:05:56.222702 2159 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:05:56.224232 2159 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:05:56.238117 2169 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:05:56.238600 2166 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:05:56.238919 2165 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:05:56.240374 2159 server_base.cc:1034] running on GCE node
I20260811 15:05:56.241066 2159 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:05:56.241914 2159 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:05:56.257476 2159 hybrid_clock.cc:648] HybridClock initialized: now 1786460756257405 us; error 70 us; skew 500 ppm
Aug 11 15:05:56 dist-test-slave-8n49 krb5kdc[1180](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460756, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:05:56.262167 2159 init.cc:377] Logged in from keytab as kudu/127.19.236.67@KRBTEST.COM (short username kudu)
I20260811 15:05:56.263468 2159 webserver.cc:460] Webserver started at http://127.19.236.67:38619/ using document root <none> and password file <none>
I20260811 15:05:56.264292 2159 fs_manager.cc:359] Metadata directory not provided
I20260811 15:05:56.264442 2159 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:05:56.264760 2159 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 15:05:56 dist-test-slave-8n49 krb5kdc[1180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460756, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.67@KRBTEST.COM for HTTP/127.19.236.84@KRBTEST.COM
I20260811 15:05:56.288529 2159 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-2/data/instance:
uuid: "cd8331aed45e4155908fbcc08c16c3c5"
format_stamp: "Formatted at 2026-08-11 15:05:56 on dist-test-slave-8n49"
server_key: "ccfdecd85759f36133ae3aa41fe97272"
server_key_iv: "c57b048b29ab672bf7d59b7a34fd6c8e"
server_key_version: "kuduclusterkey@0"
I20260811 15:05:56.289516 2159 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-2/wal/instance:
uuid: "cd8331aed45e4155908fbcc08c16c3c5"
format_stamp: "Formatted at 2026-08-11 15:05:56 on dist-test-slave-8n49"
server_key: "ccfdecd85759f36133ae3aa41fe97272"
server_key_iv: "c57b048b29ab672bf7d59b7a34fd6c8e"
server_key_version: "kuduclusterkey@0"
I20260811 15:05:56.295915 2159 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.001s sys 0.004s
Aug 11 15:05:56 dist-test-slave-8n49 krb5kdc[1180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460755, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.126@KRBTEST.COM for HTTP/127.19.236.84@KRBTEST.COM
I20260811 15:05:56.318816 2177 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:05:56.320533 2159 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.002s sys 0.000s
I20260811 15:05:56.320708 2159 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-2/wal
uuid: "cd8331aed45e4155908fbcc08c16c3c5"
format_stamp: "Formatted at 2026-08-11 15:05:56 on dist-test-slave-8n49"
server_key: "ccfdecd85759f36133ae3aa41fe97272"
server_key_iv: "c57b048b29ab672bf7d59b7a34fd6c8e"
server_key_version: "kuduclusterkey@0"
I20260811 15:05:56.320858 2159 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:05:56.341073 2159 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:05:56.344939 2159 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:05:56.345167 2159 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:05:56.345947 2159 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:05:56.347239 2159 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:05:56.347360 2159 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:05:56.347435 2159 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:05:56.347472 2159 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:05:56.363138 2159 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.67:45597
I20260811 15:05:56.364410 2159 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
I20260811 15:05:56.366551 2309 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.67:45597 every 8 connection(s)
I20260811 15:05:56.367164 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 2159
I20260811 15:05:56.367301 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-2/wal/instance
I20260811 15:05:56.367643 20401 external_mini_cluster.cc:1428] Setting key e6d7c6f27d73d94b1984108e35c35858
Aug 11 15:05:56 dist-test-slave-8n49 krb5kdc[1180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460756, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.67@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
I20260811 15:05:56.387847 1978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:05:56.372179 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.67:40041 (local address 127.19.236.126:38237)
0811 15:05:56.372303 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0811 15:05:56.372308 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:05:56.372973 (+ 665us) server_negotiation.cc:407] Connection header received
0811 15:05:56.374317 (+ 1344us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:05:56.374321 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:05:56.374382 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:05:56.374440 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:05:56.376262 (+ 1822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:05:56.377095 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:05:56.378800 (+ 1705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:05:56.379146 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:05:56.379235 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:05:56.382908 (+ 3673us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:05:56.382913 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:05:56.382917 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:05:56.382964 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:05:56.385060 (+ 2096us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:05:56.385802 (+ 742us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:05:56.385805 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:05:56.385807 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:05:56.385904 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:05:56.386375 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:05:56.386379 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:05:56.386381 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:05:56.386639 (+ 258us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:05:56.386717 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 15:05:56.387536 (+ 819us) server_negotiation.cc:299] Negotiation successful
0811 15:05:56.387674 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 15:05:56.390017 2312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:05:56.371056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:38237 (local address 127.19.236.67:40041)
0811 15:05:56.372806 (+ 1750us) negotiation.cc:107] Waiting for socket to connect
0811 15:05:56.372865 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0811 15:05:56.374047 (+ 1182us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:05:56.374894 (+ 847us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:05:56.374903 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:05:56.375317 (+ 414us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:05:56.376089 (+ 772us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:05:56.376115 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:05:56.377267 (+ 1152us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:05:56.377270 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:05:56.378645 (+ 1375us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:05:56.378657 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:05:56.379470 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:05:56.379475 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:05:56.379688 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:05:56.380458 (+ 770us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:05:56.380481 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:05:56.382387 (+ 1906us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:05:56.385273 (+ 2886us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:05:56.385279 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:05:56.385299 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:05:56.385675 (+ 376us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:05:56.386050 (+ 375us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:05:56.386053 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:05:56.386055 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:05:56.386250 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:05:56.386809 (+ 559us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:05:56.386817 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:05:56.387221 (+ 404us) client_negotiation.cc:769] Sending connection context
0811 15:05:56.388363 (+ 1142us) client_negotiation.cc:240] Negotiation successful
0811 15:05:56.388808 (+ 445us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1514,"thread_start_us":155,"threads_started":1}
I20260811 15:05:56.391696 2310 heartbeater.cc:347] Connected to a master server at 127.19.236.126:38237
I20260811 15:05:56.391981 2310 heartbeater.cc:464] Registering TS with master...
I20260811 15:05:56.392678 2310 heartbeater.cc:511] Master 127.19.236.126:38237 requested a full tablet report, sending...
I20260811 15:05:56.394053 1735 ts_manager.cc:194] Registered new tserver with Master: cd8331aed45e4155908fbcc08c16c3c5 (127.19.236.67:45597)
I20260811 15:05:56.394865 1735 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.236.67@KRBTEST.COM'} at 127.19.236.67:40041
I20260811 15:05:56.398588 20401 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 15:05:56.399379 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 1825
I20260811 15:05:56.422899 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 1985
I20260811 15:05:56.435803 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 2159
I20260811 15:05:56.448943 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 1697
I20260811 15:05:56.459736 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:38237
--webserver_interface=127.19.236.126
--webserver_port=43053
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab
--principal=kudu/127.19.236.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:39275
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.236.126:38237
--ranger_config_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.19.236.84:56277/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.19.236.84:56277/kms with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:05:56.579131 2313 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:05:56.579429 2313 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:05:56.579502 2313 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:05:56.583611 2313 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:05:56.583700 2313 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:05:56.583738 2313 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:05:56.583796 2313 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:05:56.583834 2313 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:05:56.589547 2313 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:39275
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.19.236.84:56277/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.19.236.126:38237
--ranger_config_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab
--principal=kudu/127.19.236.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:38237
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.236.126
--webserver_port=43053
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2313
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:05:56.590768 2313 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:05:56.591840 2313 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:05:56.600660 2318 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:05:56.600731 2319 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:05:56.600664 2321 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:05:56.601413 2313 server_base.cc:1034] running on GCE node
I20260811 15:05:56.602097 2313 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:05:56.603506 2313 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:05:56.604640 2313 hybrid_clock.cc:648] HybridClock initialized: now 1786460756604606 us; error 43 us; skew 500 ppm
Aug 11 15:05:56 dist-test-slave-8n49 krb5kdc[1180](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460756, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:05:56.608247 2313 init.cc:377] Logged in from keytab as kudu/127.19.236.126@KRBTEST.COM (short username kudu)
I20260811 15:05:56.609429 2313 webserver.cc:460] Webserver started at http://127.19.236.126:43053/ using document root <none> and password file <none>
I20260811 15:05:56.610111 2313 fs_manager.cc:359] Metadata directory not provided
I20260811 15:05:56.610201 2313 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 15:05:57 dist-test-slave-8n49 krb5kdc[1180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460756, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.126@KRBTEST.COM for HTTP/127.19.236.84@KRBTEST.COM
I20260811 15:05:57.456218 2313 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 15:05:57.459108 2332 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:05:57.460455 2313 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260811 15:05:57.460630 2313 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/master-0/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/master-0/wal
uuid: "da1a7f01325c44ceb3d4df91e9f34424"
format_stamp: "Formatted at 2026-08-11 15:05:54 on dist-test-slave-8n49"
server_key: "4c8f4e86162ac06d4e303ab0c3f76e0c"
server_key_iv: "3cf37dd1e1b56a72f799e8a967d2451d"
server_key_version: "kuduclusterkey@0"
I20260811 15:05:57.461246 2313 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:05:57.478556 2313 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:05:57.481760 2313 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:05:57.481986 2313 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:05:57.489445 2313 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.126:38237
I20260811 15:05:57.489454 2388 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.126:38237 every 8 connection(s)
I20260811 15:05:57.490671 2313 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
I20260811 15:05:57.495092 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 2313
I20260811 15:05:57.495327 2389 sys_catalog.cc:263] Verifying existing consensus state
I20260811 15:05:57.495667 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.19.236.84:56277/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.65:38513
--local_ip_for_outbound_sockets=127.19.236.65
--tserver_master_addrs=127.19.236.126:38237
--webserver_port=33625
--webserver_interface=127.19.236.65
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.65.keytab
--principal=kudu/127.19.236.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:39275
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.19.236.84:56277/kms with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 15:05:57.497848 2389 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P da1a7f01325c44ceb3d4df91e9f34424: Bootstrap starting.
I20260811 15:05:57.514648 2389 log.cc:824] T 00000000000000000000000000000000 P da1a7f01325c44ceb3d4df91e9f34424: Log is configured to *not* fsync() on all Append() calls
I20260811 15:05:57.521466 2389 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P da1a7f01325c44ceb3d4df91e9f34424: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 15:05:57.521893 2389 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P da1a7f01325c44ceb3d4df91e9f34424: Bootstrap complete.
I20260811 15:05:57.526153 2389 raft_consensus.cc:348] T 00000000000000000000000000000000 P da1a7f01325c44ceb3d4df91e9f34424 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da1a7f01325c44ceb3d4df91e9f34424" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 38237 } }
I20260811 15:05:57.526539 2389 raft_consensus.cc:729] T 00000000000000000000000000000000 P da1a7f01325c44ceb3d4df91e9f34424 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: da1a7f01325c44ceb3d4df91e9f34424, State: Initialized, Role: FOLLOWER
I20260811 15:05:57.527186 2389 consensus_queue.cc:260] T 00000000000000000000000000000000 P da1a7f01325c44ceb3d4df91e9f34424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da1a7f01325c44ceb3d4df91e9f34424" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 38237 } }
I20260811 15:05:57.527351 2389 raft_consensus.cc:388] T 00000000000000000000000000000000 P da1a7f01325c44ceb3d4df91e9f34424 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 15:05:57.527426 2389 raft_consensus.cc:482] T 00000000000000000000000000000000 P da1a7f01325c44ceb3d4df91e9f34424 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 15:05:57.527523 2389 raft_consensus.cc:3037] T 00000000000000000000000000000000 P da1a7f01325c44ceb3d4df91e9f34424 [term 1 FOLLOWER]: Advancing to term 2
I20260811 15:05:57.529568 2389 raft_consensus.cc:504] T 00000000000000000000000000000000 P da1a7f01325c44ceb3d4df91e9f34424 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da1a7f01325c44ceb3d4df91e9f34424" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 38237 } }
I20260811 15:05:57.529915 2389 leader_election.cc:302] T 00000000000000000000000000000000 P da1a7f01325c44ceb3d4df91e9f34424 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: da1a7f01325c44ceb3d4df91e9f34424; no voters:
I20260811 15:05:57.530246 2389 leader_election.cc:288] T 00000000000000000000000000000000 P da1a7f01325c44ceb3d4df91e9f34424 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 15:05:57.530416 2393 raft_consensus.cc:2781] T 00000000000000000000000000000000 P da1a7f01325c44ceb3d4df91e9f34424 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 15:05:57.530646 2393 raft_consensus.cc:686] T 00000000000000000000000000000000 P da1a7f01325c44ceb3d4df91e9f34424 [term 2 LEADER]: Becoming Leader. State: Replica: da1a7f01325c44ceb3d4df91e9f34424, State: Running, Role: LEADER
I20260811 15:05:57.530964 2393 consensus_queue.cc:237] T 00000000000000000000000000000000 P da1a7f01325c44ceb3d4df91e9f34424 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da1a7f01325c44ceb3d4df91e9f34424" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 38237 } }
I20260811 15:05:57.531589 2389 sys_catalog.cc:564] T 00000000000000000000000000000000 P da1a7f01325c44ceb3d4df91e9f34424 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:05:57.531998 2393 sys_catalog.cc:455] T 00000000000000000000000000000000 P da1a7f01325c44ceb3d4df91e9f34424 [sys.catalog]: SysCatalogTable state changed. Reason: New leader da1a7f01325c44ceb3d4df91e9f34424. Latest consensus state: current_term: 2 leader_uuid: "da1a7f01325c44ceb3d4df91e9f34424" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da1a7f01325c44ceb3d4df91e9f34424" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 38237 } } }
I20260811 15:05:57.532126 2393 sys_catalog.cc:458] T 00000000000000000000000000000000 P da1a7f01325c44ceb3d4df91e9f34424 [sys.catalog]: This master's current role is: LEADER
I20260811 15:05:57.532528 2397 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:05:57.532641 2394 sys_catalog.cc:455] T 00000000000000000000000000000000 P da1a7f01325c44ceb3d4df91e9f34424 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "da1a7f01325c44ceb3d4df91e9f34424" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da1a7f01325c44ceb3d4df91e9f34424" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 38237 } } }
I20260811 15:05:57.532836 2394 sys_catalog.cc:458] T 00000000000000000000000000000000 P da1a7f01325c44ceb3d4df91e9f34424 [sys.catalog]: This master's current role is: LEADER
I20260811 15:05:57.535888 2397 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:05:57.536422 2389 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260811 15:05:57.536530 2397 catalog_manager.cc:1259] Loaded cluster ID: 357b9f17585944d19a9734d8b20d4105
I20260811 15:05:57.536600 2397 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:05:57.539019 2397 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:05:57.539676 2397 catalog_manager.cc:5879] T 00000000000000000000000000000000 P da1a7f01325c44ceb3d4df91e9f34424: Loaded TSK: 0
I20260811 15:05:57.540889 2397 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 15:05:57.640457 2391 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:05:57.640843 2391 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:05:57.640961 2391 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:05:57.645251 2391 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:05:57.645327 2391 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:05:57.645430 2391 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.65
I20260811 15:05:57.651659 2391 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:39275
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.19.236.84:56277/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.65.keytab
--principal=kudu/127.19.236.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.65:38513
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.236.65
--webserver_port=33625
--tserver_master_addrs=127.19.236.126:38237
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2391
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.65
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:05:57.653164 2391 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:05:57.654593 2391 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:05:57.667135 2433 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:05:57.667119 2436 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:05:57.667397 2431 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:05:57.668339 2391 server_base.cc:1034] running on GCE node
I20260811 15:05:57.668862 2391 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:05:57.669690 2391 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:05:57.670907 2391 hybrid_clock.cc:648] HybridClock initialized: now 1786460757670881 us; error 41 us; skew 500 ppm
Aug 11 15:05:57 dist-test-slave-8n49 krb5kdc[1180](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460757, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:05:57.674710 2391 init.cc:377] Logged in from keytab as kudu/127.19.236.65@KRBTEST.COM (short username kudu)
I20260811 15:05:57.675877 2391 webserver.cc:460] Webserver started at http://127.19.236.65:33625/ using document root <none> and password file <none>
I20260811 15:05:57.676674 2391 fs_manager.cc:359] Metadata directory not provided
I20260811 15:05:57.676786 2391 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 15:05:57 dist-test-slave-8n49 krb5kdc[1180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460757, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.65@KRBTEST.COM for HTTP/127.19.236.84@KRBTEST.COM
I20260811 15:05:57.700572 2391 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260811 15:05:57.708961 2448 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:05:57.710707 2391 fs_manager.cc:725] Time spent opening block manager: real 0.009s user 0.003s sys 0.000s
I20260811 15:05:57.710848 2391 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-0/wal
uuid: "12672a90aa9b45e9a419f5da5f5d8620"
format_stamp: "Formatted at 2026-08-11 15:05:55 on dist-test-slave-8n49"
server_key: "e03c4876adad694773309fc28c97cf45"
server_key_iv: "a1264f519f007d9fc886b6936009ffcd"
server_key_version: "kuduclusterkey@0"
I20260811 15:05:57.711620 2391 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:05:57.751080 2391 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:05:57.755077 2391 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:05:57.755299 2391 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:05:57.756121 2391 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:05:57.757289 2391 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:05:57.757377 2391 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:05:57.757436 2391 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:05:57.757469 2391 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:05:57.771526 2391 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.65:38513
I20260811 15:05:57.773022 2391 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
I20260811 15:05:57.773691 2575 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.65:38513 every 8 connection(s)
I20260811 15:05:57.774858 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 2391
I20260811 15:05:57.775364 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.19.236.84:56277/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.66:45339
--local_ip_for_outbound_sockets=127.19.236.66
--tserver_master_addrs=127.19.236.126:38237
--webserver_port=37041
--webserver_interface=127.19.236.66
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.66.keytab
--principal=kudu/127.19.236.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:39275
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.19.236.84:56277/kms with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 15:05:57 dist-test-slave-8n49 krb5kdc[1180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460757, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.65@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
I20260811 15:05:57.793943 2580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:05:57.779229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.65:44103 (local address 127.19.236.126:38237)
0811 15:05:57.779911 (+ 682us) server_negotiation.cc:206] Beginning negotiation
0811 15:05:57.779933 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0811 15:05:57.780408 (+ 475us) server_negotiation.cc:407] Connection header received
0811 15:05:57.781718 (+ 1310us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:05:57.781729 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:05:57.782024 (+ 295us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:05:57.782338 (+ 314us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:05:57.783405 (+ 1067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:05:57.784434 (+ 1029us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:05:57.785626 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:05:57.786079 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:05:57.786260 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:05:57.788694 (+ 2434us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:05:57.788699 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:05:57.788712 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:05:57.788739 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:05:57.790451 (+ 1712us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:05:57.791040 (+ 589us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:05:57.791045 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:05:57.791049 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:05:57.791159 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:05:57.791538 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:05:57.791540 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:05:57.791542 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:05:57.791956 (+ 414us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:05:57.792101 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0811 15:05:57.792730 (+ 629us) server_negotiation.cc:299] Negotiation successful
0811 15:05:57.792985 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":514,"thread_start_us":137,"threads_started":1}
I20260811 15:05:57.793955 2581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:05:57.779364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:38237 (local address 127.19.236.65:44103)
0811 15:05:57.780222 (+ 858us) negotiation.cc:107] Waiting for socket to connect
0811 15:05:57.780274 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 15:05:57.781270 (+ 996us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:05:57.782408 (+ 1138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:05:57.782415 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:05:57.782768 (+ 353us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:05:57.783222 (+ 454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:05:57.783236 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:05:57.784612 (+ 1376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:05:57.784616 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:05:57.785475 (+ 859us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:05:57.785485 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:05:57.786250 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:05:57.786254 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:05:57.786442 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:05:57.787068 (+ 626us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:05:57.787085 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:05:57.788446 (+ 1361us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:05:57.790591 (+ 2145us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:05:57.790597 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:05:57.790610 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:05:57.790914 (+ 304us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:05:57.791271 (+ 357us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:05:57.791275 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:05:57.791277 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:05:57.791417 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:05:57.792087 (+ 670us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:05:57.792094 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:05:57.792358 (+ 264us) client_negotiation.cc:769] Sending connection context
0811 15:05:57.792562 (+ 204us) client_negotiation.cc:240] Negotiation successful
0811 15:05:57.792921 (+ 359us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":662,"thread_start_us":128,"threads_started":1}
I20260811 15:05:57.797286 2577 heartbeater.cc:347] Connected to a master server at 127.19.236.126:38237
I20260811 15:05:57.797554 2577 heartbeater.cc:464] Registering TS with master...
I20260811 15:05:57.798061 2577 heartbeater.cc:511] Master 127.19.236.126:38237 requested a full tablet report, sending...
W20260811 15:05:57.800130 2577 heartbeater.cc:644] Failed to heartbeat to 127.19.236.126:38237 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 15:05:57.800266 2577 heartbeater.cc:464] Registering TS with master...
I20260811 15:05:57.800443 2577 heartbeater.cc:511] Master 127.19.236.126:38237 requested a full tablet report, sending...
I20260811 15:05:57.801502 2577 heartbeater.cc:464] Registering TS with master...
I20260811 15:05:57.801702 2577 heartbeater.cc:511] Master 127.19.236.126:38237 requested a full tablet report, sending...
W20260811 15:05:57.802469 2577 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 15:05:57.941659 2579 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:05:57.941955 2579 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:05:57.942039 2579 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:05:57.947433 2579 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:05:57.947518 2579 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:05:57.947613 2579 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.66
I20260811 15:05:57.953444 2579 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:39275
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.19.236.84:56277/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.66.keytab
--principal=kudu/127.19.236.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.66:45339
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.236.66
--webserver_port=37041
--tserver_master_addrs=127.19.236.126:38237
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2579
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.66
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:05:57.954589 2579 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:05:57.955646 2579 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:05:57.967159 2587 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:05:57.967159 2588 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:05:57.967674 2590 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:05:57.967965 2579 server_base.cc:1034] running on GCE node
I20260811 15:05:57.968387 2579 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:05:57.969206 2579 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:05:57.970412 2579 hybrid_clock.cc:648] HybridClock initialized: now 1786460757970390 us; error 37 us; skew 500 ppm
Aug 11 15:05:57 dist-test-slave-8n49 krb5kdc[1180](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460757, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:05:57.973706 2579 init.cc:377] Logged in from keytab as kudu/127.19.236.66@KRBTEST.COM (short username kudu)
I20260811 15:05:57.974934 2579 webserver.cc:460] Webserver started at http://127.19.236.66:37041/ using document root <none> and password file <none>
I20260811 15:05:57.975536 2579 fs_manager.cc:359] Metadata directory not provided
I20260811 15:05:57.975659 2579 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 15:05:57 dist-test-slave-8n49 krb5kdc[1180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460757, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.66@KRBTEST.COM for HTTP/127.19.236.84@KRBTEST.COM
I20260811 15:05:57.998679 2579 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260811 15:05:58.003338 2603 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:05:58.005012 2579 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.000s
I20260811 15:05:58.005172 2579 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-1/wal
uuid: "6a2691b26f324f2f909836704b30b1d8"
format_stamp: "Formatted at 2026-08-11 15:05:55 on dist-test-slave-8n49"
server_key: "ccffcc97f45e64fb67f4cba019fd2b68"
server_key_iv: "dbb2a1a1f95d576cdfedcb316ea2c9d3"
server_key_version: "kuduclusterkey@0"
I20260811 15:05:58.005833 2579 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:05:58.026885 2579 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:05:58.030784 2579 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:05:58.031016 2579 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:05:58.031847 2579 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:05:58.033020 2579 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:05:58.033104 2579 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:05:58.033170 2579 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:05:58.033203 2579 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:05:58.045507 2579 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.66:45339
I20260811 15:05:58.046923 2579 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
I20260811 15:05:58.049405 2735 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.66:45339 every 8 connection(s)
I20260811 15:05:58.057147 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 2579
I20260811 15:05:58.057660 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.19.236.84:56277/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.67:45597
--local_ip_for_outbound_sockets=127.19.236.67
--tserver_master_addrs=127.19.236.126:38237
--webserver_port=38619
--webserver_interface=127.19.236.67
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.67.keytab
--principal=kudu/127.19.236.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:39275
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.19.236.84:56277/kms with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 15:05:58 dist-test-slave-8n49 krb5kdc[1180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460757, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.66@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
I20260811 15:05:58.067811 2580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:05:58.050953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.66:36959 (local address 127.19.236.126:38237)
0811 15:05:58.051081 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0811 15:05:58.051086 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:05:58.051104 (+ 18us) server_negotiation.cc:407] Connection header received
0811 15:05:58.051875 (+ 771us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:05:58.051879 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:05:58.051948 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:05:58.052046 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:05:58.053606 (+ 1560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:05:58.054474 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:05:58.056216 (+ 1742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:05:58.056629 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:05:58.056741 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:05:58.063329 (+ 6588us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:05:58.063334 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:05:58.063337 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:05:58.063369 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:05:58.065238 (+ 1869us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:05:58.065899 (+ 661us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:05:58.065903 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:05:58.065905 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:05:58.066006 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:05:58.066451 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:05:58.066455 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:05:58.066457 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:05:58.066689 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:05:58.066762 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 15:05:58.067478 (+ 716us) server_negotiation.cc:299] Negotiation successful
0811 15:05:58.067620 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 15:05:58.069561 2739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:05:58.049799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:38237 (local address 127.19.236.66:36959)
0811 15:05:58.050401 (+ 602us) negotiation.cc:107] Waiting for socket to connect
0811 15:05:58.050463 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0811 15:05:58.051598 (+ 1135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:05:58.052265 (+ 667us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:05:58.052275 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:05:58.052699 (+ 424us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:05:58.053425 (+ 726us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:05:58.053446 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:05:58.054636 (+ 1190us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:05:58.054640 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:05:58.056063 (+ 1423us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:05:58.056075 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:05:58.059919 (+ 3844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:05:58.059927 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:05:58.060180 (+ 253us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:05:58.060948 (+ 768us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:05:58.060973 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:05:58.063080 (+ 2107us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:05:58.065390 (+ 2310us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:05:58.065396 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:05:58.065415 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:05:58.065773 (+ 358us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:05:58.066158 (+ 385us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:05:58.066161 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:05:58.066163 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:05:58.066340 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:05:58.066849 (+ 509us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:05:58.066855 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:05:58.067191 (+ 336us) client_negotiation.cc:769] Sending connection context
0811 15:05:58.068064 (+ 873us) client_negotiation.cc:240] Negotiation successful
0811 15:05:58.068413 (+ 349us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":335,"thread_start_us":138,"threads_started":1}
I20260811 15:05:58.070930 2737 heartbeater.cc:347] Connected to a master server at 127.19.236.126:38237
I20260811 15:05:58.071199 2737 heartbeater.cc:464] Registering TS with master...
I20260811 15:05:58.071795 2737 heartbeater.cc:511] Master 127.19.236.126:38237 requested a full tablet report, sending...
W20260811 15:05:58.073565 2737 heartbeater.cc:644] Failed to heartbeat to 127.19.236.126:38237 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 15:05:58.073698 2737 heartbeater.cc:464] Registering TS with master...
I20260811 15:05:58.073876 2737 heartbeater.cc:511] Master 127.19.236.126:38237 requested a full tablet report, sending...
I20260811 15:05:58.074795 2737 heartbeater.cc:464] Registering TS with master...
I20260811 15:05:58.074966 2737 heartbeater.cc:511] Master 127.19.236.126:38237 requested a full tablet report, sending...
W20260811 15:05:58.075733 2737 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 15:05:58.213272 2740 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:05:58.213670 2740 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:05:58.213743 2740 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:05:58.220031 2740 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:05:58.220124 2740 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:05:58.220216 2740 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.67
I20260811 15:05:58.227803 2740 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:39275
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.19.236.84:56277/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.67.keytab
--principal=kudu/127.19.236.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.67:45597
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.236.67
--webserver_port=38619
--tserver_master_addrs=127.19.236.126:38237
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2740
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.67
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:05:58.229135 2740 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:05:58.230209 2740 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:05:58.240597 2747 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:05:58.240592 2750 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:05:58.241123 2748 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:05:58.241323 2740 server_base.cc:1034] running on GCE node
I20260811 15:05:58.241745 2740 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:05:58.242409 2740 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:05:58.243611 2740 hybrid_clock.cc:648] HybridClock initialized: now 1786460758243589 us; error 46 us; skew 500 ppm
Aug 11 15:05:58 dist-test-slave-8n49 krb5kdc[1180](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460758, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:05:58.246605 2740 init.cc:377] Logged in from keytab as kudu/127.19.236.67@KRBTEST.COM (short username kudu)
I20260811 15:05:58.247599 2740 webserver.cc:460] Webserver started at http://127.19.236.67:38619/ using document root <none> and password file <none>
I20260811 15:05:58.248196 2740 fs_manager.cc:359] Metadata directory not provided
I20260811 15:05:58.248298 2740 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 15:05:58 dist-test-slave-8n49 krb5kdc[1180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460758, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.67@KRBTEST.COM for HTTP/127.19.236.84@KRBTEST.COM
I20260811 15:05:58.268829 2740 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260811 15:05:58.271845 2761 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:05:58.273659 2740 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260811 15:05:58.273895 2740 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-2/wal
uuid: "cd8331aed45e4155908fbcc08c16c3c5"
format_stamp: "Formatted at 2026-08-11 15:05:56 on dist-test-slave-8n49"
server_key: "ccfdecd85759f36133ae3aa41fe97272"
server_key_iv: "c57b048b29ab672bf7d59b7a34fd6c8e"
server_key_version: "kuduclusterkey@0"
I20260811 15:05:58.274694 2740 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:05:58.296697 2740 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:05:58.300738 2740 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:05:58.300977 2740 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:05:58.301927 2740 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:05:58.303159 2740 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:05:58.303231 2740 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:05:58.303293 2740 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:05:58.303330 2740 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:05:58.315659 2740 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.67:45597
I20260811 15:05:58.317276 2740 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
I20260811 15:05:58.323071 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 2740
I20260811 15:05:58.336099 2902 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.67:45597 every 8 connection(s)
I20260811 15:05:58.344203 2580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:05:58.325036 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44264 (local address 127.19.236.126:38237)
0811 15:05:58.325202 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0811 15:05:58.325207 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:05:58.332985 (+ 7778us) server_negotiation.cc:407] Connection header received
0811 15:05:58.333138 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:05:58.333141 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:05:58.333198 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:05:58.333298 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:05:58.334681 (+ 1383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:05:58.335519 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:05:58.338117 (+ 2598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:05:58.338358 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:05:58.338446 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:05:58.340266 (+ 1820us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:05:58.340270 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:05:58.340272 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:05:58.340300 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:05:58.342133 (+ 1833us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:05:58.342650 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:05:58.342653 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:05:58.342655 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:05:58.342748 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:05:58.343076 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:05:58.343087 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:05:58.343089 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:05:58.343293 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:05:58.343499 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0811 15:05:58.343733 (+ 234us) server_negotiation.cc:299] Negotiation successful
0811 15:05:58.343864 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
Aug 11 15:05:58 dist-test-slave-8n49 krb5kdc[1180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460758, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.67@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
I20260811 15:05:58.353451 2907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:05:58.332589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.67:40643 (local address 127.19.236.126:38237)
0811 15:05:58.340722 (+ 8133us) server_negotiation.cc:206] Beginning negotiation
0811 15:05:58.340736 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 15:05:58.340750 (+ 14us) server_negotiation.cc:407] Connection header received
0811 15:05:58.340788 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:05:58.340790 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:05:58.340838 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:05:58.340938 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:05:58.342635 (+ 1697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:05:58.343379 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:05:58.345058 (+ 1679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:05:58.345383 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:05:58.345501 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:05:58.348112 (+ 2611us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:05:58.348116 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:05:58.348118 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:05:58.348142 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:05:58.350893 (+ 2751us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:05:58.351559 (+ 666us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:05:58.351562 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:05:58.351563 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:05:58.351648 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:05:58.352089 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:05:58.352093 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:05:58.352095 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:05:58.352339 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:05:58.352468 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0811 15:05:58.353205 (+ 737us) server_negotiation.cc:299] Negotiation successful
0811 15:05:58.353316 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1931,"thread_start_us":89,"threads_started":1}
I20260811 15:05:58.354652 2906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:05:58.331164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:38237 (local address 127.19.236.67:40643)
0811 15:05:58.333418 (+ 2254us) negotiation.cc:107] Waiting for socket to connect
0811 15:05:58.333493 (+ 75us) client_negotiation.cc:174] Beginning negotiation
0811 15:05:58.335766 (+ 2273us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:05:58.341290 (+ 5524us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:05:58.341301 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:05:58.341703 (+ 402us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:05:58.342452 (+ 749us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:05:58.342471 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:05:58.343518 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:05:58.343523 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:05:58.344931 (+ 1408us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:05:58.344943 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:05:58.345549 (+ 606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:05:58.345553 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:05:58.345783 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:05:58.346366 (+ 583us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:05:58.346382 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:05:58.347934 (+ 1552us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:05:58.351033 (+ 3099us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:05:58.351041 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:05:58.351061 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:05:58.351449 (+ 388us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:05:58.351757 (+ 308us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:05:58.351760 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:05:58.351762 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:05:58.351970 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:05:58.352488 (+ 518us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:05:58.352494 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:05:58.352899 (+ 405us) client_negotiation.cc:769] Sending connection context
0811 15:05:58.353147 (+ 248us) client_negotiation.cc:240] Negotiation successful
0811 15:05:58.353524 (+ 377us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2001,"thread_start_us":189,"threads_started":1}
I20260811 15:05:58.355962 2903 heartbeater.cc:347] Connected to a master server at 127.19.236.126:38237
I20260811 15:05:58.356251 2903 heartbeater.cc:464] Registering TS with master...
I20260811 15:05:58.356899 2903 heartbeater.cc:511] Master 127.19.236.126:38237 requested a full tablet report, sending...
W20260811 15:05:58.358721 2903 heartbeater.cc:644] Failed to heartbeat to 127.19.236.126:38237 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 15:05:58.358861 2903 heartbeater.cc:464] Registering TS with master...
I20260811 15:05:58.359053 2903 heartbeater.cc:511] Master 127.19.236.126:38237 requested a full tablet report, sending...
I20260811 15:05:58.359925 2903 heartbeater.cc:464] Registering TS with master...
I20260811 15:05:58.360116 2903 heartbeater.cc:511] Master 127.19.236.126:38237 requested a full tablet report, sending...
W20260811 15:05:58.360945 2903 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 11 15:05:58 dist-test-slave-8n49 krb5kdc[1180](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786460758, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:05:58.802783 2577 heartbeater.cc:464] Registering TS with master...
I20260811 15:05:58.803265 2577 heartbeater.cc:511] Master 127.19.236.126:38237 requested a full tablet report, sending...
I20260811 15:05:58.804488 2348 ts_manager.cc:194] Registered new tserver with Master: 12672a90aa9b45e9a419f5da5f5d8620 (127.19.236.65:38513)
I20260811 15:05:58.805809 2348 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.236.65@KRBTEST.COM'} at 127.19.236.65:44103
I20260811 15:05:59.075985 2737 heartbeater.cc:464] Registering TS with master...
I20260811 15:05:59.076337 2737 heartbeater.cc:511] Master 127.19.236.126:38237 requested a full tablet report, sending...
I20260811 15:05:59.077314 2348 ts_manager.cc:194] Registered new tserver with Master: 6a2691b26f324f2f909836704b30b1d8 (127.19.236.66:45339)
I20260811 15:05:59.078166 2348 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.236.66@KRBTEST.COM'} at 127.19.236.66:36959
Aug 11 15:05:59 dist-test-slave-8n49 krb5kdc[1180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460758, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.126@KRBTEST.COM for HTTP/127.19.236.84@KRBTEST.COM
Aug 11 15:05:59 dist-test-slave-8n49 krb5kdc[1180](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460758, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.126@KRBTEST.COM for HTTP/127.19.236.84@KRBTEST.COM
I20260811 15:05:59.361183 2903 heartbeater.cc:464] Registering TS with master...
I20260811 15:05:59.361470 2903 heartbeater.cc:511] Master 127.19.236.126:38237 requested a full tablet report, sending...
I20260811 15:05:59.362215 2348 ts_manager.cc:194] Registered new tserver with Master: cd8331aed45e4155908fbcc08c16c3c5 (127.19.236.67:45597)
I20260811 15:05:59.363049 2348 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.236.67@KRBTEST.COM'} at 127.19.236.67:40643
I20260811 15:05:59.389528 20401 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 15:05:59.415645 2929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:05:59.392827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44278 (local address 127.19.236.126:38237)
0811 15:05:59.401524 (+ 8697us) server_negotiation.cc:206] Beginning negotiation
0811 15:05:59.401530 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 15:05:59.401545 (+ 15us) server_negotiation.cc:407] Connection header received
0811 15:05:59.401721 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:05:59.401725 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:05:59.401783 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:05:59.401871 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:05:59.403852 (+ 1981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:05:59.404765 (+ 913us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:05:59.407901 (+ 3136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:05:59.408314 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:05:59.408415 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:05:59.410830 (+ 2415us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:05:59.410835 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:05:59.410838 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:05:59.410870 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:05:59.412995 (+ 2125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:05:59.413653 (+ 658us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:05:59.413657 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:05:59.413659 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:05:59.413750 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:05:59.414058 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:05:59.414062 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:05:59.414064 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:05:59.414308 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:05:59.414440 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0811 15:05:59.415314 (+ 874us) server_negotiation.cc:299] Negotiation successful
0811 15:05:59.415449 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8600,"thread_start_us":82,"threads_started":1}
I20260811 15:05:59.421857 2348 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44278:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 15:05:59.426934 2348 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 15:05:59.446587 2938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:05:59.438746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.66:45339 (local address 127.0.0.1:58988)
0811 15:05:59.439204 (+ 458us) negotiation.cc:107] Waiting for socket to connect
0811 15:05:59.439255 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0811 15:05:59.439388 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:05:59.440968 (+ 1580us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:05:59.440977 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:05:59.441001 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:05:59.441157 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:05:59.441164 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:05:59.443039 (+ 1875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:05:59.443042 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:05:59.444138 (+ 1096us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:05:59.444148 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:05:59.446008 (+ 1860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:05:59.446014 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:05:59.446129 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:05:59.446179 (+ 50us) client_negotiation.cc:769] Sending connection context
0811 15:05:59.446272 (+ 93us) client_negotiation.cc:240] Negotiation successful
0811 15:05:59.446415 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":277,"mutex_wait_us":1,"thread_start_us":97,"threads_started":1}
I20260811 15:05:59.449059 2941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:05:59.439780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58988 (local address 127.19.236.66:45339)
0811 15:05:59.440370 (+ 590us) server_negotiation.cc:206] Beginning negotiation
0811 15:05:59.440377 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 15:05:59.440402 (+ 25us) server_negotiation.cc:407] Connection header received
0811 15:05:59.440488 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:05:59.440496 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:05:59.440761 (+ 265us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:05:59.441448 (+ 687us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:05:59.441593 (+ 145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:05:59.442909 (+ 1316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:05:59.444614 (+ 1705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:05:59.445654 (+ 1040us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:05:59.448099 (+ 2445us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:05:59.448243 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0811 15:05:59.448297 (+ 54us) server_negotiation.cc:299] Negotiation successful
0811 15:05:59.448396 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":477,"thread_start_us":97,"threads_started":1}
I20260811 15:05:59.449638 2939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:05:59.439601 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51280 (local address 127.19.236.65:38513)
0811 15:05:59.440173 (+ 572us) server_negotiation.cc:206] Beginning negotiation
0811 15:05:59.440182 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 15:05:59.441039 (+ 857us) server_negotiation.cc:407] Connection header received
0811 15:05:59.441119 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:05:59.441125 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:05:59.441320 (+ 195us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:05:59.441466 (+ 146us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:05:59.441742 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:05:59.443415 (+ 1673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:05:59.446881 (+ 3466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:05:59.447732 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:05:59.447816 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:05:59.447977 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0811 15:05:59.448794 (+ 817us) server_negotiation.cc:299] Negotiation successful
0811 15:05:59.449491 (+ 697us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":460,"thread_start_us":131,"threads_started":1}
I20260811 15:05:59.450232 2936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:05:59.438802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.65:38513 (local address 127.0.0.1:51280)
0811 15:05:59.440822 (+ 2020us) negotiation.cc:107] Waiting for socket to connect
0811 15:05:59.440838 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 15:05:59.440941 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:05:59.441483 (+ 542us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:05:59.441486 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:05:59.441509 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:05:59.441605 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:05:59.441612 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:05:59.443554 (+ 1942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:05:59.443558 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:05:59.446721 (+ 3163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:05:59.446733 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:05:59.448501 (+ 1768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:05:59.448505 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:05:59.448635 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:05:59.448658 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 15:05:59.449994 (+ 1336us) client_negotiation.cc:240] Negotiation successful
0811 15:05:59.450092 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1952,"mutex_wait_us":54,"thread_start_us":124,"threads_started":1}
I20260811 15:05:59.451078 2942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:05:59.440425 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.67:45597 (local address 127.0.0.1:37176)
0811 15:05:59.444761 (+ 4336us) negotiation.cc:107] Waiting for socket to connect
0811 15:05:59.444775 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 15:05:59.444860 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:05:59.446463 (+ 1603us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:05:59.446467 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:05:59.446485 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:05:59.446564 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:05:59.446570 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:05:59.448030 (+ 1460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:05:59.448036 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:05:59.449156 (+ 1120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:05:59.449171 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:05:59.450703 (+ 1532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:05:59.450707 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:05:59.450793 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:05:59.450815 (+ 22us) client_negotiation.cc:769] Sending connection context
0811 15:05:59.450885 (+ 70us) client_negotiation.cc:240] Negotiation successful
0811 15:05:59.450949 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4267,"thread_start_us":120,"threads_started":1}
I20260811 15:05:59.451747 2943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:05:59.440599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37176 (local address 127.19.236.67:45597)
0811 15:05:59.445109 (+ 4510us) server_negotiation.cc:206] Beginning negotiation
0811 15:05:59.445116 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 15:05:59.445139 (+ 23us) server_negotiation.cc:407] Connection header received
0811 15:05:59.445217 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:05:59.445222 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:05:59.445448 (+ 226us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:05:59.445599 (+ 151us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:05:59.446821 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:05:59.447881 (+ 1060us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:05:59.449316 (+ 1435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:05:59.450398 (+ 1082us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:05:59.450504 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:05:59.450636 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0811 15:05:59.451514 (+ 878us) server_negotiation.cc:299] Negotiation successful
0811 15:05:59.451612 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4397,"thread_start_us":82,"threads_started":1}
I20260811 15:05:59.452867 2634 tablet_service.cc:1467] Processing CreateTablet for tablet 7122f1ed959d4f099a58a86b967a55c3 (DEFAULT_TABLE table=test-table [id=c91874b893be466389965f7c8964e99d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:05:59.453191 2480 tablet_service.cc:1467] Processing CreateTablet for tablet 7122f1ed959d4f099a58a86b967a55c3 (DEFAULT_TABLE table=test-table [id=c91874b893be466389965f7c8964e99d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:05:59.454146 2634 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7122f1ed959d4f099a58a86b967a55c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:05:59.454196 2480 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7122f1ed959d4f099a58a86b967a55c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:05:59.459430 2816 tablet_service.cc:1467] Processing CreateTablet for tablet 7122f1ed959d4f099a58a86b967a55c3 (DEFAULT_TABLE table=test-table [id=c91874b893be466389965f7c8964e99d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:05:59.460572 2816 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7122f1ed959d4f099a58a86b967a55c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:05:59.465461 2945 tablet_bootstrap.cc:492] T 7122f1ed959d4f099a58a86b967a55c3 P 12672a90aa9b45e9a419f5da5f5d8620: Bootstrap starting.
I20260811 15:05:59.467900 2944 tablet_bootstrap.cc:492] T 7122f1ed959d4f099a58a86b967a55c3 P 6a2691b26f324f2f909836704b30b1d8: Bootstrap starting.
I20260811 15:05:59.468238 2945 tablet_bootstrap.cc:654] T 7122f1ed959d4f099a58a86b967a55c3 P 12672a90aa9b45e9a419f5da5f5d8620: Neither blocks nor log segments found. Creating new log.
I20260811 15:05:59.470463 2944 tablet_bootstrap.cc:654] T 7122f1ed959d4f099a58a86b967a55c3 P 6a2691b26f324f2f909836704b30b1d8: Neither blocks nor log segments found. Creating new log.
I20260811 15:05:59.471658 2945 log.cc:824] T 7122f1ed959d4f099a58a86b967a55c3 P 12672a90aa9b45e9a419f5da5f5d8620: Log is configured to *not* fsync() on all Append() calls
I20260811 15:05:59.471658 2944 log.cc:824] T 7122f1ed959d4f099a58a86b967a55c3 P 6a2691b26f324f2f909836704b30b1d8: Log is configured to *not* fsync() on all Append() calls
I20260811 15:05:59.471804 2946 tablet_bootstrap.cc:492] T 7122f1ed959d4f099a58a86b967a55c3 P cd8331aed45e4155908fbcc08c16c3c5: Bootstrap starting.
I20260811 15:05:59.474128 2946 tablet_bootstrap.cc:654] T 7122f1ed959d4f099a58a86b967a55c3 P cd8331aed45e4155908fbcc08c16c3c5: Neither blocks nor log segments found. Creating new log.
I20260811 15:05:59.474960 2946 log.cc:824] T 7122f1ed959d4f099a58a86b967a55c3 P cd8331aed45e4155908fbcc08c16c3c5: Log is configured to *not* fsync() on all Append() calls
I20260811 15:05:59.476145 2945 tablet_bootstrap.cc:492] T 7122f1ed959d4f099a58a86b967a55c3 P 12672a90aa9b45e9a419f5da5f5d8620: No bootstrap required, opened a new log
I20260811 15:05:59.476456 2945 ts_tablet_manager.cc:1397] T 7122f1ed959d4f099a58a86b967a55c3 P 12672a90aa9b45e9a419f5da5f5d8620: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.000s
I20260811 15:05:59.476648 2944 tablet_bootstrap.cc:492] T 7122f1ed959d4f099a58a86b967a55c3 P 6a2691b26f324f2f909836704b30b1d8: No bootstrap required, opened a new log
I20260811 15:05:59.476876 2944 ts_tablet_manager.cc:1397] T 7122f1ed959d4f099a58a86b967a55c3 P 6a2691b26f324f2f909836704b30b1d8: Time spent bootstrapping tablet: real 0.012s user 0.006s sys 0.000s
I20260811 15:05:59.477566 2946 tablet_bootstrap.cc:492] T 7122f1ed959d4f099a58a86b967a55c3 P cd8331aed45e4155908fbcc08c16c3c5: No bootstrap required, opened a new log
I20260811 15:05:59.477767 2946 ts_tablet_manager.cc:1397] T 7122f1ed959d4f099a58a86b967a55c3 P cd8331aed45e4155908fbcc08c16c3c5: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260811 15:05:59.481086 2944 raft_consensus.cc:348] T 7122f1ed959d4f099a58a86b967a55c3 P 6a2691b26f324f2f909836704b30b1d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a2691b26f324f2f909836704b30b1d8" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 45339 } } peers { permanent_uuid: "12672a90aa9b45e9a419f5da5f5d8620" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 38513 } } peers { permanent_uuid: "cd8331aed45e4155908fbcc08c16c3c5" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 45597 } }
I20260811 15:05:59.481427 2944 raft_consensus.cc:374] T 7122f1ed959d4f099a58a86b967a55c3 P 6a2691b26f324f2f909836704b30b1d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:05:59.481503 2944 raft_consensus.cc:729] T 7122f1ed959d4f099a58a86b967a55c3 P 6a2691b26f324f2f909836704b30b1d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a2691b26f324f2f909836704b30b1d8, State: Initialized, Role: FOLLOWER
I20260811 15:05:59.481614 2945 raft_consensus.cc:348] T 7122f1ed959d4f099a58a86b967a55c3 P 12672a90aa9b45e9a419f5da5f5d8620 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a2691b26f324f2f909836704b30b1d8" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 45339 } } peers { permanent_uuid: "12672a90aa9b45e9a419f5da5f5d8620" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 38513 } } peers { permanent_uuid: "cd8331aed45e4155908fbcc08c16c3c5" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 45597 } }
I20260811 15:05:59.482015 2945 raft_consensus.cc:374] T 7122f1ed959d4f099a58a86b967a55c3 P 12672a90aa9b45e9a419f5da5f5d8620 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:05:59.482002 2944 consensus_queue.cc:260] T 7122f1ed959d4f099a58a86b967a55c3 P 6a2691b26f324f2f909836704b30b1d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a2691b26f324f2f909836704b30b1d8" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 45339 } } peers { permanent_uuid: "12672a90aa9b45e9a419f5da5f5d8620" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 38513 } } peers { permanent_uuid: "cd8331aed45e4155908fbcc08c16c3c5" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 45597 } }
I20260811 15:05:59.482112 2945 raft_consensus.cc:729] T 7122f1ed959d4f099a58a86b967a55c3 P 12672a90aa9b45e9a419f5da5f5d8620 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12672a90aa9b45e9a419f5da5f5d8620, State: Initialized, Role: FOLLOWER
I20260811 15:05:59.482717 2945 consensus_queue.cc:260] T 7122f1ed959d4f099a58a86b967a55c3 P 12672a90aa9b45e9a419f5da5f5d8620 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a2691b26f324f2f909836704b30b1d8" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 45339 } } peers { permanent_uuid: "12672a90aa9b45e9a419f5da5f5d8620" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 38513 } } peers { permanent_uuid: "cd8331aed45e4155908fbcc08c16c3c5" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 45597 } }
I20260811 15:05:59.483170 2944 ts_tablet_manager.cc:1428] T 7122f1ed959d4f099a58a86b967a55c3 P 6a2691b26f324f2f909836704b30b1d8: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260811 15:05:59.483047 2946 raft_consensus.cc:348] T 7122f1ed959d4f099a58a86b967a55c3 P cd8331aed45e4155908fbcc08c16c3c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a2691b26f324f2f909836704b30b1d8" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 45339 } } peers { permanent_uuid: "12672a90aa9b45e9a419f5da5f5d8620" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 38513 } } peers { permanent_uuid: "cd8331aed45e4155908fbcc08c16c3c5" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 45597 } }
I20260811 15:05:59.483346 2946 raft_consensus.cc:374] T 7122f1ed959d4f099a58a86b967a55c3 P cd8331aed45e4155908fbcc08c16c3c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:05:59.483436 2946 raft_consensus.cc:729] T 7122f1ed959d4f099a58a86b967a55c3 P cd8331aed45e4155908fbcc08c16c3c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd8331aed45e4155908fbcc08c16c3c5, State: Initialized, Role: FOLLOWER
I20260811 15:05:59.483559 2737 heartbeater.cc:503] Master 127.19.236.126:38237 was elected leader, sending a full tablet report...
I20260811 15:05:59.483850 2946 consensus_queue.cc:260] T 7122f1ed959d4f099a58a86b967a55c3 P cd8331aed45e4155908fbcc08c16c3c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a2691b26f324f2f909836704b30b1d8" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 45339 } } peers { permanent_uuid: "12672a90aa9b45e9a419f5da5f5d8620" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 38513 } } peers { permanent_uuid: "cd8331aed45e4155908fbcc08c16c3c5" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 45597 } }
I20260811 15:05:59.484097 2577 heartbeater.cc:503] Master 127.19.236.126:38237 was elected leader, sending a full tablet report...
I20260811 15:05:59.484907 2946 ts_tablet_manager.cc:1428] T 7122f1ed959d4f099a58a86b967a55c3 P cd8331aed45e4155908fbcc08c16c3c5: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260811 15:05:59.485469 2945 ts_tablet_manager.cc:1428] T 7122f1ed959d4f099a58a86b967a55c3 P 12672a90aa9b45e9a419f5da5f5d8620: Time spent starting tablet: real 0.009s user 0.002s sys 0.004s
I20260811 15:05:59.485796 2903 heartbeater.cc:503] Master 127.19.236.126:38237 was elected leader, sending a full tablet report...
W20260811 15:05:59.530145 2578 tablet.cc:2369] T 7122f1ed959d4f099a58a86b967a55c3 P 12672a90aa9b45e9a419f5da5f5d8620: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 15:05:59.558312 2738 tablet.cc:2369] T 7122f1ed959d4f099a58a86b967a55c3 P 6a2691b26f324f2f909836704b30b1d8: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 15:05:59.590801 2904 tablet.cc:2369] T 7122f1ed959d4f099a58a86b967a55c3 P cd8331aed45e4155908fbcc08c16c3c5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 15:05:59.705988 2951 raft_consensus.cc:482] T 7122f1ed959d4f099a58a86b967a55c3 P 6a2691b26f324f2f909836704b30b1d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 15:05:59.706284 2951 raft_consensus.cc:504] T 7122f1ed959d4f099a58a86b967a55c3 P 6a2691b26f324f2f909836704b30b1d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a2691b26f324f2f909836704b30b1d8" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 45339 } } peers { permanent_uuid: "12672a90aa9b45e9a419f5da5f5d8620" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 38513 } } peers { permanent_uuid: "cd8331aed45e4155908fbcc08c16c3c5" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 45597 } }
I20260811 15:05:59.707580 2951 leader_election.cc:288] T 7122f1ed959d4f099a58a86b967a55c3 P 6a2691b26f324f2f909836704b30b1d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 12672a90aa9b45e9a419f5da5f5d8620 (127.19.236.65:38513), cd8331aed45e4155908fbcc08c16c3c5 (127.19.236.67:45597)
I20260811 15:05:59.712617 2943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:05:59.708340 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.66:60905 (local address 127.19.236.67:45597)
0811 15:05:59.708464 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0811 15:05:59.708468 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:05:59.708484 (+ 16us) server_negotiation.cc:407] Connection header received
0811 15:05:59.708545 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:05:59.708576 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:05:59.708631 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:05:59.708720 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:05:59.709067 (+ 347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:05:59.709878 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:05:59.711334 (+ 1456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:05:59.711912 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:05:59.712048 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:05:59.712108 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 15:05:59.712348 (+ 240us) server_negotiation.cc:299] Negotiation successful
0811 15:05:59.712450 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 15:05:59.712754 2939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:05:59.707986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.66:50551 (local address 127.19.236.65:38513)
0811 15:05:59.708127 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0811 15:05:59.708132 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:05:59.708298 (+ 166us) server_negotiation.cc:407] Connection header received
0811 15:05:59.708610 (+ 312us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:05:59.708613 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:05:59.708671 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:05:59.708762 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:05:59.709135 (+ 373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:05:59.709876 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:05:59.711545 (+ 1669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:05:59.712133 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:05:59.712270 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:05:59.712317 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0811 15:05:59.712521 (+ 204us) server_negotiation.cc:299] Negotiation successful
0811 15:05:59.712615 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 15:05:59.713032 2963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:05:59.707804 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.65:38513 (local address 127.19.236.66:50551)
0811 15:05:59.708200 (+ 396us) negotiation.cc:107] Waiting for socket to connect
0811 15:05:59.708216 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 15:05:59.708398 (+ 182us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:05:59.708861 (+ 463us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:05:59.708864 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:05:59.708884 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:05:59.709029 (+ 145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:05:59.709035 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:05:59.710000 (+ 965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:05:59.710004 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:05:59.711403 (+ 1399us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:05:59.711415 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:05:59.712265 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:05:59.712269 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:05:59.712381 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:05:59.712404 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 15:05:59.712502 (+ 98us) client_negotiation.cc:240] Negotiation successful
0811 15:05:59.712596 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":325,"mutex_wait_us":43,"spinlock_wait_cycles":384,"thread_start_us":136,"threads_started":1}
I20260811 15:05:59.713080 2961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:05:59.707878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.67:45597 (local address 127.19.236.66:60905)
0811 15:05:59.708300 (+ 422us) negotiation.cc:107] Waiting for socket to connect
0811 15:05:59.708313 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 15:05:59.708398 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:05:59.708750 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:05:59.708754 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:05:59.708775 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:05:59.708934 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:05:59.708940 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:05:59.710040 (+ 1100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:05:59.710045 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:05:59.711154 (+ 1109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:05:59.711165 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:05:59.712074 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:05:59.712078 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:05:59.712184 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:05:59.712212 (+ 28us) client_negotiation.cc:769] Sending connection context
0811 15:05:59.712841 (+ 629us) client_negotiation.cc:240] Negotiation successful
0811 15:05:59.712916 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":351,"mutex_wait_us":46,"spinlock_wait_cycles":5120,"thread_start_us":134,"threads_started":1}
I20260811 15:05:59.713898 2524 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7122f1ed959d4f099a58a86b967a55c3" candidate_uuid: "6a2691b26f324f2f909836704b30b1d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12672a90aa9b45e9a419f5da5f5d8620" is_pre_election: true
I20260811 15:05:59.714351 2524 raft_consensus.cc:2454] T 7122f1ed959d4f099a58a86b967a55c3 P 12672a90aa9b45e9a419f5da5f5d8620 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a2691b26f324f2f909836704b30b1d8 in term 0.
I20260811 15:05:59.714923 2605 leader_election.cc:302] T 7122f1ed959d4f099a58a86b967a55c3 P 6a2691b26f324f2f909836704b30b1d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 12672a90aa9b45e9a419f5da5f5d8620, 6a2691b26f324f2f909836704b30b1d8; no voters:
I20260811 15:05:59.715004 2829 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7122f1ed959d4f099a58a86b967a55c3" candidate_uuid: "6a2691b26f324f2f909836704b30b1d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd8331aed45e4155908fbcc08c16c3c5" is_pre_election: true
I20260811 15:05:59.715291 2829 raft_consensus.cc:2454] T 7122f1ed959d4f099a58a86b967a55c3 P cd8331aed45e4155908fbcc08c16c3c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a2691b26f324f2f909836704b30b1d8 in term 0.
I20260811 15:05:59.715255 2951 raft_consensus.cc:2781] T 7122f1ed959d4f099a58a86b967a55c3 P 6a2691b26f324f2f909836704b30b1d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 15:05:59.715369 2951 raft_consensus.cc:482] T 7122f1ed959d4f099a58a86b967a55c3 P 6a2691b26f324f2f909836704b30b1d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 15:05:59.715420 2951 raft_consensus.cc:3037] T 7122f1ed959d4f099a58a86b967a55c3 P 6a2691b26f324f2f909836704b30b1d8 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:05:59.716543 2951 raft_consensus.cc:504] T 7122f1ed959d4f099a58a86b967a55c3 P 6a2691b26f324f2f909836704b30b1d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a2691b26f324f2f909836704b30b1d8" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 45339 } } peers { permanent_uuid: "12672a90aa9b45e9a419f5da5f5d8620" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 38513 } } peers { permanent_uuid: "cd8331aed45e4155908fbcc08c16c3c5" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 45597 } }
I20260811 15:05:59.717048 2951 leader_election.cc:288] T 7122f1ed959d4f099a58a86b967a55c3 P 6a2691b26f324f2f909836704b30b1d8 [CANDIDATE]: Term 1 election: Requested vote from peers 12672a90aa9b45e9a419f5da5f5d8620 (127.19.236.65:38513), cd8331aed45e4155908fbcc08c16c3c5 (127.19.236.67:45597)
I20260811 15:05:59.717422 2524 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7122f1ed959d4f099a58a86b967a55c3" candidate_uuid: "6a2691b26f324f2f909836704b30b1d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12672a90aa9b45e9a419f5da5f5d8620"
I20260811 15:05:59.717504 2829 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7122f1ed959d4f099a58a86b967a55c3" candidate_uuid: "6a2691b26f324f2f909836704b30b1d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd8331aed45e4155908fbcc08c16c3c5"
I20260811 15:05:59.717572 2524 raft_consensus.cc:3037] T 7122f1ed959d4f099a58a86b967a55c3 P 12672a90aa9b45e9a419f5da5f5d8620 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:05:59.717610 2829 raft_consensus.cc:3037] T 7122f1ed959d4f099a58a86b967a55c3 P cd8331aed45e4155908fbcc08c16c3c5 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:05:59.718915 2524 raft_consensus.cc:2454] T 7122f1ed959d4f099a58a86b967a55c3 P 12672a90aa9b45e9a419f5da5f5d8620 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a2691b26f324f2f909836704b30b1d8 in term 1.
I20260811 15:05:59.718915 2829 raft_consensus.cc:2454] T 7122f1ed959d4f099a58a86b967a55c3 P cd8331aed45e4155908fbcc08c16c3c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a2691b26f324f2f909836704b30b1d8 in term 1.
I20260811 15:05:59.719249 2607 leader_election.cc:302] T 7122f1ed959d4f099a58a86b967a55c3 P 6a2691b26f324f2f909836704b30b1d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a2691b26f324f2f909836704b30b1d8, cd8331aed45e4155908fbcc08c16c3c5; no voters:
I20260811 15:05:59.719424 2951 raft_consensus.cc:2781] T 7122f1ed959d4f099a58a86b967a55c3 P 6a2691b26f324f2f909836704b30b1d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:05:59.719719 2951 raft_consensus.cc:686] T 7122f1ed959d4f099a58a86b967a55c3 P 6a2691b26f324f2f909836704b30b1d8 [term 1 LEADER]: Becoming Leader. State: Replica: 6a2691b26f324f2f909836704b30b1d8, State: Running, Role: LEADER
I20260811 15:05:59.720089 2951 consensus_queue.cc:237] T 7122f1ed959d4f099a58a86b967a55c3 P 6a2691b26f324f2f909836704b30b1d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a2691b26f324f2f909836704b30b1d8" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 45339 } } peers { permanent_uuid: "12672a90aa9b45e9a419f5da5f5d8620" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 38513 } } peers { permanent_uuid: "cd8331aed45e4155908fbcc08c16c3c5" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 45597 } }
I20260811 15:05:59.723878 2348 catalog_manager.cc:5495] T 7122f1ed959d4f099a58a86b967a55c3 P 6a2691b26f324f2f909836704b30b1d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6a2691b26f324f2f909836704b30b1d8 (127.19.236.66). New cstate: current_term: 1 leader_uuid: "6a2691b26f324f2f909836704b30b1d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a2691b26f324f2f909836704b30b1d8" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 45339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "12672a90aa9b45e9a419f5da5f5d8620" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 38513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd8331aed45e4155908fbcc08c16c3c5" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 45597 } health_report { overall_health: UNKNOWN } } }
I20260811 15:05:59.742169 2941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:05:59.737942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59004 (local address 127.19.236.66:45339)
0811 15:05:59.738098 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0811 15:05:59.738108 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 15:05:59.738126 (+ 18us) server_negotiation.cc:407] Connection header received
0811 15:05:59.738343 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:05:59.738346 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:05:59.738410 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:05:59.738512 (+ 102us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 15:05:59.738794 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:05:59.739303 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:05:59.740504 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:05:59.740811 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:05:59.740894 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:05:59.741234 (+ 340us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 15:05:59.741666 (+ 432us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 15:05:59.741758 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0811 15:05:59.741888 (+ 130us) server_negotiation.cc:299] Negotiation successful
0811 15:05:59.741953 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 15:05:59.748422 2524 raft_consensus.cc:1261] T 7122f1ed959d4f099a58a86b967a55c3 P 12672a90aa9b45e9a419f5da5f5d8620 [term 1 FOLLOWER]: Refusing update from remote peer 6a2691b26f324f2f909836704b30b1d8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:05:59.748422 2829 raft_consensus.cc:1261] T 7122f1ed959d4f099a58a86b967a55c3 P cd8331aed45e4155908fbcc08c16c3c5 [term 1 FOLLOWER]: Refusing update from remote peer 6a2691b26f324f2f909836704b30b1d8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:05:59.749272 2951 consensus_queue.cc:1035] T 7122f1ed959d4f099a58a86b967a55c3 P 6a2691b26f324f2f909836704b30b1d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd8331aed45e4155908fbcc08c16c3c5" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 45597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:05:59.749672 2964 consensus_queue.cc:1035] T 7122f1ed959d4f099a58a86b967a55c3 P 6a2691b26f324f2f909836704b30b1d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12672a90aa9b45e9a419f5da5f5d8620" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 38513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:05:59.758693 2969 mvcc.cc:205] Tried to move back new op lower bound from 7317343271921373184 to 7317343271816683520. Current Snapshot: MvccSnapshot[applied={T|T < 7317343271921373184}]
I20260811 15:05:59.759752 2968 mvcc.cc:205] Tried to move back new op lower bound from 7317343271921373184 to 7317343271816683520. Current Snapshot: MvccSnapshot[applied={T|T < 7317343271921373184}]
I20260811 15:05:59.769115 2349 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44278:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 15:05:59.769323 2349 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44278:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 15:05:59.772266 2349 catalog_manager.cc:5782] T 00000000000000000000000000000000 P da1a7f01325c44ceb3d4df91e9f34424: Sending DeleteTablet for 3 replicas of tablet 7122f1ed959d4f099a58a86b967a55c3
I20260811 15:05:59.773344 2480 tablet_service.cc:1514] Processing DeleteTablet for tablet 7122f1ed959d4f099a58a86b967a55c3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:05:59 UTC) from {username='kudu', principal='kudu/127.19.236.126@KRBTEST.COM'} at 127.0.0.1:51280
I20260811 15:05:59.774395 2634 tablet_service.cc:1514] Processing DeleteTablet for tablet 7122f1ed959d4f099a58a86b967a55c3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:05:59 UTC) from {username='kudu', principal='kudu/127.19.236.126@KRBTEST.COM'} at 127.0.0.1:58988
I20260811 15:05:59.774595 2816 tablet_service.cc:1514] Processing DeleteTablet for tablet 7122f1ed959d4f099a58a86b967a55c3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:05:59 UTC) from {username='kudu', principal='kudu/127.19.236.126@KRBTEST.COM'} at 127.0.0.1:37176
I20260811 15:05:59.775341 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 2391
W20260811 15:05:59.788179 2334 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.19.236.65:38513 (error 108)
I20260811 15:05:59.788333 2980 tablet_replica.cc:330] T 7122f1ed959d4f099a58a86b967a55c3 P cd8331aed45e4155908fbcc08c16c3c5: stopping tablet replica
I20260811 15:05:59.788769 2980 raft_consensus.cc:2229] T 7122f1ed959d4f099a58a86b967a55c3 P cd8331aed45e4155908fbcc08c16c3c5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 15:05:59.789160 2980 raft_consensus.cc:2258] T 7122f1ed959d4f099a58a86b967a55c3 P cd8331aed45e4155908fbcc08c16c3c5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:05:59.789395 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 2579
I20260811 15:05:59.789561 2979 tablet_replica.cc:330] T 7122f1ed959d4f099a58a86b967a55c3 P 6a2691b26f324f2f909836704b30b1d8: stopping tablet replica
I20260811 15:05:59.792066 2980 ts_tablet_manager.cc:1905] T 7122f1ed959d4f099a58a86b967a55c3 P cd8331aed45e4155908fbcc08c16c3c5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 15:05:59.793336 2936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:05:59.792959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.65:38513 (local address 127.0.0.1:51288)
0811 15:05:59.793168 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0811 15:05:59.793240 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.65:38513: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126}
W20260811 15:05:59.793529 2334 catalog_manager.cc:4584] TS 12672a90aa9b45e9a419f5da5f5d8620 (127.19.236.65:38513): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 7122f1ed959d4f099a58a86b967a55c3: Network error: Client connection negotiation failed: client connection to 127.19.236.65:38513: connect: Connection refused (error 111)
I20260811 15:05:59.796149 2980 ts_tablet_manager.cc:1918] T 7122f1ed959d4f099a58a86b967a55c3 P cd8331aed45e4155908fbcc08c16c3c5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 15:05:59.796275 2980 log.cc:1196] T 7122f1ed959d4f099a58a86b967a55c3 P cd8331aed45e4155908fbcc08c16c3c5: Deleting WAL directory at /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786460596631409-20401-0/minicluster-data/ts-2/wal/wals/7122f1ed959d4f099a58a86b967a55c3
I20260811 15:05:59.796728 2980 ts_tablet_manager.cc:1939] T 7122f1ed959d4f099a58a86b967a55c3 P cd8331aed45e4155908fbcc08c16c3c5: Deleting consensus metadata
I20260811 15:05:59.798357 2336 catalog_manager.cc:4841] TS cd8331aed45e4155908fbcc08c16c3c5 (127.19.236.67:45597): tablet 7122f1ed959d4f099a58a86b967a55c3 (table test-table [id=c91874b893be466389965f7c8964e99d]) successfully deleted
I20260811 15:05:59.799902 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 2740
I20260811 15:05:59.804766 2936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:05:59.804365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.66:45339 (local address 127.0.0.1:59006)
0811 15:05:59.804571 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0811 15:05:59.804648 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.66:45339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260811 15:05:59.809270 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 2313
I20260811 15:05:59.821080 20401 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260811 15:06:00.166361 20401 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260811 15:06:00.166491 20401 mini_ranger.cc:66] Stopping Ranger...
I20260811 15:06:00.511885 20401 mini_ranger.cc:68] Stopped Ranger
2026-08-11 15:06:00.512 UTC [1215] LOG: received smart shutdown request
2026-08-11 15:06:00.517 UTC [1215] LOG: background worker "logical replication launcher" (PID 1225) exited with exit code 1
2026-08-11 15:06:00.517 UTC [1219] LOG: shutting down
2026-08-11 15:06:00.698 UTC [1215] LOG: database system is shut down
2026-08-11T15:06:00Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (49628 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460596631409-20401-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 15:06:00 dist-test-slave-8n49 krb5kdc[2993](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 15:06:00 dist-test-slave-8n49 krb5kdc[2993](info): set up 2 sockets
Aug 11 15:06:00 dist-test-slave-8n49 krb5kdc[2993](info): commencing operation
krb5kdc: starting...
W20260811 15:06:01.933094 20401 mini_kdc.cc:121] Time spent starting KDC: real 1.089s user 0.006s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460596631409-20401-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460596631409-20401-0/krb5kdc/test-user.keytab.
Aug 11 15:06:02 dist-test-slave-8n49 krb5kdc[2993](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460762, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T15:06:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T15:06:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.236.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.236.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.236.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab.
Entry for principal kudu/127.19.236.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab.
I20260811 15:06:02.065848 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460596631409-20401-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460596631409-20401-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460596631409-20401-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:40559
--webserver_interface=127.19.236.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab
--principal=kudu/127.19.236.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:45081
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.236.126:40559,127.19.236.125:40969,127.19.236.124:33301
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:06:02.180214 3010 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:06:02.180534 3010 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:06:02.180629 3010 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:06:02.184641 3010 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:06:02.184728 3010 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:06:02.184767 3010 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:06:02.184821 3010 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:06:02.184855 3010 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:06:02.190263 3010 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:45081
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460596631409-20401-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460596631409-20401-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.236.126:40559,127.19.236.125:40969,127.19.236.124:33301
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab
--principal=kudu/127.19.236.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:40559
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.236.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3010
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460596631409-20401-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:06:02.191447 3010 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:06:02.192533 3010 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:06:02.201403 3019 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:06:02.201406 3017 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:06:02.201443 3010 server_base.cc:1034] running on GCE node
W20260811 15:06:02.201403 3016 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:06:02.202251 3010 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:06:02.203320 3010 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:06:02.204515 3010 hybrid_clock.cc:648] HybridClock initialized: now 1786460762204487 us; error 38 us; skew 500 ppm
Aug 11 15:06:02 dist-test-slave-8n49 krb5kdc[2993](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460762, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:06:02.207542 3010 init.cc:377] Logged in from keytab as kudu/127.19.236.126@KRBTEST.COM (short username kudu)
I20260811 15:06:02.208508 3010 webserver.cc:460] Webserver started at http://127.19.236.126:37081/ using document root <none> and password file <none>
I20260811 15:06:02.209122 3010 fs_manager.cc:359] Metadata directory not provided
I20260811 15:06:02.209187 3010 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:06:02.209432 3010 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:06:02.211531 3010 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460596631409-20401-0/minicluster-data/master-0/data/instance:
uuid: "7e50ceb4d4b64410bce4b0994ca39d00"
format_stamp: "Formatted at 2026-08-11 15:06:02 on dist-test-slave-8n49"
server_key: "d36dd304f38649e089633efeb9f7464b"
server_key_iv: "5cc2d2bd90b255c735c5cd24349f1d61"
server_key_version: "encryptionkey@0"
I20260811 15:06:02.212129 3010 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460596631409-20401-0/minicluster-data/master-0/wal/instance:
uuid: "7e50ceb4d4b64410bce4b0994ca39d00"
format_stamp: "Formatted at 2026-08-11 15:06:02 on dist-test-slave-8n49"
server_key: "d36dd304f38649e089633efeb9f7464b"
server_key_iv: "5cc2d2bd90b255c735c5cd24349f1d61"
server_key_version: "encryptionkey@0"
I20260811 15:06:02.216037 3010 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260811 15:06:02.218506 3027 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:06:02.219718 3010 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 15:06:02.219857 3010 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460596631409-20401-0/minicluster-data/master-0/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460596631409-20401-0/minicluster-data/master-0/wal
uuid: "7e50ceb4d4b64410bce4b0994ca39d00"
format_stamp: "Formatted at 2026-08-11 15:06:02 on dist-test-slave-8n49"
server_key: "d36dd304f38649e089633efeb9f7464b"
server_key_iv: "5cc2d2bd90b255c735c5cd24349f1d61"
server_key_version: "encryptionkey@0"
I20260811 15:06:02.219980 3010 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460596631409-20401-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460596631409-20401-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460596631409-20401-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:06:02.237190 3010 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:06:02.240089 3010 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:06:02.240291 3010 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:06:02.247587 3010 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.126:40559
I20260811 15:06:02.247895 3086 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.126:40559 every 8 connection(s)
I20260811 15:06:02.248600 3010 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
I20260811 15:06:02.251448 3088 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:06:02.253152 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 3010
I20260811 15:06:02.253289 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460596631409-20401-0/minicluster-data/master-0/wal/instance
I20260811 15:06:02.253626 20401 external_mini_cluster.cc:1428] Setting key f947f92ed9ac63caa34914d493dd6c61
I20260811 15:06:02.256800 3088 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.236.126" port: 40559 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.19.236.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.236.125@KRBTEST.COM" created.
Aug 11 15:06:02 dist-test-slave-8n49 krb5kdc[2993](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460762, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.126@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
I20260811 15:06:02.273234 3091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:02.259180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:40559 (local address 127.0.0.1:51402)
0811 15:06:02.259817 (+ 637us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:02.259876 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0811 15:06:02.261087 (+ 1211us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:06:02.261795 (+ 708us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:06:02.261801 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:06:02.262271 (+ 470us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:06:02.262676 (+ 405us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:06:02.262696 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:06:02.263892 (+ 1196us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:06:02.263895 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:06:02.264764 (+ 869us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:06:02.264775 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:06:02.265564 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:06:02.265567 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:06:02.265666 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:02.266273 (+ 607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:06:02.266299 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:06:02.268009 (+ 1710us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:06:02.270208 (+ 2199us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:06:02.270216 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:06:02.270224 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:06:02.270451 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:06:02.270853 (+ 402us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:06:02.270855 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:06:02.270856 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:06:02.271005 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:06:02.271807 (+ 802us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:06:02.271812 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:06:02.271940 (+ 128us) client_negotiation.cc:769] Sending connection context
0811 15:06:02.272082 (+ 142us) client_negotiation.cc:240] Negotiation successful
0811 15:06:02.272354 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":370,"thread_start_us":161,"threads_started":1}
I20260811 15:06:02.273238 3092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:02.259180 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51402 (local address 127.19.236.126:40559)
0811 15:06:02.259787 (+ 607us) server_negotiation.cc:206] Beginning negotiation
0811 15:06:02.259805 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 15:06:02.259999 (+ 194us) server_negotiation.cc:407] Connection header received
0811 15:06:02.261399 (+ 1400us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:06:02.261404 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:06:02.261580 (+ 176us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:06:02.261735 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:06:02.262837 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:02.263752 (+ 915us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:02.264876 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:02.265378 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:02.265530 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:02.268165 (+ 2635us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:06:02.268170 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:06:02.268184 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:06:02.268205 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:06:02.270099 (+ 1894us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:06:02.270567 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:06:02.270576 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:06:02.270581 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:06:02.270746 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:06:02.271123 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:06:02.271129 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:06:02.271134 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:06:02.271689 (+ 555us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:06:02.271847 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0811 15:06:02.272203 (+ 356us) server_negotiation.cc:299] Negotiation successful
0811 15:06:02.272496 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":43,"server-negotiator.queue_time_us":481,"spinlock_wait_cycles":57088,"thread_start_us":161,"threads_started":1}
I20260811 15:06:02.275825 3088 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.236.125" port: 40969 } has no permanent_uuid. Determining permanent_uuid...
I20260811 15:06:02.276654 3091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:02.276317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.125:40969 (local address 127.0.0.1:34470)
0811 15:06:02.276455 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:02.276525 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.125:40969: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260811 15:06:02.276878 3028 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.236.125:40969: connect: Connection refused (error 111)
I20260811 15:06:02.277808 3091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:02.277590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.125:40969 (local address 127.0.0.1:34472)
0811 15:06:02.277704 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:02.277756 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.125:40969: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260811 15:06:02.277957 3088 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.236.125:40969: Network error: Client connection negotiation failed: client connection to 127.19.236.125:40969: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.236.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.125.keytab.
Entry for principal kudu/127.19.236.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.125.keytab.
I20260811 15:06:02.285002 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460596631409-20401-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460596631409-20401-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460596631409-20401-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460596631409-20401-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.125:40969
--webserver_interface=127.19.236.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.125.keytab
--principal=kudu/127.19.236.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:45081
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.236.126:40559,127.19.236.125:40969,127.19.236.124:33301
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 15:06:02.327234 3088 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.236.125" port: 40969 } attempt: 1
I20260811 15:06:02.328172 3091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:02.327851 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.125:40969 (local address 127.0.0.1:34480)
0811 15:06:02.328013 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:02.328088 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.125:40969: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260811 15:06:02.328975 3091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:02.328742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.125:40969 (local address 127.0.0.1:34484)
0811 15:06:02.328863 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:02.328914 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.125:40969: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260811 15:06:02.329139 3088 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.236.125:40969: Network error: Client connection negotiation failed: client connection to 127.19.236.125:40969: connect: Connection refused (error 111)
I20260811 15:06:02.397301 3088 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.236.125" port: 40969 } attempt: 2
I20260811 15:06:02.398269 3091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:02.397911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.125:40969 (local address 127.0.0.1:34498)
0811 15:06:02.398098 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:02.398172 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.125:40969: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260811 15:06:02.399073 3091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:02.398827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.125:40969 (local address 127.0.0.1:34506)
0811 15:06:02.398941 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:02.398996 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.125:40969: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260811 15:06:02.399214 3088 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.236.125:40969: Network error: Client connection negotiation failed: client connection to 127.19.236.125:40969: connect: Connection refused (error 111)
W20260811 15:06:02.403190 3095 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:06:02.403455 3095 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:06:02.403496 3095 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:06:02.407596 3095 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:06:02.407655 3095 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:06:02.407675 3095 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:06:02.407691 3095 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:06:02.407707 3095 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:06:02.413174 3095 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:45081
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460596631409-20401-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460596631409-20401-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.19.236.126:40559,127.19.236.125:40969,127.19.236.124:33301
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.125.keytab
--principal=kudu/127.19.236.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.125:40969
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460596631409-20401-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.19.236.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3095
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460596631409-20401-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:06:02.414281 3095 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:06:02.415342 3095 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:06:02.424304 3105 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:06:02.424324 3100 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:06:02.424453 3095 server_base.cc:1034] running on GCE node
W20260811 15:06:02.424611 3102 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:06:02.425174 3095 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:06:02.426330 3095 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:06:02.427551 3095 hybrid_clock.cc:648] HybridClock initialized: now 1786460762427526 us; error 38 us; skew 500 ppm
Aug 11 15:06:02 dist-test-slave-8n49 krb5kdc[2993](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460762, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:06:02.430437 3095 init.cc:377] Logged in from keytab as kudu/127.19.236.125@KRBTEST.COM (short username kudu)
I20260811 15:06:02.431308 3095 webserver.cc:460] Webserver started at http://127.19.236.125:40223/ using document root <none> and password file <none>
I20260811 15:06:02.431856 3095 fs_manager.cc:359] Metadata directory not provided
I20260811 15:06:02.431913 3095 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:06:02.432083 3095 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:06:02.434214 3095 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460596631409-20401-0/minicluster-data/master-1/data/instance:
uuid: "95cf6f1147f34494b529aec20cc71c90"
format_stamp: "Formatted at 2026-08-11 15:06:02 on dist-test-slave-8n49"
server_key: "e62d4092850b7d94e7413346e93c22fd"
server_key_iv: "6c38a6a7b793b550cf38a8708db5435e"
server_key_version: "encryptionkey@0"
I20260811 15:06:02.434752 3095 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460596631409-20401-0/minicluster-data/master-1/wal/instance:
uuid: "95cf6f1147f34494b529aec20cc71c90"
format_stamp: "Formatted at 2026-08-11 15:06:02 on dist-test-slave-8n49"
server_key: "e62d4092850b7d94e7413346e93c22fd"
server_key_iv: "6c38a6a7b793b550cf38a8708db5435e"
server_key_version: "encryptionkey@0"
I20260811 15:06:02.438694 3095 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 15:06:02.441260 3116 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:06:02.442549 3095 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 15:06:02.442684 3095 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460596631409-20401-0/minicluster-data/master-1/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460596631409-20401-0/minicluster-data/master-1/wal
uuid: "95cf6f1147f34494b529aec20cc71c90"
format_stamp: "Formatted at 2026-08-11 15:06:02 on dist-test-slave-8n49"
server_key: "e62d4092850b7d94e7413346e93c22fd"
server_key_iv: "6c38a6a7b793b550cf38a8708db5435e"
server_key_version: "encryptionkey@0"
I20260811 15:06:02.442801 3095 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460596631409-20401-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460596631409-20401-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460596631409-20401-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:06:02.455296 3095 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:06:02.458745 3095 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:06:02.458961 3095 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:06:02.465994 3095 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.125:40969
I20260811 15:06:02.466288 3174 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.125:40969 every 8 connection(s)
I20260811 15:06:02.467027 3095 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460596631409-20401-0/minicluster-data/master-1/data/info.pb
I20260811 15:06:02.470125 3175 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:06:02.472347 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 3095
I20260811 15:06:02.472500 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460596631409-20401-0/minicluster-data/master-1/wal/instance
I20260811 15:06:02.472815 20401 external_mini_cluster.cc:1428] Setting key cc076ab8af2157becd6b196cc31608d7
I20260811 15:06:02.474552 3175 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.236.126" port: 40559 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.19.236.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.236.124@KRBTEST.COM" created.
Aug 11 15:06:02 dist-test-slave-8n49 krb5kdc[2993](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460762, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.125@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
I20260811 15:06:02.490373 3088 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.236.125" port: 40969 } attempt: 3
I20260811 15:06:02.491082 3092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:02.477124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51410 (local address 127.19.236.126:40559)
0811 15:06:02.477301 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0811 15:06:02.477307 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 15:06:02.478299 (+ 992us) server_negotiation.cc:407] Connection header received
0811 15:06:02.479319 (+ 1020us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:06:02.479326 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:06:02.479403 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:06:02.479523 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:06:02.480820 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:02.481724 (+ 904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:02.483027 (+ 1303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:02.483274 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:02.483372 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:02.486160 (+ 2788us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:06:02.486164 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:06:02.486166 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:06:02.486193 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:06:02.488082 (+ 1889us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:06:02.488864 (+ 782us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:06:02.488867 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:06:02.488869 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:06:02.488992 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:06:02.489504 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:06:02.489510 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:06:02.489514 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:06:02.489805 (+ 291us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:06:02.489899 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0811 15:06:02.490610 (+ 711us) server_negotiation.cc:299] Negotiation successful
0811 15:06:02.490793 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 15:06:02.491982 3178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:02.477559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:40559 (local address 127.0.0.1:51410)
0811 15:06:02.478106 (+ 547us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:02.478163 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0811 15:06:02.479093 (+ 930us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:06:02.479694 (+ 601us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:06:02.479701 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:06:02.480060 (+ 359us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:06:02.480650 (+ 590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:06:02.480669 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:06:02.481858 (+ 1189us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:06:02.481861 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:06:02.482900 (+ 1039us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:06:02.482911 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:06:02.483474 (+ 563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:06:02.483478 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:06:02.483644 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:02.484362 (+ 718us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:06:02.484379 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:06:02.485973 (+ 1594us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:06:02.488237 (+ 2264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:06:02.488242 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:06:02.488259 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:06:02.488749 (+ 490us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:06:02.489122 (+ 373us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:06:02.489126 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:06:02.489130 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:06:02.489330 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:06:02.489975 (+ 645us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:06:02.489982 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:06:02.490258 (+ 276us) client_negotiation.cc:769] Sending connection context
0811 15:06:02.490474 (+ 216us) client_negotiation.cc:240] Negotiation successful
0811 15:06:02.490853 (+ 379us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":324,"thread_start_us":157,"threads_started":1}
I20260811 15:06:02.493726 3175 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.236.125" port: 40969 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 15:06:02 dist-test-slave-8n49 krb5kdc[2993](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460762, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.126@KRBTEST.COM for kudu/127.19.236.125@KRBTEST.COM
Aug 11 15:06:02 dist-test-slave-8n49 krb5kdc[2993](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460762, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.125@KRBTEST.COM for kudu/127.19.236.125@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.236.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.124.keytab.
Entry for principal kudu/127.19.236.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.124.keytab.
I20260811 15:06:02.503782 3091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:02.490866 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.125:40969 (local address 127.0.0.1:34510)
0811 15:06:02.491227 (+ 361us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:02.491242 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 15:06:02.491317 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:06:02.492430 (+ 1113us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:06:02.492433 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:06:02.492634 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:06:02.492751 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:06:02.492758 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:06:02.493785 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:06:02.493790 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:06:02.494528 (+ 738us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:06:02.494537 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:06:02.495354 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:06:02.495359 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:06:02.495494 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:02.496037 (+ 543us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:06:02.496049 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:06:02.498929 (+ 2880us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:06:02.501728 (+ 2799us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:06:02.501731 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:06:02.501733 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:06:02.501988 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:06:02.502393 (+ 405us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:06:02.502396 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:06:02.502397 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:06:02.502484 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:06:02.503166 (+ 682us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:06:02.503170 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:06:02.503290 (+ 120us) client_negotiation.cc:769] Sending connection context
0811 15:06:02.503413 (+ 123us) client_negotiation.cc:240] Negotiation successful
0811 15:06:02.503577 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":278}
I20260811 15:06:02.503876 3180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:02.491466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34510 (local address 127.19.236.125:40969)
0811 15:06:02.491875 (+ 409us) server_negotiation.cc:206] Beginning negotiation
0811 15:06:02.491893 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 15:06:02.491923 (+ 30us) server_negotiation.cc:407] Connection header received
0811 15:06:02.491980 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:06:02.491989 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:06:02.492249 (+ 260us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:06:02.492427 (+ 178us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:06:02.492917 (+ 490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:02.493660 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:02.494641 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:02.495215 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:02.495321 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:02.499092 (+ 3771us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:06:02.499103 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:06:02.499118 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:06:02.499141 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:06:02.501603 (+ 2462us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:06:02.502124 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:06:02.502131 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:06:02.502133 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:06:02.502255 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:06:02.502622 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:06:02.502630 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:06:02.502635 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:06:02.503038 (+ 403us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:06:02.503208 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0811 15:06:02.503527 (+ 319us) server_negotiation.cc:299] Negotiation successful
0811 15:06:02.503688 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":265,"thread_start_us":134,"threads_started":1}
I20260811 15:06:02.504421 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460596631409-20401-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460596631409-20401-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460596631409-20401-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460596631409-20401-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.124:33301
--webserver_interface=127.19.236.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.124.keytab
--principal=kudu/127.19.236.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:45081
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.236.126:40559,127.19.236.125:40969,127.19.236.124:33301
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 15:06:02.504810 3178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:02.494285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.125:40969 (local address 127.0.0.1:34514)
0811 15:06:02.494936 (+ 651us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:02.494949 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 15:06:02.495022 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:06:02.495471 (+ 449us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:06:02.495474 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:06:02.495629 (+ 155us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:06:02.495746 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:06:02.495754 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:06:02.496775 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:06:02.496778 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:06:02.497387 (+ 609us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:06:02.497396 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:06:02.498005 (+ 609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:06:02.498010 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:06:02.498115 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:02.498568 (+ 453us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:06:02.498585 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:06:02.500155 (+ 1570us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:06:02.503054 (+ 2899us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:06:02.503059 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:06:02.503065 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:06:02.503358 (+ 293us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:06:02.503704 (+ 346us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:06:02.503707 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:06:02.503709 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:06:02.503796 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:06:02.504214 (+ 418us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:06:02.504217 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:06:02.504313 (+ 96us) client_negotiation.cc:769] Sending connection context
0811 15:06:02.504434 (+ 121us) client_negotiation.cc:240] Negotiation successful
0811 15:06:02.504620 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":592}
I20260811 15:06:02.504992 3181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:02.494717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34514 (local address 127.19.236.125:40969)
0811 15:06:02.495238 (+ 521us) server_negotiation.cc:206] Beginning negotiation
0811 15:06:02.495250 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 15:06:02.495263 (+ 13us) server_negotiation.cc:407] Connection header received
0811 15:06:02.495295 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:06:02.495298 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:06:02.495337 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:06:02.495461 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:06:02.495885 (+ 424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:02.496644 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:02.497507 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:02.497833 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:02.497979 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:02.500317 (+ 2338us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:06:02.500322 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:06:02.500325 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:06:02.500356 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:06:02.502916 (+ 2560us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:06:02.503503 (+ 587us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:06:02.503509 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:06:02.503513 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:06:02.503606 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:06:02.503891 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:06:02.503894 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:06:02.503897 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:06:02.504100 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:06:02.504211 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0811 15:06:02.504520 (+ 309us) server_negotiation.cc:299] Negotiation successful
0811 15:06:02.504698 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":461,"thread_start_us":107,"threads_started":1}
I20260811 15:06:02.508275 3175 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.236.124" port: 33301 } has no permanent_uuid. Determining permanent_uuid...
I20260811 15:06:02.508482 3088 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.236.124" port: 33301 } has no permanent_uuid. Determining permanent_uuid...
I20260811 15:06:02.509284 3178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:02.508906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.124:33301 (local address 127.0.0.1:33392)
0811 15:06:02.509070 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:02.509161 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.124:33301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260811 15:06:02.509588 3118 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.236.124:33301: connect: Connection refused (error 111)
I20260811 15:06:02.509907 3091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:02.508984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.124:33301 (local address 127.0.0.1:33394)
0811 15:06:02.509778 (+ 794us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:02.509840 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.124:33301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":709}
I20260811 15:06:02.510672 3178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:02.510411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.124:33301 (local address 127.0.0.1:33396)
0811 15:06:02.510543 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:02.510601 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.124:33301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260811 15:06:02.510767 3091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:02.510464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.124:33301 (local address 127.0.0.1:33404)
0811 15:06:02.510651 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:02.510705 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.124:33301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127}
W20260811 15:06:02.510921 3088 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.236.124:33301: Network error: Client connection negotiation failed: client connection to 127.19.236.124:33301: connect: Connection refused (error 111)
W20260811 15:06:02.510924 3175 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.236.124:33301: Network error: Client connection negotiation failed: client connection to 127.19.236.124:33301: connect: Connection refused (error 111)
I20260811 15:06:02.542086 3088 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.236.124" port: 33301 } attempt: 1
I20260811 15:06:02.542971 3091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:02.542652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.124:33301 (local address 127.0.0.1:33408)
0811 15:06:02.542815 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:02.542885 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.124:33301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260811 15:06:02.543685 3091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:02.543470 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.124:33301 (local address 127.0.0.1:33424)
0811 15:06:02.543576 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:02.543631 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.124:33301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260811 15:06:02.543817 3088 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.236.124:33301: Network error: Client connection negotiation failed: client connection to 127.19.236.124:33301: connect: Connection refused (error 111)
I20260811 15:06:02.560252 3175 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.236.124" port: 33301 } attempt: 1
I20260811 15:06:02.561252 3178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:02.560932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.124:33301 (local address 127.0.0.1:33428)
0811 15:06:02.561095 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:02.561165 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.124:33301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260811 15:06:02.562070 3178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:02.561839 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.124:33301 (local address 127.0.0.1:33436)
0811 15:06:02.561948 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:02.561999 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.124:33301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260811 15:06:02.562249 3175 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.236.124:33301: Network error: Client connection negotiation failed: client connection to 127.19.236.124:33301: connect: Connection refused (error 111)
I20260811 15:06:02.618989 3088 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.236.124" port: 33301 } attempt: 2
I20260811 15:06:02.619860 3091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:02.619555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.124:33301 (local address 127.0.0.1:33444)
0811 15:06:02.619710 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:02.619780 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.124:33301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260811 15:06:02.620780 3091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:02.620541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.124:33301 (local address 127.0.0.1:33460)
0811 15:06:02.620674 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:02.620723 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.124:33301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260811 15:06:02.621048 3088 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.236.124:33301: Network error: Client connection negotiation failed: client connection to 127.19.236.124:33301: connect: Connection refused (error 111)
W20260811 15:06:02.622607 3182 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:06:02.622866 3182 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:06:02.622910 3182 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:06:02.627147 3182 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:06:02.627210 3182 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:06:02.627230 3182 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:06:02.627247 3182 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:06:02.627264 3182 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:06:02.630445 3175 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.236.124" port: 33301 } attempt: 2
I20260811 15:06:02.631260 3178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:02.630964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.124:33301 (local address 127.0.0.1:33476)
0811 15:06:02.631110 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:02.631177 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.124:33301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260811 15:06:02.632102 3178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:02.631833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.124:33301 (local address 127.0.0.1:33486)
0811 15:06:02.631985 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:02.632038 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.124:33301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260811 15:06:02.632320 3175 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.236.124:33301: Network error: Client connection negotiation failed: client connection to 127.19.236.124:33301: connect: Connection refused (error 111)
I20260811 15:06:02.633491 3182 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:45081
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460596631409-20401-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460596631409-20401-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.19.236.126:40559,127.19.236.125:40969,127.19.236.124:33301
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.124.keytab
--principal=kudu/127.19.236.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.124:33301
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460596631409-20401-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.19.236.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3182
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460596631409-20401-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:06:02.634684 3182 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:06:02.635787 3182 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:06:02.645172 3193 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:06:02.645176 3195 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:06:02.645166 3191 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:06:02.645566 3182 server_base.cc:1034] running on GCE node
I20260811 15:06:02.646229 3182 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:06:02.647451 3182 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:06:02.648648 3182 hybrid_clock.cc:648] HybridClock initialized: now 1786460762648631 us; error 28 us; skew 500 ppm
Aug 11 15:06:02 dist-test-slave-8n49 krb5kdc[2993](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460762, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:06:02.651458 3182 init.cc:377] Logged in from keytab as kudu/127.19.236.124@KRBTEST.COM (short username kudu)
I20260811 15:06:02.652377 3182 webserver.cc:460] Webserver started at http://127.19.236.124:34229/ using document root <none> and password file <none>
I20260811 15:06:02.653000 3182 fs_manager.cc:359] Metadata directory not provided
I20260811 15:06:02.653066 3182 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:06:02.653301 3182 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:06:02.655386 3182 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460596631409-20401-0/minicluster-data/master-2/data/instance:
uuid: "63d8096b89664140923360ecb44554c4"
format_stamp: "Formatted at 2026-08-11 15:06:02 on dist-test-slave-8n49"
server_key: "d79c0c7e50a51e4c439b6e43c89c5a9a"
server_key_iv: "23f722f1d1848d39b416441b4c808a0e"
server_key_version: "encryptionkey@0"
I20260811 15:06:02.655982 3182 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460596631409-20401-0/minicluster-data/master-2/wal/instance:
uuid: "63d8096b89664140923360ecb44554c4"
format_stamp: "Formatted at 2026-08-11 15:06:02 on dist-test-slave-8n49"
server_key: "d79c0c7e50a51e4c439b6e43c89c5a9a"
server_key_iv: "23f722f1d1848d39b416441b4c808a0e"
server_key_version: "encryptionkey@0"
I20260811 15:06:02.659838 3182 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260811 15:06:02.662449 3204 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:06:02.663647 3182 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260811 15:06:02.663781 3182 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460596631409-20401-0/minicluster-data/master-2/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460596631409-20401-0/minicluster-data/master-2/wal
uuid: "63d8096b89664140923360ecb44554c4"
format_stamp: "Formatted at 2026-08-11 15:06:02 on dist-test-slave-8n49"
server_key: "d79c0c7e50a51e4c439b6e43c89c5a9a"
server_key_iv: "23f722f1d1848d39b416441b4c808a0e"
server_key_version: "encryptionkey@0"
I20260811 15:06:02.663897 3182 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460596631409-20401-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460596631409-20401-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460596631409-20401-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:06:02.693082 3182 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:06:02.696535 3182 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:06:02.696790 3182 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:06:02.704891 3182 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.124:33301
I20260811 15:06:02.705215 3262 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.124:33301 every 8 connection(s)
I20260811 15:06:02.706001 3182 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460596631409-20401-0/minicluster-data/master-2/data/info.pb
I20260811 15:06:02.709159 3263 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:06:02.712610 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 3182
I20260811 15:06:02.712761 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786460596631409-20401-0/minicluster-data/master-2/wal/instance
I20260811 15:06:02.713214 20401 external_mini_cluster.cc:1428] Setting key fdb626547a8f346669b14469e2b670b0
I20260811 15:06:02.713663 3263 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.236.126" port: 40559 } has no permanent_uuid. Determining permanent_uuid...
I20260811 15:06:02.720250 3088 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.236.124" port: 33301 } attempt: 3
Aug 11 15:06:02 dist-test-slave-8n49 krb5kdc[2993](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460762, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.124@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
Aug 11 15:06:02 dist-test-slave-8n49 krb5kdc[2993](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460762, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.236.124@KRBTEST.COM
I20260811 15:06:02.723537 3175 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.236.124" port: 33301 } attempt: 3
Aug 11 15:06:02 dist-test-slave-8n49 krb5kdc[2993](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460762, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.126@KRBTEST.COM for kudu/127.19.236.124@KRBTEST.COM
I20260811 15:06:02.727432 3092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:02.715765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51422 (local address 127.19.236.126:40559)
0811 15:06:02.715895 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0811 15:06:02.715899 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:06:02.716168 (+ 269us) server_negotiation.cc:407] Connection header received
0811 15:06:02.716667 (+ 499us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:06:02.716671 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:06:02.716735 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:06:02.716842 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:06:02.717905 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:02.718513 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:02.719566 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:02.719776 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:02.719854 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:02.722976 (+ 3122us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:06:02.722980 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:06:02.722982 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:06:02.723008 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:06:02.724751 (+ 1743us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:06:02.725560 (+ 809us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:06:02.725564 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:06:02.725566 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:06:02.725651 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:06:02.726080 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:06:02.726087 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:06:02.726090 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:06:02.726327 (+ 237us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:06:02.726408 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 15:06:02.727143 (+ 735us) server_negotiation.cc:299] Negotiation successful
0811 15:06:02.727262 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 15:06:02.729641 3267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:02.715609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:40559 (local address 127.0.0.1:51422)
0811 15:06:02.716011 (+ 402us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:02.716067 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0811 15:06:02.716362 (+ 295us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:06:02.716909 (+ 547us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:06:02.716915 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:06:02.717399 (+ 484us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:06:02.717743 (+ 344us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:06:02.717756 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:06:02.718630 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:06:02.718633 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:06:02.719432 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:06:02.719446 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:06:02.719918 (+ 472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:06:02.719923 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:06:02.720192 (+ 269us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:02.720873 (+ 681us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:06:02.720903 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:06:02.722764 (+ 1861us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:06:02.724881 (+ 2117us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:06:02.724890 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:06:02.724901 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:06:02.725439 (+ 538us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:06:02.725772 (+ 333us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:06:02.725774 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:06:02.725776 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:06:02.725947 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:06:02.726499 (+ 552us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:06:02.726505 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:06:02.726831 (+ 326us) client_negotiation.cc:769] Sending connection context
0811 15:06:02.727931 (+ 1100us) client_negotiation.cc:240] Negotiation successful
0811 15:06:02.728491 (+ 560us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":219,"mutex_wait_us":39,"spinlock_wait_cycles":4992,"thread_start_us":118,"threads_started":1}
I20260811 15:06:02.729645 3266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:02.714733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33496 (local address 127.19.236.124:33301)
0811 15:06:02.715220 (+ 487us) server_negotiation.cc:206] Beginning negotiation
0811 15:06:02.715235 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 15:06:02.715272 (+ 37us) server_negotiation.cc:407] Connection header received
0811 15:06:02.716178 (+ 906us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:06:02.716201 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:06:02.716441 (+ 240us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:06:02.716670 (+ 229us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:06:02.717608 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:02.718623 (+ 1015us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:02.719471 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:02.719936 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:02.720189 (+ 253us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:02.723463 (+ 3274us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:06:02.723473 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:06:02.723491 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:06:02.723909 (+ 418us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:06:02.726050 (+ 2141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:06:02.726569 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:06:02.726578 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:06:02.726579 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:06:02.726665 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:06:02.727025 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:06:02.727030 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:06:02.727033 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:06:02.727367 (+ 334us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:06:02.727608 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0811 15:06:02.728377 (+ 769us) server_negotiation.cc:299] Negotiation successful
0811 15:06:02.728544 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":76,"server-negotiator.queue_time_us":337,"thread_start_us":145,"threads_started":1}
Aug 11 15:06:02 dist-test-slave-8n49 krb5kdc[2993](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460762, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.125@KRBTEST.COM for kudu/127.19.236.124@KRBTEST.COM
I20260811 15:06:02.732038 3263 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.236.125" port: 40969 } has no permanent_uuid. Determining permanent_uuid...
I20260811 15:06:02.732798 3091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:02.720768 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.124:33301 (local address 127.0.0.1:33508)
0811 15:06:02.720987 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:02.721004 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 15:06:02.721082 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:06:02.721536 (+ 454us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:06:02.721541 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:06:02.721730 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:06:02.721810 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:06:02.721815 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:06:02.722570 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:06:02.722574 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:06:02.723392 (+ 818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:06:02.723405 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:06:02.723986 (+ 581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:06:02.723990 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:06:02.724094 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:02.725014 (+ 920us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:06:02.725034 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:06:02.726233 (+ 1199us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:06:02.729105 (+ 2872us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:06:02.729108 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:06:02.729110 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:06:02.729347 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:06:02.729984 (+ 637us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:06:02.729988 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:06:02.729989 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:06:02.730096 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:06:02.731967 (+ 1871us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:06:02.731970 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:06:02.732076 (+ 106us) client_negotiation.cc:769] Sending connection context
0811 15:06:02.732422 (+ 346us) client_negotiation.cc:240] Negotiation successful
0811 15:06:02.732631 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125}
I20260811 15:06:02.733704 3268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:02.720836 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33508 (local address 127.19.236.124:33301)
0811 15:06:02.721257 (+ 421us) server_negotiation.cc:206] Beginning negotiation
0811 15:06:02.721266 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 15:06:02.721281 (+ 15us) server_negotiation.cc:407] Connection header received
0811 15:06:02.721319 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:06:02.721323 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:06:02.721370 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:06:02.721490 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:06:02.721923 (+ 433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:02.722466 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:02.723519 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:02.723839 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:02.724319 (+ 480us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:02.726404 (+ 2085us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:06:02.726409 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:06:02.726411 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:06:02.726437 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:06:02.728976 (+ 2539us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:06:02.729474 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:06:02.729477 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:06:02.729479 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:06:02.729562 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:06:02.731353 (+ 1791us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:06:02.731357 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:06:02.731359 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:06:02.731580 (+ 221us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:06:02.733303 (+ 1723us) server_negotiation.cc:1035] Waiting for connection context
0811 15:06:02.733387 (+ 84us) server_negotiation.cc:299] Negotiation successful
0811 15:06:02.733513 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":347,"thread_start_us":175,"threads_started":1}
I20260811 15:06:02.735190 3178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:02.724799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.124:33301 (local address 127.0.0.1:33524)
0811 15:06:02.724939 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:02.724954 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 15:06:02.725050 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:06:02.726530 (+ 1480us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:06:02.726533 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:06:02.726712 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:06:02.726818 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:06:02.726825 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:06:02.727968 (+ 1143us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:06:02.727972 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:06:02.728752 (+ 780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:06:02.728763 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:06:02.729362 (+ 599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:06:02.729365 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:06:02.729443 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:02.729914 (+ 471us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:06:02.729934 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:06:02.731181 (+ 1247us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:06:02.733550 (+ 2369us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:06:02.733554 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:06:02.733556 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:06:02.733824 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:06:02.734195 (+ 371us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:06:02.734199 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:06:02.734200 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:06:02.734293 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:06:02.734740 (+ 447us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:06:02.734743 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:06:02.734833 (+ 90us) client_negotiation.cc:769] Sending connection context
0811 15:06:02.734909 (+ 76us) client_negotiation.cc:240] Negotiation successful
0811 15:06:02.735035 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44}
I20260811 15:06:02.735814 3269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:02.724719 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33524 (local address 127.19.236.124:33301)
0811 15:06:02.726269 (+ 1550us) server_negotiation.cc:206] Beginning negotiation
0811 15:06:02.726277 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 15:06:02.726289 (+ 12us) server_negotiation.cc:407] Connection header received
0811 15:06:02.726318 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:06:02.726321 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:06:02.726362 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:06:02.726933 (+ 571us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:06:02.727052 (+ 119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:02.727825 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:02.728903 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:02.729225 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:02.729670 (+ 445us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:02.731314 (+ 1644us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:06:02.731318 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:06:02.731320 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:06:02.731345 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:06:02.733416 (+ 2071us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:06:02.733966 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:06:02.733970 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:06:02.733973 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:06:02.734081 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:06:02.734413 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:06:02.734416 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:06:02.734417 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:06:02.734624 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:06:02.735470 (+ 846us) server_negotiation.cc:1035] Waiting for connection context
0811 15:06:02.735546 (+ 76us) server_negotiation.cc:299] Negotiation successful
0811 15:06:02.735654 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1488,"thread_start_us":349,"threads_started":1}
I20260811 15:06:02.737402 3088 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7e50ceb4d4b64410bce4b0994ca39d00: Bootstrap starting.
Aug 11 15:06:02 dist-test-slave-8n49 krb5kdc[2993](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460762, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.124@KRBTEST.COM for kudu/127.19.236.125@KRBTEST.COM
Aug 11 15:06:02 dist-test-slave-8n49 krb5kdc[2993](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460762, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
I20260811 15:06:02.740837 3088 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7e50ceb4d4b64410bce4b0994ca39d00: Neither blocks nor log segments found. Creating new log.
I20260811 15:06:02.741922 3088 log.cc:824] T 00000000000000000000000000000000 P 7e50ceb4d4b64410bce4b0994ca39d00: Log is configured to *not* fsync() on all Append() calls
I20260811 15:06:02.743448 3181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:02.732748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34516 (local address 127.19.236.125:40969)
0811 15:06:02.732894 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0811 15:06:02.732898 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:06:02.733527 (+ 629us) server_negotiation.cc:407] Connection header received
0811 15:06:02.733681 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:06:02.733685 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:06:02.733736 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:06:02.733798 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:06:02.734375 (+ 577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:02.735121 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:02.736157 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:02.736507 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:02.736616 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:02.739539 (+ 2923us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:06:02.739543 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:06:02.739546 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:06:02.739571 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:06:02.741568 (+ 1997us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:06:02.742072 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:06:02.742079 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:06:02.742080 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:06:02.742169 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:06:02.742529 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:06:02.742532 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:06:02.742534 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:06:02.742749 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:06:02.742862 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0811 15:06:02.743151 (+ 289us) server_negotiation.cc:299] Negotiation successful
0811 15:06:02.743292 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 15:06:02.743479 3175 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 95cf6f1147f34494b529aec20cc71c90: Bootstrap starting.
I20260811 15:06:02.744163 3267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:02.732544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.125:40969 (local address 127.0.0.1:34516)
0811 15:06:02.733456 (+ 912us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:02.733472 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 15:06:02.733584 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:06:02.733947 (+ 363us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:06:02.733950 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:06:02.734122 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:06:02.734238 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:06:02.734245 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:06:02.735269 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:06:02.735272 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:06:02.736015 (+ 743us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:06:02.736026 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:06:02.736762 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:06:02.736765 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:06:02.736862 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:02.737441 (+ 579us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:06:02.737455 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:06:02.739366 (+ 1911us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:06:02.741699 (+ 2333us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:06:02.741703 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:06:02.741705 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:06:02.741944 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:06:02.742290 (+ 346us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:06:02.742293 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:06:02.742295 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:06:02.742405 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:06:02.742852 (+ 447us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:06:02.742855 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:06:02.742953 (+ 98us) client_negotiation.cc:769] Sending connection context
0811 15:06:02.743871 (+ 918us) client_negotiation.cc:240] Negotiation successful
0811 15:06:02.744017 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":827}
I20260811 15:06:02.744422 3088 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7e50ceb4d4b64410bce4b0994ca39d00: No bootstrap required, opened a new log
I20260811 15:06:02.745157 3263 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.236.124" port: 33301 } has no permanent_uuid. Determining permanent_uuid...
I20260811 15:06:02.745932 3175 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 95cf6f1147f34494b529aec20cc71c90: Neither blocks nor log segments found. Creating new log.
I20260811 15:06:02.746709 3175 log.cc:824] T 00000000000000000000000000000000 P 95cf6f1147f34494b529aec20cc71c90: Log is configured to *not* fsync() on all Append() calls
I20260811 15:06:02.749044 3088 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7e50ceb4d4b64410bce4b0994ca39d00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e50ceb4d4b64410bce4b0994ca39d00" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 40559 } } peers { permanent_uuid: "95cf6f1147f34494b529aec20cc71c90" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 40969 } } peers { permanent_uuid: "63d8096b89664140923360ecb44554c4" member_type: VOTER last_known_addr { host: "127.19.236.124" port: 33301 } }
I20260811 15:06:02.749387 3092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:02.733114 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51426 (local address 127.19.236.126:40559)
0811 15:06:02.733247 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0811 15:06:02.733252 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:06:02.733268 (+ 16us) server_negotiation.cc:407] Connection header received
0811 15:06:02.733378 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:06:02.733382 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:06:02.733422 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:06:02.733501 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:06:02.734413 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:02.735117 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:02.736177 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:02.736407 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:02.736527 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:02.739576 (+ 3049us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:06:02.739580 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:06:02.739582 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:06:02.739608 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:06:02.741809 (+ 2201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:06:02.747540 (+ 5731us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:06:02.747545 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:06:02.747546 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:06:02.747647 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:06:02.748014 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:06:02.748017 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:06:02.748022 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:06:02.748254 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:06:02.748419 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0811 15:06:02.749116 (+ 697us) server_negotiation.cc:299] Negotiation successful
0811 15:06:02.749242 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 15:06:02.749397 3088 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7e50ceb4d4b64410bce4b0994ca39d00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:06:02.749521 3175 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 95cf6f1147f34494b529aec20cc71c90: No bootstrap required, opened a new log
I20260811 15:06:02.749723 3088 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7e50ceb4d4b64410bce4b0994ca39d00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e50ceb4d4b64410bce4b0994ca39d00, State: Initialized, Role: FOLLOWER
I20260811 15:06:02.750285 3088 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7e50ceb4d4b64410bce4b0994ca39d00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e50ceb4d4b64410bce4b0994ca39d00" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 40559 } } peers { permanent_uuid: "95cf6f1147f34494b529aec20cc71c90" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 40969 } } peers { permanent_uuid: "63d8096b89664140923360ecb44554c4" member_type: VOTER last_known_addr { host: "127.19.236.124" port: 33301 } }
Aug 11 15:06:02 dist-test-slave-8n49 krb5kdc[2993](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460762, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.124@KRBTEST.COM for kudu/127.19.236.124@KRBTEST.COM
I20260811 15:06:02.751915 3088 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7e50ceb4d4b64410bce4b0994ca39d00 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:06:02.754277 3274 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7e50ceb4d4b64410bce4b0994ca39d00 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e50ceb4d4b64410bce4b0994ca39d00" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 40559 } } peers { permanent_uuid: "95cf6f1147f34494b529aec20cc71c90" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 40969 } } peers { permanent_uuid: "63d8096b89664140923360ecb44554c4" member_type: VOTER last_known_addr { host: "127.19.236.124" port: 33301 } } }
I20260811 15:06:02.754536 3274 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7e50ceb4d4b64410bce4b0994ca39d00 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 15:06:02.755000 3175 raft_consensus.cc:348] T 00000000000000000000000000000000 P 95cf6f1147f34494b529aec20cc71c90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e50ceb4d4b64410bce4b0994ca39d00" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 40559 } } peers { permanent_uuid: "95cf6f1147f34494b529aec20cc71c90" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 40969 } } peers { permanent_uuid: "63d8096b89664140923360ecb44554c4" member_type: VOTER last_known_addr { host: "127.19.236.124" port: 33301 } }
I20260811 15:06:02.755327 3175 raft_consensus.cc:374] T 00000000000000000000000000000000 P 95cf6f1147f34494b529aec20cc71c90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:06:02.755434 3175 raft_consensus.cc:729] T 00000000000000000000000000000000 P 95cf6f1147f34494b529aec20cc71c90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95cf6f1147f34494b529aec20cc71c90, State: Initialized, Role: FOLLOWER
I20260811 15:06:02.755995 3175 consensus_queue.cc:260] T 00000000000000000000000000000000 P 95cf6f1147f34494b529aec20cc71c90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e50ceb4d4b64410bce4b0994ca39d00" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 40559 } } peers { permanent_uuid: "95cf6f1147f34494b529aec20cc71c90" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 40969 } } peers { permanent_uuid: "63d8096b89664140923360ecb44554c4" member_type: VOTER last_known_addr { host: "127.19.236.124" port: 33301 } }
I20260811 15:06:02.756352 3268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:02.745743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33526 (local address 127.19.236.124:33301)
0811 15:06:02.745842 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0811 15:06:02.745846 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:06:02.745971 (+ 125us) server_negotiation.cc:407] Connection header received
0811 15:06:02.746174 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:06:02.746178 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:06:02.746221 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:06:02.746265 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:06:02.746748 (+ 483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:02.747553 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:02.748649 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:02.748967 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:02.749042 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:02.752023 (+ 2981us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:06:02.752027 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:06:02.752030 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:06:02.752053 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:06:02.753616 (+ 1563us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:06:02.754804 (+ 1188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:06:02.754824 (+ 20us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:06:02.754829 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:06:02.754995 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:06:02.755441 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:06:02.755444 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:06:02.755446 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:06:02.755673 (+ 227us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:06:02.755745 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 15:06:02.756074 (+ 329us) server_negotiation.cc:299] Negotiation successful
0811 15:06:02.756196 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 15:06:02.756776 3267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:02.745655 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.124:33301 (local address 127.0.0.1:33526)
0811 15:06:02.745899 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:02.745912 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 15:06:02.746046 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:06:02.746374 (+ 328us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:06:02.746377 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:06:02.746555 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:06:02.746635 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:06:02.746642 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:06:02.747720 (+ 1078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:06:02.747723 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:06:02.748502 (+ 779us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:06:02.748513 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:06:02.749313 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:06:02.749316 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:06:02.749409 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:02.749890 (+ 481us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:06:02.749904 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:06:02.751880 (+ 1976us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:06:02.753731 (+ 1851us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:06:02.753737 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:06:02.753740 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:06:02.754017 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:06:02.755163 (+ 1146us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:06:02.755166 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:06:02.755168 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:06:02.755305 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:06:02.755804 (+ 499us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:06:02.755806 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:06:02.755898 (+ 92us) client_negotiation.cc:769] Sending connection context
0811 15:06:02.756484 (+ 586us) client_negotiation.cc:240] Negotiation successful
0811 15:06:02.756645 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":200}
I20260811 15:06:02.757910 3175 sys_catalog.cc:564] T 00000000000000000000000000000000 P 95cf6f1147f34494b529aec20cc71c90 [sys.catalog]: configured and running, proceeding with master startup.
Aug 11 15:06:02 dist-test-slave-8n49 krb5kdc[2993](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460762, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.236.125@KRBTEST.COM
I20260811 15:06:02.760187 3263 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 63d8096b89664140923360ecb44554c4: Bootstrap starting.
I20260811 15:06:02.762708 3181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:02.751188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34528 (local address 127.19.236.125:40969)
0811 15:06:02.751325 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0811 15:06:02.751329 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:06:02.751344 (+ 15us) server_negotiation.cc:407] Connection header received
0811 15:06:02.751393 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:06:02.751396 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:06:02.751439 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:06:02.751525 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:06:02.752278 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:02.753115 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:02.754296 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:02.755802 (+ 1506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:02.755881 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:02.758883 (+ 3002us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:06:02.758889 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:06:02.758892 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:06:02.758919 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:06:02.760718 (+ 1799us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:06:02.761231 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:06:02.761235 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:06:02.761237 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:06:02.761321 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:06:02.761663 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:06:02.761667 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:06:02.761669 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:06:02.761892 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:06:02.762051 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0811 15:06:02.762429 (+ 378us) server_negotiation.cc:299] Negotiation successful
0811 15:06:02.762570 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
W20260811 15:06:02.765172 3287 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7e50ceb4d4b64410bce4b0994ca39d00: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 15:06:02.765379 3287 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 15:06:02.766626 20401 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 15:06:02.767865 3288 sys_catalog.cc:455] T 00000000000000000000000000000000 P 95cf6f1147f34494b529aec20cc71c90 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e50ceb4d4b64410bce4b0994ca39d00" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 40559 } } peers { permanent_uuid: "95cf6f1147f34494b529aec20cc71c90" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 40969 } } peers { permanent_uuid: "63d8096b89664140923360ecb44554c4" member_type: VOTER last_known_addr { host: "127.19.236.124" port: 33301 } } }
I20260811 15:06:02.768030 3288 sys_catalog.cc:458] T 00000000000000000000000000000000 P 95cf6f1147f34494b529aec20cc71c90 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 15:06:02.765709 3095 master_runner.cc:186] Error getting master registration for 127.19.236.124:33301: OK, instance_id { permanent_uuid: "63d8096b89664140923360ecb44554c4" instance_seqno: 1786460762702715 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
W20260811 15:06:02.769245 3302 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 95cf6f1147f34494b529aec20cc71c90: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260811 15:06:02.769413 3095 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260811 15:06:02.769673 3302 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 15:06:02.768927 3010 master_runner.cc:186] Error getting master registration for 127.19.236.124:33301: OK, instance_id { permanent_uuid: "63d8096b89664140923360ecb44554c4" instance_seqno: 1786460762702715 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 15:06:02.778666 3263 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 63d8096b89664140923360ecb44554c4: Neither blocks nor log segments found. Creating new log.
I20260811 15:06:02.779127 3010 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 15:06:02.781154 3263 log.cc:824] T 00000000000000000000000000000000 P 63d8096b89664140923360ecb44554c4: Log is configured to *not* fsync() on all Append() calls
I20260811 15:06:02.782053 3181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:02.769805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34542 (local address 127.19.236.125:40969)
0811 15:06:02.769932 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0811 15:06:02.769937 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:06:02.771163 (+ 1226us) server_negotiation.cc:407] Connection header received
0811 15:06:02.771346 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:06:02.771349 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:06:02.771397 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:06:02.771448 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:06:02.772595 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:02.773369 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:02.774577 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:02.774910 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:02.774990 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:02.777365 (+ 2375us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:06:02.777368 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:06:02.777596 (+ 228us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:06:02.777626 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:06:02.779485 (+ 1859us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:06:02.780016 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:06:02.780023 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:06:02.780027 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:06:02.780373 (+ 346us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:06:02.781004 (+ 631us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:06:02.781009 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:06:02.781011 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:06:02.781244 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:06:02.781357 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0811 15:06:02.781739 (+ 382us) server_negotiation.cc:299] Negotiation successful
0811 15:06:02.781879 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 15:06:02.783489 3092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:02.772638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51440 (local address 127.19.236.126:40559)
0811 15:06:02.772760 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0811 15:06:02.772764 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:06:02.772776 (+ 12us) server_negotiation.cc:407] Connection header received
0811 15:06:02.772815 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:06:02.772817 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:06:02.772860 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:06:02.772936 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:06:02.773820 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:02.774556 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:02.775586 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:02.775972 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:02.776074 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:02.779808 (+ 3734us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:06:02.779812 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:06:02.779815 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:06:02.779844 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:06:02.781639 (+ 1795us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:06:02.782127 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:06:02.782131 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:06:02.782133 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:06:02.782213 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:06:02.782487 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:06:02.782490 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:06:02.782492 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:06:02.782701 (+ 209us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:06:02.782828 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0811 15:06:02.783187 (+ 359us) server_negotiation.cc:299] Negotiation successful
0811 15:06:02.783310 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 15:06:02.784618 3268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:02.770524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33542 (local address 127.19.236.124:33301)
0811 15:06:02.770643 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0811 15:06:02.770647 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:06:02.771425 (+ 778us) server_negotiation.cc:407] Connection header received
0811 15:06:02.771610 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:06:02.771614 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:06:02.771661 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:06:02.771713 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:06:02.772795 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:02.773558 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:02.774724 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:02.775100 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:02.775184 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:02.777101 (+ 1917us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:06:02.777106 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:06:02.777110 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:06:02.777145 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:06:02.778794 (+ 1649us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:06:02.780770 (+ 1976us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:06:02.780774 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:06:02.780775 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:06:02.780865 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:06:02.783633 (+ 2768us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:06:02.783637 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:06:02.783638 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:06:02.783851 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:06:02.783988 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0811 15:06:02.784316 (+ 328us) server_negotiation.cc:299] Negotiation successful
0811 15:06:02.784438 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 15:06:02.786237 3263 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 63d8096b89664140923360ecb44554c4: No bootstrap required, opened a new log
I20260811 15:06:02.790593 3263 raft_consensus.cc:348] T 00000000000000000000000000000000 P 63d8096b89664140923360ecb44554c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e50ceb4d4b64410bce4b0994ca39d00" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 40559 } } peers { permanent_uuid: "95cf6f1147f34494b529aec20cc71c90" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 40969 } } peers { permanent_uuid: "63d8096b89664140923360ecb44554c4" member_type: VOTER last_known_addr { host: "127.19.236.124" port: 33301 } }
I20260811 15:06:02.790827 3263 raft_consensus.cc:374] T 00000000000000000000000000000000 P 63d8096b89664140923360ecb44554c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:06:02.790917 3263 raft_consensus.cc:729] T 00000000000000000000000000000000 P 63d8096b89664140923360ecb44554c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63d8096b89664140923360ecb44554c4, State: Initialized, Role: FOLLOWER
I20260811 15:06:02.791360 3263 consensus_queue.cc:260] T 00000000000000000000000000000000 P 63d8096b89664140923360ecb44554c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e50ceb4d4b64410bce4b0994ca39d00" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 40559 } } peers { permanent_uuid: "95cf6f1147f34494b529aec20cc71c90" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 40969 } } peers { permanent_uuid: "63d8096b89664140923360ecb44554c4" member_type: VOTER last_known_addr { host: "127.19.236.124" port: 33301 } }
I20260811 15:06:02.791874 3313 sys_catalog.cc:455] T 00000000000000000000000000000000 P 63d8096b89664140923360ecb44554c4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e50ceb4d4b64410bce4b0994ca39d00" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 40559 } } peers { permanent_uuid: "95cf6f1147f34494b529aec20cc71c90" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 40969 } } peers { permanent_uuid: "63d8096b89664140923360ecb44554c4" member_type: VOTER last_known_addr { host: "127.19.236.124" port: 33301 } } }
I20260811 15:06:02.793267 3313 sys_catalog.cc:458] T 00000000000000000000000000000000 P 63d8096b89664140923360ecb44554c4 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 15:06:02.800997 3263 sys_catalog.cc:564] T 00000000000000000000000000000000 P 63d8096b89664140923360ecb44554c4 [sys.catalog]: configured and running, proceeding with master startup.
W20260811 15:06:02.807176 3324 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 63d8096b89664140923360ecb44554c4: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 15:06:02.807273 3324 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 15:06:02.808972 3182 master_runner.cc:263] No leader master found from master 63d8096b89664140923360ecb44554c4
I20260811 15:06:02.809054 3182 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 15:06:02.875473 3288 raft_consensus.cc:482] T 00000000000000000000000000000000 P 95cf6f1147f34494b529aec20cc71c90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 15:06:02.875689 3288 raft_consensus.cc:504] T 00000000000000000000000000000000 P 95cf6f1147f34494b529aec20cc71c90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e50ceb4d4b64410bce4b0994ca39d00" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 40559 } } peers { permanent_uuid: "95cf6f1147f34494b529aec20cc71c90" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 40969 } } peers { permanent_uuid: "63d8096b89664140923360ecb44554c4" member_type: VOTER last_known_addr { host: "127.19.236.124" port: 33301 } }
I20260811 15:06:02.876829 3288 leader_election.cc:288] T 00000000000000000000000000000000 P 95cf6f1147f34494b529aec20cc71c90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e50ceb4d4b64410bce4b0994ca39d00 (127.19.236.126:40559), 63d8096b89664140923360ecb44554c4 (127.19.236.124:33301)
I20260811 15:06:02.877926 3059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "95cf6f1147f34494b529aec20cc71c90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e50ceb4d4b64410bce4b0994ca39d00" is_pre_election: true
I20260811 15:06:02.878294 3059 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 7e50ceb4d4b64410bce4b0994ca39d00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95cf6f1147f34494b529aec20cc71c90 in term 0.
I20260811 15:06:02.878880 3118 leader_election.cc:302] T 00000000000000000000000000000000 P 95cf6f1147f34494b529aec20cc71c90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e50ceb4d4b64410bce4b0994ca39d00, 95cf6f1147f34494b529aec20cc71c90; no voters:
I20260811 15:06:02.879643 3235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "95cf6f1147f34494b529aec20cc71c90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63d8096b89664140923360ecb44554c4" is_pre_election: true
I20260811 15:06:02.879935 3235 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 63d8096b89664140923360ecb44554c4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95cf6f1147f34494b529aec20cc71c90 in term 0.
I20260811 15:06:02.880592 3288 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 95cf6f1147f34494b529aec20cc71c90 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 15:06:02.880676 3288 raft_consensus.cc:482] T 00000000000000000000000000000000 P 95cf6f1147f34494b529aec20cc71c90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 15:06:02.880716 3288 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 95cf6f1147f34494b529aec20cc71c90 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:06:02.882015 3288 raft_consensus.cc:504] T 00000000000000000000000000000000 P 95cf6f1147f34494b529aec20cc71c90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e50ceb4d4b64410bce4b0994ca39d00" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 40559 } } peers { permanent_uuid: "95cf6f1147f34494b529aec20cc71c90" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 40969 } } peers { permanent_uuid: "63d8096b89664140923360ecb44554c4" member_type: VOTER last_known_addr { host: "127.19.236.124" port: 33301 } }
I20260811 15:06:02.882359 3288 leader_election.cc:288] T 00000000000000000000000000000000 P 95cf6f1147f34494b529aec20cc71c90 [CANDIDATE]: Term 1 election: Requested vote from peers 7e50ceb4d4b64410bce4b0994ca39d00 (127.19.236.126:40559), 63d8096b89664140923360ecb44554c4 (127.19.236.124:33301)
I20260811 15:06:02.882899 3059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "95cf6f1147f34494b529aec20cc71c90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e50ceb4d4b64410bce4b0994ca39d00"
I20260811 15:06:02.883026 3059 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7e50ceb4d4b64410bce4b0994ca39d00 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:06:02.884296 3059 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 7e50ceb4d4b64410bce4b0994ca39d00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95cf6f1147f34494b529aec20cc71c90 in term 1.
I20260811 15:06:02.884820 3235 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "95cf6f1147f34494b529aec20cc71c90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63d8096b89664140923360ecb44554c4"
I20260811 15:06:02.884944 3235 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 63d8096b89664140923360ecb44554c4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:06:02.886328 3235 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 63d8096b89664140923360ecb44554c4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95cf6f1147f34494b529aec20cc71c90 in term 1.
I20260811 15:06:02.886685 3118 leader_election.cc:302] T 00000000000000000000000000000000 P 95cf6f1147f34494b529aec20cc71c90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e50ceb4d4b64410bce4b0994ca39d00, 95cf6f1147f34494b529aec20cc71c90; no voters:
I20260811 15:06:02.887149 3288 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 95cf6f1147f34494b529aec20cc71c90 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:06:02.887437 3288 raft_consensus.cc:686] T 00000000000000000000000000000000 P 95cf6f1147f34494b529aec20cc71c90 [term 1 LEADER]: Becoming Leader. State: Replica: 95cf6f1147f34494b529aec20cc71c90, State: Running, Role: LEADER
I20260811 15:06:02.887825 3288 consensus_queue.cc:237] T 00000000000000000000000000000000 P 95cf6f1147f34494b529aec20cc71c90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e50ceb4d4b64410bce4b0994ca39d00" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 40559 } } peers { permanent_uuid: "95cf6f1147f34494b529aec20cc71c90" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 40969 } } peers { permanent_uuid: "63d8096b89664140923360ecb44554c4" member_type: VOTER last_known_addr { host: "127.19.236.124" port: 33301 } }
I20260811 15:06:02.893321 3288 sys_catalog.cc:455] T 00000000000000000000000000000000 P 95cf6f1147f34494b529aec20cc71c90 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 95cf6f1147f34494b529aec20cc71c90. Latest consensus state: current_term: 1 leader_uuid: "95cf6f1147f34494b529aec20cc71c90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e50ceb4d4b64410bce4b0994ca39d00" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 40559 } } peers { permanent_uuid: "95cf6f1147f34494b529aec20cc71c90" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 40969 } } peers { permanent_uuid: "63d8096b89664140923360ecb44554c4" member_type: VOTER last_known_addr { host: "127.19.236.124" port: 33301 } } }
I20260811 15:06:02.893510 3288 sys_catalog.cc:458] T 00000000000000000000000000000000 P 95cf6f1147f34494b529aec20cc71c90 [sys.catalog]: This master's current role is: LEADER
I20260811 15:06:02.893939 3328 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:06:02.894930 3328 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:06:02.902380 3235 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 63d8096b89664140923360ecb44554c4 [term 1 FOLLOWER]: Refusing update from remote peer 95cf6f1147f34494b529aec20cc71c90: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:06:02.903230 3326 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 95cf6f1147f34494b529aec20cc71c90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63d8096b89664140923360ecb44554c4" member_type: VOTER last_known_addr { host: "127.19.236.124" port: 33301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:06:02.908128 3313 sys_catalog.cc:455] T 00000000000000000000000000000000 P 63d8096b89664140923360ecb44554c4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 95cf6f1147f34494b529aec20cc71c90. Latest consensus state: current_term: 1 leader_uuid: "95cf6f1147f34494b529aec20cc71c90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e50ceb4d4b64410bce4b0994ca39d00" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 40559 } } peers { permanent_uuid: "95cf6f1147f34494b529aec20cc71c90" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 40969 } } peers { permanent_uuid: "63d8096b89664140923360ecb44554c4" member_type: VOTER last_known_addr { host: "127.19.236.124" port: 33301 } } }
I20260811 15:06:02.908326 3313 sys_catalog.cc:458] T 00000000000000000000000000000000 P 63d8096b89664140923360ecb44554c4 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 15:06:02.912408 3059 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 7e50ceb4d4b64410bce4b0994ca39d00 [term 1 FOLLOWER]: Refusing update from remote peer 95cf6f1147f34494b529aec20cc71c90: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:06:02.913152 3326 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 95cf6f1147f34494b529aec20cc71c90 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e50ceb4d4b64410bce4b0994ca39d00" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 40559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:06:02.917543 3274 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7e50ceb4d4b64410bce4b0994ca39d00 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 95cf6f1147f34494b529aec20cc71c90. Latest consensus state: current_term: 1 leader_uuid: "95cf6f1147f34494b529aec20cc71c90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e50ceb4d4b64410bce4b0994ca39d00" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 40559 } } peers { permanent_uuid: "95cf6f1147f34494b529aec20cc71c90" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 40969 } } peers { permanent_uuid: "63d8096b89664140923360ecb44554c4" member_type: VOTER last_known_addr { host: "127.19.236.124" port: 33301 } } }
I20260811 15:06:02.917671 3274 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7e50ceb4d4b64410bce4b0994ca39d00 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 15:06:02.922538 3326 sys_catalog.cc:455] T 00000000000000000000000000000000 P 95cf6f1147f34494b529aec20cc71c90 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "95cf6f1147f34494b529aec20cc71c90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e50ceb4d4b64410bce4b0994ca39d00" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 40559 } } peers { permanent_uuid: "95cf6f1147f34494b529aec20cc71c90" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 40969 } } peers { permanent_uuid: "63d8096b89664140923360ecb44554c4" member_type: VOTER last_known_addr { host: "127.19.236.124" port: 33301 } } }
I20260811 15:06:02.922684 3326 sys_catalog.cc:458] T 00000000000000000000000000000000 P 95cf6f1147f34494b529aec20cc71c90 [sys.catalog]: This master's current role is: LEADER
I20260811 15:06:02.924113 3274 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7e50ceb4d4b64410bce4b0994ca39d00 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "95cf6f1147f34494b529aec20cc71c90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e50ceb4d4b64410bce4b0994ca39d00" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 40559 } } peers { permanent_uuid: "95cf6f1147f34494b529aec20cc71c90" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 40969 } } peers { permanent_uuid: "63d8096b89664140923360ecb44554c4" member_type: VOTER last_known_addr { host: "127.19.236.124" port: 33301 } } }
I20260811 15:06:02.924244 3274 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7e50ceb4d4b64410bce4b0994ca39d00 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 15:06:02.924813 3329 mvcc.cc:205] Tried to move back new op lower bound from 7317343284839309312 to 7317343284801728512. Current Snapshot: MvccSnapshot[applied={T|T < 7317343284839309312}]
I20260811 15:06:02.929277 3336 mvcc.cc:205] Tried to move back new op lower bound from 7317343284839309312 to 7317343284801728512. Current Snapshot: MvccSnapshot[applied={T|T < 7317343284839309312}]
I20260811 15:06:02.930333 3288 sys_catalog.cc:455] T 00000000000000000000000000000000 P 95cf6f1147f34494b529aec20cc71c90 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "95cf6f1147f34494b529aec20cc71c90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e50ceb4d4b64410bce4b0994ca39d00" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 40559 } } peers { permanent_uuid: "95cf6f1147f34494b529aec20cc71c90" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 40969 } } peers { permanent_uuid: "63d8096b89664140923360ecb44554c4" member_type: VOTER last_known_addr { host: "127.19.236.124" port: 33301 } } }
I20260811 15:06:02.930454 3288 sys_catalog.cc:458] T 00000000000000000000000000000000 P 95cf6f1147f34494b529aec20cc71c90 [sys.catalog]: This master's current role is: LEADER
I20260811 15:06:02.931566 3313 sys_catalog.cc:455] T 00000000000000000000000000000000 P 63d8096b89664140923360ecb44554c4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "95cf6f1147f34494b529aec20cc71c90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e50ceb4d4b64410bce4b0994ca39d00" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 40559 } } peers { permanent_uuid: "95cf6f1147f34494b529aec20cc71c90" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 40969 } } peers { permanent_uuid: "63d8096b89664140923360ecb44554c4" member_type: VOTER last_known_addr { host: "127.19.236.124" port: 33301 } } }
I20260811 15:06:02.931689 3313 sys_catalog.cc:458] T 00000000000000000000000000000000 P 63d8096b89664140923360ecb44554c4 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 15:06:02.934583 3330 mvcc.cc:205] Tried to move back new op lower bound from 7317343284839309312 to 7317343284801728512. Current Snapshot: MvccSnapshot[applied={T|T < 7317343284839309312}]
I20260811 15:06:02.938372 3328 catalog_manager.cc:1347] Generated new cluster ID: 4320a08cdbd544e081052b1625a5954d
I20260811 15:06:02.938441 3328 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:06:02.956766 3328 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 15:06:02.958315 3328 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:06:02.982649 3328 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 95cf6f1147f34494b529aec20cc71c90: Generated new TSK 0
I20260811 15:06:02.983631 3328 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 15:06:03.766999 3287 catalog_manager.cc:1259] Loaded cluster ID: 4320a08cdbd544e081052b1625a5954d
I20260811 15:06:03.767098 3287 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 7e50ceb4d4b64410bce4b0994ca39d00: loading cluster ID for follower catalog manager: success
I20260811 15:06:03.769050 3287 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 7e50ceb4d4b64410bce4b0994ca39d00: acquiring CA information for follower catalog manager: success
I20260811 15:06:03.770293 3287 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 7e50ceb4d4b64410bce4b0994ca39d00: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 15:06:03.808748 3324 catalog_manager.cc:1259] Loaded cluster ID: 4320a08cdbd544e081052b1625a5954d
I20260811 15:06:03.808853 3324 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 63d8096b89664140923360ecb44554c4: loading cluster ID for follower catalog manager: success
I20260811 15:06:03.810571 3324 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 63d8096b89664140923360ecb44554c4: acquiring CA information for follower catalog manager: success
I20260811 15:06:03.811755 3324 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 63d8096b89664140923360ecb44554c4: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 15:06:04.042865 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 3010
I20260811 15:06:04.053738 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 3095
I20260811 15:06:04.061923 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 3182
2026-08-11T15:06:04Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3242 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786460596631409-20401-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 15:06:04 dist-test-slave-8n49 krb5kdc[3353](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 15:06:04 dist-test-slave-8n49 krb5kdc[3353](info): set up 2 sockets
Aug 11 15:06:04 dist-test-slave-8n49 krb5kdc[3353](info): commencing operation
krb5kdc: starting...
W20260811 15:06:05.196776 20401 mini_kdc.cc:121] Time spent starting KDC: real 1.110s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786460596631409-20401-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786460596631409-20401-0/krb5kdc/test-user.keytab.
Aug 11 15:06:05 dist-test-slave-8n49 krb5kdc[3353](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460765, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T15:06:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T15:06:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.236.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.236.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.236.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab.
Entry for principal kudu/127.19.236.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab.
I20260811 15:06:05.333338 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786460596631409-20401-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786460596631409-20401-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786460596631409-20401-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:39025
--webserver_interface=127.19.236.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab
--principal=kudu/127.19.236.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:44721
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.236.126:39025
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:06:05.467046 3367 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:06:05.467340 3367 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:06:05.467382 3367 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:06:05.471659 3367 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:06:05.471735 3367 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:06:05.471755 3367 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:06:05.471772 3367 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:06:05.471788 3367 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:06:05.477380 3367 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:44721
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786460596631409-20401-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786460596631409-20401-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.236.126:39025
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab
--principal=kudu/127.19.236.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:39025
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.236.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3367
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786460596631409-20401-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:06:05.478541 3367 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:06:05.479629 3367 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:06:05.488664 3372 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:06:05.488726 3375 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:06:05.488664 3373 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:06:05.489065 3367 server_base.cc:1034] running on GCE node
I20260811 15:06:05.489727 3367 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:06:05.491003 3367 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:06:05.492195 3367 hybrid_clock.cc:648] HybridClock initialized: now 1786460765492177 us; error 36 us; skew 500 ppm
Aug 11 15:06:05 dist-test-slave-8n49 krb5kdc[3353](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460765, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:06:05.495285 3367 init.cc:377] Logged in from keytab as kudu/127.19.236.126@KRBTEST.COM (short username kudu)
I20260811 15:06:05.496309 3367 webserver.cc:460] Webserver started at http://127.19.236.126:40561/ using document root <none> and password file <none>
I20260811 15:06:05.496984 3367 fs_manager.cc:359] Metadata directory not provided
I20260811 15:06:05.497078 3367 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:06:05.497323 3367 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:06:05.499502 3367 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786460596631409-20401-0/minicluster-data/master-0/data/instance:
uuid: "2167ce46bd7e47b7a260255fb5df99f6"
format_stamp: "Formatted at 2026-08-11 15:06:05 on dist-test-slave-8n49"
server_key: "597b2ee303d0a33e48658ead6af27eb6"
server_key_iv: "3964a23fdb1ccb6dfa0b440a6ad92770"
server_key_version: "encryptionkey@0"
I20260811 15:06:05.500111 3367 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786460596631409-20401-0/minicluster-data/master-0/wal/instance:
uuid: "2167ce46bd7e47b7a260255fb5df99f6"
format_stamp: "Formatted at 2026-08-11 15:06:05 on dist-test-slave-8n49"
server_key: "597b2ee303d0a33e48658ead6af27eb6"
server_key_iv: "3964a23fdb1ccb6dfa0b440a6ad92770"
server_key_version: "encryptionkey@0"
I20260811 15:06:05.504225 3367 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260811 15:06:05.507320 3386 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:06:05.508774 3367 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260811 15:06:05.508922 3367 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786460596631409-20401-0/minicluster-data/master-0/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786460596631409-20401-0/minicluster-data/master-0/wal
uuid: "2167ce46bd7e47b7a260255fb5df99f6"
format_stamp: "Formatted at 2026-08-11 15:06:05 on dist-test-slave-8n49"
server_key: "597b2ee303d0a33e48658ead6af27eb6"
server_key_iv: "3964a23fdb1ccb6dfa0b440a6ad92770"
server_key_version: "encryptionkey@0"
I20260811 15:06:05.509053 3367 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786460596631409-20401-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786460596631409-20401-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786460596631409-20401-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:06:05.525635 3367 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:06:05.529258 3367 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:06:05.529488 3367 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:06:05.536614 3367 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.126:39025
I20260811 15:06:05.536690 3448 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.126:39025 every 8 connection(s)
I20260811 15:06:05.537639 3367 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
I20260811 15:06:05.540473 3449 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:06:05.541702 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 3367
I20260811 15:06:05.541843 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786460596631409-20401-0/minicluster-data/master-0/wal/instance
I20260811 15:06:05.542163 20401 external_mini_cluster.cc:1428] Setting key 735104c929fa8914624fa48740d8549c
I20260811 15:06:05.547516 3449 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2167ce46bd7e47b7a260255fb5df99f6: Bootstrap starting.
I20260811 15:06:05.550287 3449 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2167ce46bd7e47b7a260255fb5df99f6: Neither blocks nor log segments found. Creating new log.
I20260811 15:06:05.551098 3449 log.cc:824] T 00000000000000000000000000000000 P 2167ce46bd7e47b7a260255fb5df99f6: Log is configured to *not* fsync() on all Append() calls
Aug 11 15:06:05 dist-test-slave-8n49 krb5kdc[3353](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460765, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
I20260811 15:06:05.553589 3449 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2167ce46bd7e47b7a260255fb5df99f6: No bootstrap required, opened a new log
I20260811 15:06:05.557428 3452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:05.543475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34772 (local address 127.19.236.126:39025)
0811 15:06:05.543914 (+ 439us) server_negotiation.cc:206] Beginning negotiation
0811 15:06:05.543936 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0811 15:06:05.543996 (+ 60us) server_negotiation.cc:407] Connection header received
0811 15:06:05.544882 (+ 886us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:06:05.544905 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:06:05.545331 (+ 426us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:06:05.545704 (+ 373us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:06:05.546390 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:05.547852 (+ 1462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:05.548738 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:05.549421 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:05.549594 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:05.552134 (+ 2540us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:06:05.552141 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:06:05.552157 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:06:05.552187 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:06:05.554203 (+ 2016us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:06:05.554646 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:06:05.554652 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:06:05.554658 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:06:05.554799 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:06:05.555064 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:06:05.555067 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:06:05.555069 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:06:05.555604 (+ 535us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:06:05.555850 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0811 15:06:05.556087 (+ 237us) server_negotiation.cc:299] Negotiation successful
0811 15:06:05.556406 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":282,"thread_start_us":121,"threads_started":1}
I20260811 15:06:05.558283 3449 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2167ce46bd7e47b7a260255fb5df99f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2167ce46bd7e47b7a260255fb5df99f6" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 39025 } }
I20260811 15:06:05.558578 3449 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2167ce46bd7e47b7a260255fb5df99f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:06:05.558691 3449 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2167ce46bd7e47b7a260255fb5df99f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2167ce46bd7e47b7a260255fb5df99f6, State: Initialized, Role: FOLLOWER
I20260811 15:06:05.559183 3449 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2167ce46bd7e47b7a260255fb5df99f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2167ce46bd7e47b7a260255fb5df99f6" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 39025 } }
I20260811 15:06:05.559355 3449 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2167ce46bd7e47b7a260255fb5df99f6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 15:06:05.559429 3449 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2167ce46bd7e47b7a260255fb5df99f6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 15:06:05.559535 3449 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2167ce46bd7e47b7a260255fb5df99f6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:06:05.560526 20401 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 15:06:05.560725 3449 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2167ce46bd7e47b7a260255fb5df99f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2167ce46bd7e47b7a260255fb5df99f6" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 39025 } }
I20260811 15:06:05.561064 3449 leader_election.cc:302] T 00000000000000000000000000000000 P 2167ce46bd7e47b7a260255fb5df99f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2167ce46bd7e47b7a260255fb5df99f6; no voters:
I20260811 15:06:05.561388 3449 leader_election.cc:288] T 00000000000000000000000000000000 P 2167ce46bd7e47b7a260255fb5df99f6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 15:06:05.561532 3456 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2167ce46bd7e47b7a260255fb5df99f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:06:05.561794 3456 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2167ce46bd7e47b7a260255fb5df99f6 [term 1 LEADER]: Becoming Leader. State: Replica: 2167ce46bd7e47b7a260255fb5df99f6, State: Running, Role: LEADER
I20260811 15:06:05.562106 3456 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2167ce46bd7e47b7a260255fb5df99f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2167ce46bd7e47b7a260255fb5df99f6" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 39025 } }
I20260811 15:06:05.562774 3449 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2167ce46bd7e47b7a260255fb5df99f6 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:06:05.563997 3458 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2167ce46bd7e47b7a260255fb5df99f6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2167ce46bd7e47b7a260255fb5df99f6. Latest consensus state: current_term: 1 leader_uuid: "2167ce46bd7e47b7a260255fb5df99f6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2167ce46bd7e47b7a260255fb5df99f6" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 39025 } } }
I20260811 15:06:05.564000 3457 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2167ce46bd7e47b7a260255fb5df99f6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2167ce46bd7e47b7a260255fb5df99f6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2167ce46bd7e47b7a260255fb5df99f6" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 39025 } } }
I20260811 15:06:05.564132 3458 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2167ce46bd7e47b7a260255fb5df99f6 [sys.catalog]: This master's current role is: LEADER
I20260811 15:06:05.564162 3457 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2167ce46bd7e47b7a260255fb5df99f6 [sys.catalog]: This master's current role is: LEADER
I20260811 15:06:05.564584 3466 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:06:05.567247 3466 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:06:05.572722 3466 catalog_manager.cc:1347] Generated new cluster ID: 7cd8430c17e44ad786dc53339afa190b
I20260811 15:06:05.572794 3466 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:06:05.591523 3466 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 15:06:05.592530 3466 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:06:05.598161 3466 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2167ce46bd7e47b7a260255fb5df99f6: Generated new TSK 0
I20260811 15:06:05.598847 3466 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 15:06:05.617780 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 3367
2026-08-11T15:06:05Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1555 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 15:06:05 dist-test-slave-8n49 krb5kdc[3481](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 15:06:05 dist-test-slave-8n49 krb5kdc[3481](info): set up 2 sockets
Aug 11 15:06:05 dist-test-slave-8n49 krb5kdc[3481](info): commencing operation
krb5kdc: starting...
W20260811 15:06:06.724154 20401 mini_kdc.cc:121] Time spent starting KDC: real 1.082s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/krb5kdc/test-user.keytab.
Aug 11 15:06:06 dist-test-slave-8n49 krb5kdc[3481](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460766, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T15:06:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T15:06:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.236.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.236.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.236.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab.
Entry for principal kudu/127.19.236.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab.
I20260811 15:06:06.853474 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:43737
--webserver_interface=127.19.236.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab
--principal=kudu/127.19.236.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:42739
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.236.126:43737
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:06:06.969370 3496 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:06:06.969662 3496 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:06:06.969735 3496 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:06:06.974507 3496 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:06:06.974602 3496 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:06:06.974623 3496 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:06:06.974642 3496 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:06:06.974658 3496 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:06:06.981896 3496 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:42739
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.236.126:43737
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab
--principal=kudu/127.19.236.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:43737
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.236.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3496
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:06:06.983187 3496 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:06:06.984364 3496 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:06:06.993853 3502 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:06:06.993839 3501 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:06:06.993918 3496 server_base.cc:1034] running on GCE node
W20260811 15:06:06.994047 3504 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:06:06.994654 3496 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:06:06.995782 3496 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:06:06.996956 3496 hybrid_clock.cc:648] HybridClock initialized: now 1786460766996931 us; error 40 us; skew 500 ppm
Aug 11 15:06:07 dist-test-slave-8n49 krb5kdc[3481](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460767, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:06:07.007149 3496 init.cc:377] Logged in from keytab as kudu/127.19.236.126@KRBTEST.COM (short username kudu)
I20260811 15:06:07.008282 3496 webserver.cc:460] Webserver started at http://127.19.236.126:34105/ using document root <none> and password file <none>
I20260811 15:06:07.008987 3496 fs_manager.cc:359] Metadata directory not provided
I20260811 15:06:07.009085 3496 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:06:07.009341 3496 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:06:07.011587 3496 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/master-0/data/instance:
uuid: "b6742f0314744b19a6b25bc347fd6f10"
format_stamp: "Formatted at 2026-08-11 15:06:07 on dist-test-slave-8n49"
server_key: "55ea0c75adfa2ed63a4f110431b1603d"
server_key_iv: "b1ee7335eb9069ed7cd34e1c0f1acab9"
server_key_version: "encryptionkey@0"
I20260811 15:06:07.012210 3496 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/master-0/wal/instance:
uuid: "b6742f0314744b19a6b25bc347fd6f10"
format_stamp: "Formatted at 2026-08-11 15:06:07 on dist-test-slave-8n49"
server_key: "55ea0c75adfa2ed63a4f110431b1603d"
server_key_iv: "b1ee7335eb9069ed7cd34e1c0f1acab9"
server_key_version: "encryptionkey@0"
I20260811 15:06:07.016337 3496 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260811 15:06:07.019166 3513 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:06:07.020535 3496 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 15:06:07.020753 3496 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/master-0/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/master-0/wal
uuid: "b6742f0314744b19a6b25bc347fd6f10"
format_stamp: "Formatted at 2026-08-11 15:06:07 on dist-test-slave-8n49"
server_key: "55ea0c75adfa2ed63a4f110431b1603d"
server_key_iv: "b1ee7335eb9069ed7cd34e1c0f1acab9"
server_key_version: "encryptionkey@0"
I20260811 15:06:07.020886 3496 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:06:07.037010 3496 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:06:07.040475 3496 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:06:07.040748 3496 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:06:07.048833 3496 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.126:43737
I20260811 15:06:07.049113 3573 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.126:43737 every 8 connection(s)
I20260811 15:06:07.049942 3496 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
I20260811 15:06:07.050833 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 3496
I20260811 15:06:07.050976 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/master-0/wal/instance
I20260811 15:06:07.051267 20401 external_mini_cluster.cc:1428] Setting key 7fc0265f87d004fc10653b2e1b9b4a17
I20260811 15:06:07.053331 3574 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:06:07.059239 3574 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b6742f0314744b19a6b25bc347fd6f10: Bootstrap starting.
Aug 11 15:06:07 dist-test-slave-8n49 krb5kdc[3481](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460766, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
I20260811 15:06:07.061996 3574 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b6742f0314744b19a6b25bc347fd6f10: Neither blocks nor log segments found. Creating new log.
I20260811 15:06:07.062879 3574 log.cc:824] T 00000000000000000000000000000000 P b6742f0314744b19a6b25bc347fd6f10: Log is configured to *not* fsync() on all Append() calls
I20260811 15:06:07.065307 3574 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b6742f0314744b19a6b25bc347fd6f10: No bootstrap required, opened a new log
I20260811 15:06:07.066432 3578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:07.052724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36510 (local address 127.19.236.126:43737)
0811 15:06:07.053180 (+ 456us) server_negotiation.cc:206] Beginning negotiation
0811 15:06:07.053195 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 15:06:07.053233 (+ 38us) server_negotiation.cc:407] Connection header received
0811 15:06:07.054103 (+ 870us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:06:07.054124 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:06:07.054477 (+ 353us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:06:07.054837 (+ 360us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:06:07.055671 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:07.056772 (+ 1101us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:07.057645 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:07.058122 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:07.058290 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:07.061391 (+ 3101us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:06:07.061397 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:06:07.061411 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:06:07.061441 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:06:07.063350 (+ 1909us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:06:07.063872 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:06:07.063878 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:06:07.063883 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:06:07.064004 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:06:07.064330 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:06:07.064333 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:06:07.064334 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:06:07.064839 (+ 505us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:06:07.065011 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0811 15:06:07.065328 (+ 317us) server_negotiation.cc:299] Negotiation successful
0811 15:06:07.065700 (+ 372us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":307,"thread_start_us":143,"threads_started":1}
I20260811 15:06:07.068723 3574 raft_consensus.cc:348] T 00000000000000000000000000000000 P b6742f0314744b19a6b25bc347fd6f10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6742f0314744b19a6b25bc347fd6f10" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 43737 } }
I20260811 15:06:07.069015 3574 raft_consensus.cc:374] T 00000000000000000000000000000000 P b6742f0314744b19a6b25bc347fd6f10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:06:07.069146 3574 raft_consensus.cc:729] T 00000000000000000000000000000000 P b6742f0314744b19a6b25bc347fd6f10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6742f0314744b19a6b25bc347fd6f10, State: Initialized, Role: FOLLOWER
I20260811 15:06:07.069582 3574 consensus_queue.cc:260] T 00000000000000000000000000000000 P b6742f0314744b19a6b25bc347fd6f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6742f0314744b19a6b25bc347fd6f10" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 43737 } }
I20260811 15:06:07.069736 3574 raft_consensus.cc:388] T 00000000000000000000000000000000 P b6742f0314744b19a6b25bc347fd6f10 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 15:06:07.069823 3574 raft_consensus.cc:482] T 00000000000000000000000000000000 P b6742f0314744b19a6b25bc347fd6f10 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 15:06:07.069936 3574 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b6742f0314744b19a6b25bc347fd6f10 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:06:07.070960 3574 raft_consensus.cc:504] T 00000000000000000000000000000000 P b6742f0314744b19a6b25bc347fd6f10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6742f0314744b19a6b25bc347fd6f10" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 43737 } }
I20260811 15:06:07.071326 3574 leader_election.cc:302] T 00000000000000000000000000000000 P b6742f0314744b19a6b25bc347fd6f10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b6742f0314744b19a6b25bc347fd6f10; no voters:
I20260811 15:06:07.071802 3574 leader_election.cc:288] T 00000000000000000000000000000000 P b6742f0314744b19a6b25bc347fd6f10 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 15:06:07.072011 3580 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b6742f0314744b19a6b25bc347fd6f10 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:06:07.072446 3580 raft_consensus.cc:686] T 00000000000000000000000000000000 P b6742f0314744b19a6b25bc347fd6f10 [term 1 LEADER]: Becoming Leader. State: Replica: b6742f0314744b19a6b25bc347fd6f10, State: Running, Role: LEADER
I20260811 15:06:07.073055 3580 consensus_queue.cc:237] T 00000000000000000000000000000000 P b6742f0314744b19a6b25bc347fd6f10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6742f0314744b19a6b25bc347fd6f10" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 43737 } }
I20260811 15:06:07.073225 3574 sys_catalog.cc:564] T 00000000000000000000000000000000 P b6742f0314744b19a6b25bc347fd6f10 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:06:07.074862 3581 sys_catalog.cc:455] T 00000000000000000000000000000000 P b6742f0314744b19a6b25bc347fd6f10 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b6742f0314744b19a6b25bc347fd6f10" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6742f0314744b19a6b25bc347fd6f10" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 43737 } } }
I20260811 15:06:07.074997 3581 sys_catalog.cc:458] T 00000000000000000000000000000000 P b6742f0314744b19a6b25bc347fd6f10 [sys.catalog]: This master's current role is: LEADER
I20260811 15:06:07.075335 3582 sys_catalog.cc:455] T 00000000000000000000000000000000 P b6742f0314744b19a6b25bc347fd6f10 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b6742f0314744b19a6b25bc347fd6f10. Latest consensus state: current_term: 1 leader_uuid: "b6742f0314744b19a6b25bc347fd6f10" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6742f0314744b19a6b25bc347fd6f10" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 43737 } } }
I20260811 15:06:07.075444 3582 sys_catalog.cc:458] T 00000000000000000000000000000000 P b6742f0314744b19a6b25bc347fd6f10 [sys.catalog]: This master's current role is: LEADER
I20260811 15:06:07.075876 3595 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:06:07.078747 3595 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:06:07.085083 3595 catalog_manager.cc:1347] Generated new cluster ID: a93c6095c5d64a53b6e596b67ef34bbe
I20260811 15:06:07.085175 3595 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:06:07.097994 3595 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 15:06:07.099048 3595 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:06:07.107869 3595 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b6742f0314744b19a6b25bc347fd6f10: Generated new TSK 0
I20260811 15:06:07.108636 3595 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.236.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.236.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.236.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.65.keytab.
Entry for principal kudu/127.19.236.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.65.keytab.
I20260811 15:06:07.145247 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.65:0
--local_ip_for_outbound_sockets=127.19.236.65
--webserver_interface=127.19.236.65
--webserver_port=0
--tserver_master_addrs=127.19.236.126:43737
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.65.keytab
--principal=kudu/127.19.236.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:42739
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:06:07.261983 3604 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:06:07.262291 3604 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:06:07.262360 3604 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:06:07.266466 3604 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:06:07.266552 3604 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:06:07.266642 3604 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.65
I20260811 15:06:07.272049 3604 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:42739
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.65.keytab
--principal=kudu/127.19.236.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.236.65
--webserver_port=0
--tserver_master_addrs=127.19.236.126:43737
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3604
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.65
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:06:07.273265 3604 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:06:07.274425 3604 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:06:07.284798 3615 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:06:07.284969 3610 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:06:07.285161 3604 server_base.cc:1034] running on GCE node
W20260811 15:06:07.284798 3611 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:06:07.286000 3604 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:06:07.286876 3604 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:06:07.288074 3604 hybrid_clock.cc:648] HybridClock initialized: now 1786460767288057 us; error 38 us; skew 500 ppm
Aug 11 15:06:07 dist-test-slave-8n49 krb5kdc[3481](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460767, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:06:07.291316 3604 init.cc:377] Logged in from keytab as kudu/127.19.236.65@KRBTEST.COM (short username kudu)
I20260811 15:06:07.292310 3604 webserver.cc:460] Webserver started at http://127.19.236.65:46161/ using document root <none> and password file <none>
I20260811 15:06:07.292969 3604 fs_manager.cc:359] Metadata directory not provided
I20260811 15:06:07.293063 3604 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:06:07.293298 3604 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:06:07.295374 3604 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-0/data/instance:
uuid: "c021852aca1a445ebd50c797ae4afa5a"
format_stamp: "Formatted at 2026-08-11 15:06:07 on dist-test-slave-8n49"
server_key: "353d1470315869865dfe3274cbabd640"
server_key_iv: "a1502811da12d547a281551deb07db9f"
server_key_version: "encryptionkey@0"
I20260811 15:06:07.295969 3604 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-0/wal/instance:
uuid: "c021852aca1a445ebd50c797ae4afa5a"
format_stamp: "Formatted at 2026-08-11 15:06:07 on dist-test-slave-8n49"
server_key: "353d1470315869865dfe3274cbabd640"
server_key_iv: "a1502811da12d547a281551deb07db9f"
server_key_version: "encryptionkey@0"
I20260811 15:06:07.299746 3604 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260811 15:06:07.302265 3622 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:06:07.303500 3604 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 15:06:07.303645 3604 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-0/wal
uuid: "c021852aca1a445ebd50c797ae4afa5a"
format_stamp: "Formatted at 2026-08-11 15:06:07 on dist-test-slave-8n49"
server_key: "353d1470315869865dfe3274cbabd640"
server_key_iv: "a1502811da12d547a281551deb07db9f"
server_key_version: "encryptionkey@0"
I20260811 15:06:07.303759 3604 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:06:07.329347 3604 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:06:07.333488 3604 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:06:07.333704 3604 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:06:07.334368 3604 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:06:07.335455 3604 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:06:07.335538 3604 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:06:07.335619 3604 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:06:07.335647 3604 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:06:07.348084 3604 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.65:36747
I20260811 15:06:07.348148 3754 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.65:36747 every 8 connection(s)
I20260811 15:06:07.349329 3604 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
I20260811 15:06:07.353641 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 3604
I20260811 15:06:07.353787 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-0/wal/instance
I20260811 15:06:07.354177 20401 external_mini_cluster.cc:1428] Setting key 1f173e5a1b7243ac77d4185ee181fc6a
Aug 11 15:06:07 dist-test-slave-8n49 krb5kdc[3481](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460767, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.65@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
I20260811 15:06:07.366773 3578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:07.351563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.65:33709 (local address 127.19.236.126:43737)
0811 15:06:07.351735 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0811 15:06:07.351740 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:06:07.352937 (+ 1197us) server_negotiation.cc:407] Connection header received
0811 15:06:07.354852 (+ 1915us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:06:07.354857 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:06:07.354918 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:06:07.354989 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:06:07.356587 (+ 1598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:07.357133 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:07.358362 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:07.358778 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:07.358872 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:07.362084 (+ 3212us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:06:07.362088 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:06:07.362091 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:06:07.362124 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:06:07.363823 (+ 1699us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:06:07.364545 (+ 722us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:06:07.364574 (+ 29us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:06:07.364576 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:06:07.364702 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:06:07.365207 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:06:07.365213 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:06:07.365218 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:06:07.365520 (+ 302us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:06:07.365636 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0811 15:06:07.366345 (+ 709us) server_negotiation.cc:299] Negotiation successful
0811 15:06:07.366529 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
WARNING: no policy specified for kudu/127.19.236.66@KRBTEST.COM; defaulting to no policy
I20260811 15:06:07.368142 3757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:07.352116 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:43737 (local address 127.19.236.65:33709)
0811 15:06:07.352768 (+ 652us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:07.352828 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0811 15:06:07.354596 (+ 1768us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:06:07.355416 (+ 820us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:06:07.355423 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:06:07.355947 (+ 524us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:06:07.356424 (+ 477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:06:07.356437 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:06:07.357260 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:06:07.357264 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:06:07.358200 (+ 936us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:06:07.358214 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:06:07.359098 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:06:07.359104 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:06:07.359328 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:07.360093 (+ 765us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:06:07.360111 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:06:07.361903 (+ 1792us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:06:07.363958 (+ 2055us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:06:07.363966 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:06:07.363983 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:06:07.364408 (+ 425us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:06:07.364838 (+ 430us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:06:07.364844 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:06:07.364847 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:06:07.365047 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:06:07.365647 (+ 600us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:06:07.365656 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:06:07.366021 (+ 365us) client_negotiation.cc:769] Sending connection context
0811 15:06:07.366281 (+ 260us) client_negotiation.cc:240] Negotiation successful
0811 15:06:07.366663 (+ 382us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":386,"thread_start_us":183,"threads_started":1}
I20260811 15:06:07.370023 3755 heartbeater.cc:347] Connected to a master server at 127.19.236.126:43737
I20260811 15:06:07.370548 3755 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.236.66@KRBTEST.COM" created.
I20260811 15:06:07.371251 3755 heartbeater.cc:511] Master 127.19.236.126:43737 requested a full tablet report, sending...
I20260811 15:06:07.373354 3531 ts_manager.cc:194] Registered new tserver with Master: c021852aca1a445ebd50c797ae4afa5a (127.19.236.65:36747)
I20260811 15:06:07.374806 3531 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.236.65@KRBTEST.COM'} at 127.19.236.65:33709
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.236.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.66.keytab.
Entry for principal kudu/127.19.236.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.66.keytab.
I20260811 15:06:07.389722 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.66:0
--local_ip_for_outbound_sockets=127.19.236.66
--webserver_interface=127.19.236.66
--webserver_port=0
--tserver_master_addrs=127.19.236.126:43737
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.66.keytab
--principal=kudu/127.19.236.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:42739
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:06:07.503388 3761 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:06:07.503679 3761 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:06:07.503755 3761 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:06:07.507778 3761 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:06:07.507858 3761 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:06:07.507951 3761 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.66
I20260811 15:06:07.513140 3761 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:42739
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.66.keytab
--principal=kudu/127.19.236.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.236.66
--webserver_port=0
--tserver_master_addrs=127.19.236.126:43737
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3761
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.66
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:06:07.514173 3761 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:06:07.515198 3761 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 15:06:07.524735 3761 server_base.cc:1034] running on GCE node
W20260811 15:06:07.524669 3766 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:06:07.524703 3767 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:06:07.524672 3769 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:06:07.525324 3761 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:06:07.526031 3761 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:06:07.527215 3761 hybrid_clock.cc:648] HybridClock initialized: now 1786460767527196 us; error 36 us; skew 500 ppm
Aug 11 15:06:07 dist-test-slave-8n49 krb5kdc[3481](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460767, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:06:07.530020 3761 init.cc:377] Logged in from keytab as kudu/127.19.236.66@KRBTEST.COM (short username kudu)
I20260811 15:06:07.530905 3761 webserver.cc:460] Webserver started at http://127.19.236.66:34939/ using document root <none> and password file <none>
I20260811 15:06:07.531464 3761 fs_manager.cc:359] Metadata directory not provided
I20260811 15:06:07.531526 3761 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:06:07.531769 3761 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:06:07.533882 3761 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-1/data/instance:
uuid: "17295ce6738a4eb594f9aeb25ec12052"
format_stamp: "Formatted at 2026-08-11 15:06:07 on dist-test-slave-8n49"
server_key: "2d4f17d84e50fd78833b87eed9e306da"
server_key_iv: "76264519e19fc126422f552aaf16144b"
server_key_version: "encryptionkey@0"
I20260811 15:06:07.534435 3761 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-1/wal/instance:
uuid: "17295ce6738a4eb594f9aeb25ec12052"
format_stamp: "Formatted at 2026-08-11 15:06:07 on dist-test-slave-8n49"
server_key: "2d4f17d84e50fd78833b87eed9e306da"
server_key_iv: "76264519e19fc126422f552aaf16144b"
server_key_version: "encryptionkey@0"
I20260811 15:06:07.538174 3761 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 15:06:07.540485 3778 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:06:07.541759 3761 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260811 15:06:07.541877 3761 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-1/wal
uuid: "17295ce6738a4eb594f9aeb25ec12052"
format_stamp: "Formatted at 2026-08-11 15:06:07 on dist-test-slave-8n49"
server_key: "2d4f17d84e50fd78833b87eed9e306da"
server_key_iv: "76264519e19fc126422f552aaf16144b"
server_key_version: "encryptionkey@0"
I20260811 15:06:07.541975 3761 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:06:07.559993 3761 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:06:07.562954 3761 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:06:07.563170 3761 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:06:07.563828 3761 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:06:07.564747 3761 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:06:07.564797 3761 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:06:07.564838 3761 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:06:07.564858 3761 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:06:07.573737 3761 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.66:35841
I20260811 15:06:07.573768 3908 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.66:35841 every 8 connection(s)
I20260811 15:06:07.574806 3761 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
I20260811 15:06:07.576655 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 3761
I20260811 15:06:07.576787 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-1/wal/instance
I20260811 15:06:07.577103 20401 external_mini_cluster.cc:1428] Setting key 07653df2647ad752a911adc4f3c92cf0
Aug 11 15:06:07 dist-test-slave-8n49 krb5kdc[3481](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460767, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.66@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.19.236.67@KRBTEST.COM; defaulting to no policy
I20260811 15:06:07.591323 3578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:07.576709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.66:60769 (local address 127.19.236.126:43737)
0811 15:06:07.576872 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0811 15:06:07.576878 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 15:06:07.577822 (+ 944us) server_negotiation.cc:407] Connection header received
0811 15:06:07.579698 (+ 1876us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:06:07.579700 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:06:07.579747 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:06:07.579817 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:06:07.581336 (+ 1519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:07.582201 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:07.584070 (+ 1869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:07.584317 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:07.584400 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:07.587348 (+ 2948us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:06:07.587352 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:06:07.587354 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:06:07.587376 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:06:07.589024 (+ 1648us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:06:07.589617 (+ 593us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:06:07.589621 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:06:07.589622 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:06:07.589704 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:06:07.590093 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:06:07.590096 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:06:07.590098 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:06:07.590296 (+ 198us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:06:07.590428 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0811 15:06:07.590988 (+ 560us) server_negotiation.cc:299] Negotiation successful
0811 15:06:07.591125 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.236.67@KRBTEST.COM" created.
I20260811 15:06:07.592221 3913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:07.577106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:43737 (local address 127.19.236.66:60769)
0811 15:06:07.577638 (+ 532us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:07.577708 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0811 15:06:07.579444 (+ 1736us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:06:07.579995 (+ 551us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:06:07.580006 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:06:07.580539 (+ 533us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:06:07.581185 (+ 646us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:06:07.581200 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:06:07.582358 (+ 1158us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:06:07.582364 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:06:07.583927 (+ 1563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:06:07.583942 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:06:07.584486 (+ 544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:06:07.584490 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:06:07.584761 (+ 271us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:07.585410 (+ 649us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:06:07.585437 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:06:07.587169 (+ 1732us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:06:07.589162 (+ 1993us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:06:07.589169 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:06:07.589186 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:06:07.589486 (+ 300us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:06:07.589807 (+ 321us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:06:07.589811 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:06:07.589813 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:06:07.589974 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:06:07.590439 (+ 465us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:06:07.590449 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:06:07.590715 (+ 266us) client_negotiation.cc:769] Sending connection context
0811 15:06:07.590917 (+ 202us) client_negotiation.cc:240] Negotiation successful
0811 15:06:07.591288 (+ 371us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":318,"thread_start_us":113,"threads_started":1}
I20260811 15:06:07.593598 3909 heartbeater.cc:347] Connected to a master server at 127.19.236.126:43737
I20260811 15:06:07.593858 3909 heartbeater.cc:464] Registering TS with master...
I20260811 15:06:07.594362 3909 heartbeater.cc:511] Master 127.19.236.126:43737 requested a full tablet report, sending...
I20260811 15:06:07.595469 3531 ts_manager.cc:194] Registered new tserver with Master: 17295ce6738a4eb594f9aeb25ec12052 (127.19.236.66:35841)
I20260811 15:06:07.596386 3531 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.236.66@KRBTEST.COM'} at 127.19.236.66:60769
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.236.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.67.keytab.
Entry for principal kudu/127.19.236.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.67.keytab.
I20260811 15:06:07.608144 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.67:0
--local_ip_for_outbound_sockets=127.19.236.67
--webserver_interface=127.19.236.67
--webserver_port=0
--tserver_master_addrs=127.19.236.126:43737
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.67.keytab
--principal=kudu/127.19.236.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:42739
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:06:07.722906 3918 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:06:07.723145 3918 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:06:07.723189 3918 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:06:07.727320 3918 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:06:07.727375 3918 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:06:07.727471 3918 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.67
I20260811 15:06:07.732671 3918 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:42739
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.67.keytab
--principal=kudu/127.19.236.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.236.67
--webserver_port=0
--tserver_master_addrs=127.19.236.126:43737
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3918
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.67
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:06:07.733716 3918 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:06:07.734738 3918 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:06:07.744728 3923 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:06:07.744728 3924 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:06:07.744722 3926 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:06:07.744765 3918 server_base.cc:1034] running on GCE node
I20260811 15:06:07.745522 3918 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:06:07.746330 3918 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:06:07.747524 3918 hybrid_clock.cc:648] HybridClock initialized: now 1786460767747510 us; error 30 us; skew 500 ppm
Aug 11 15:06:07 dist-test-slave-8n49 krb5kdc[3481](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460767, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:06:07.750530 3918 init.cc:377] Logged in from keytab as kudu/127.19.236.67@KRBTEST.COM (short username kudu)
I20260811 15:06:07.751407 3918 webserver.cc:460] Webserver started at http://127.19.236.67:34027/ using document root <none> and password file <none>
I20260811 15:06:07.751995 3918 fs_manager.cc:359] Metadata directory not provided
I20260811 15:06:07.752058 3918 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:06:07.752307 3918 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:06:07.754467 3918 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-2/data/instance:
uuid: "eec8d0c3c86e47c98651ecba3e80f6df"
format_stamp: "Formatted at 2026-08-11 15:06:07 on dist-test-slave-8n49"
server_key: "dd5ceaca2c406852746fc04b543707f2"
server_key_iv: "4c8472338ba447e00e43795e8455dc09"
server_key_version: "encryptionkey@0"
I20260811 15:06:07.755045 3918 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-2/wal/instance:
uuid: "eec8d0c3c86e47c98651ecba3e80f6df"
format_stamp: "Formatted at 2026-08-11 15:06:07 on dist-test-slave-8n49"
server_key: "dd5ceaca2c406852746fc04b543707f2"
server_key_iv: "4c8472338ba447e00e43795e8455dc09"
server_key_version: "encryptionkey@0"
I20260811 15:06:07.758852 3918 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 15:06:07.761322 3933 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:06:07.762516 3918 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 15:06:07.762656 3918 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-2/wal
uuid: "eec8d0c3c86e47c98651ecba3e80f6df"
format_stamp: "Formatted at 2026-08-11 15:06:07 on dist-test-slave-8n49"
server_key: "dd5ceaca2c406852746fc04b543707f2"
server_key_iv: "4c8472338ba447e00e43795e8455dc09"
server_key_version: "encryptionkey@0"
I20260811 15:06:07.762764 3918 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:06:07.783874 3918 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:06:07.787025 3918 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:06:07.787237 3918 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:06:07.787863 3918 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:06:07.788811 3918 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:06:07.788875 3918 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:06:07.788936 3918 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:06:07.788955 3918 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:06:07.798480 3918 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.67:33219
I20260811 15:06:07.798506 4062 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.67:33219 every 8 connection(s)
I20260811 15:06:07.799371 3918 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
I20260811 15:06:07.805706 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 3918
I20260811 15:06:07.805860 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-2/wal/instance
I20260811 15:06:07.806146 20401 external_mini_cluster.cc:1428] Setting key f776c0e0066a42785e45ea617e1d2dd8
Aug 11 15:06:07 dist-test-slave-8n49 krb5kdc[3481](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460767, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.67@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
I20260811 15:06:07.813400 3578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:07.801228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.67:34761 (local address 127.19.236.126:43737)
0811 15:06:07.801368 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0811 15:06:07.801372 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:06:07.802242 (+ 870us) server_negotiation.cc:407] Connection header received
0811 15:06:07.803645 (+ 1403us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:06:07.803649 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:06:07.803710 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:06:07.803812 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:06:07.805022 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:07.805691 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:07.807178 (+ 1487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:07.807533 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:07.807643 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:07.810136 (+ 2493us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:06:07.810140 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:06:07.810143 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:06:07.810168 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:06:07.811347 (+ 1179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:06:07.811851 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:06:07.811855 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:06:07.811857 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:06:07.811943 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:06:07.812285 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:06:07.812290 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:06:07.812292 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:06:07.812491 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:06:07.812619 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0811 15:06:07.813102 (+ 483us) server_negotiation.cc:299] Negotiation successful
0811 15:06:07.813226 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 15:06:07.814169 4065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:07.801603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:43737 (local address 127.19.236.67:34761)
0811 15:06:07.802104 (+ 501us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:07.802145 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 15:06:07.803439 (+ 1294us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:06:07.803986 (+ 547us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:06:07.803993 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:06:07.804342 (+ 349us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:06:07.804878 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:06:07.804892 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:06:07.805851 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:06:07.805859 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:06:07.807040 (+ 1181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:06:07.807053 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:06:07.807692 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:06:07.807697 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:06:07.807863 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:07.808468 (+ 605us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:06:07.808487 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:06:07.809969 (+ 1482us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:06:07.811468 (+ 1499us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:06:07.811474 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:06:07.811489 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:06:07.811744 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:06:07.812053 (+ 309us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:06:07.812056 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:06:07.812058 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:06:07.812190 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:06:07.812620 (+ 430us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:06:07.812628 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:06:07.812865 (+ 237us) client_negotiation.cc:769] Sending connection context
0811 15:06:07.813058 (+ 193us) client_negotiation.cc:240] Negotiation successful
0811 15:06:07.813370 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":318,"thread_start_us":145,"threads_started":1}
I20260811 15:06:07.815297 4063 heartbeater.cc:347] Connected to a master server at 127.19.236.126:43737
I20260811 15:06:07.815546 4063 heartbeater.cc:464] Registering TS with master...
I20260811 15:06:07.816043 4063 heartbeater.cc:511] Master 127.19.236.126:43737 requested a full tablet report, sending...
I20260811 15:06:07.817060 3531 ts_manager.cc:194] Registered new tserver with Master: eec8d0c3c86e47c98651ecba3e80f6df (127.19.236.67:33219)
I20260811 15:06:07.817643 3531 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.236.67@KRBTEST.COM'} at 127.19.236.67:34761
I20260811 15:06:07.819936 20401 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 15:06:07.829694 3578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:07.821967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36518 (local address 127.19.236.126:43737)
0811 15:06:07.822130 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0811 15:06:07.822135 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:06:07.822337 (+ 202us) server_negotiation.cc:407] Connection header received
0811 15:06:07.822436 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:06:07.822438 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:06:07.822478 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:06:07.822544 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:06:07.823210 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:07.823727 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:07.824675 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:07.824895 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:07.824979 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:07.826561 (+ 1582us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:06:07.826564 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:06:07.826566 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:06:07.826588 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:06:07.827873 (+ 1285us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:06:07.828325 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:06:07.828333 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:06:07.828334 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:06:07.828422 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:06:07.828767 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:06:07.828770 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:06:07.828771 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:06:07.829008 (+ 237us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:06:07.829136 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0811 15:06:07.829385 (+ 249us) server_negotiation.cc:299] Negotiation successful
0811 15:06:07.829484 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260811 15:06:07.832907 3531 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36518:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 15:06:07.835986 3531 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 15:06:07.851135 4079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:07.844743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.65:36747 (local address 127.0.0.1:54606)
0811 15:06:07.845941 (+ 1198us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:07.845960 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 15:06:07.846053 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:06:07.846766 (+ 713us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:06:07.846804 (+ 38us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:06:07.846825 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:06:07.846930 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:06:07.846937 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:06:07.847961 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:06:07.847967 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:06:07.849611 (+ 1644us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:06:07.849618 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:06:07.850708 (+ 1090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:06:07.850712 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:06:07.850856 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:07.850899 (+ 43us) client_negotiation.cc:769] Sending connection context
0811 15:06:07.850973 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 15:06:07.851028 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1117,"mutex_wait_us":109,"thread_start_us":118,"threads_started":1}
I20260811 15:06:07.851359 4080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:07.845374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33934 (local address 127.19.236.67:33219)
0811 15:06:07.845740 (+ 366us) server_negotiation.cc:206] Beginning negotiation
0811 15:06:07.845757 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 15:06:07.845781 (+ 24us) server_negotiation.cc:407] Connection header received
0811 15:06:07.845864 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:06:07.845871 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:06:07.846086 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:06:07.846703 (+ 617us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:06:07.846867 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:07.848060 (+ 1193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:07.849754 (+ 1694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:07.850570 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:07.850913 (+ 343us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:07.851061 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0811 15:06:07.851114 (+ 53us) server_negotiation.cc:299] Negotiation successful
0811 15:06:07.851212 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":260,"thread_start_us":177,"threads_started":1}
I20260811 15:06:07.851493 4082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:07.845493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35344 (local address 127.19.236.66:35841)
0811 15:06:07.846070 (+ 577us) server_negotiation.cc:206] Beginning negotiation
0811 15:06:07.846496 (+ 426us) server_negotiation.cc:399] Waiting for connection header
0811 15:06:07.846523 (+ 27us) server_negotiation.cc:407] Connection header received
0811 15:06:07.846603 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:06:07.846610 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:06:07.846784 (+ 174us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:06:07.846941 (+ 157us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:06:07.847123 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:07.848194 (+ 1071us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:07.849714 (+ 1520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:07.850268 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:07.850390 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:07.850542 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0811 15:06:07.851217 (+ 675us) server_negotiation.cc:299] Negotiation successful
0811 15:06:07.851325 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":485,"thread_start_us":105,"threads_started":1}
I20260811 15:06:07.851647 4081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:07.845493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54606 (local address 127.19.236.65:36747)
0811 15:06:07.845872 (+ 379us) server_negotiation.cc:206] Beginning negotiation
0811 15:06:07.845886 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 15:06:07.846158 (+ 272us) server_negotiation.cc:407] Connection header received
0811 15:06:07.846244 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:06:07.846252 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:06:07.846444 (+ 192us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:06:07.846622 (+ 178us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:06:07.847068 (+ 446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:07.847827 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:07.849753 (+ 1926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:07.850570 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:07.850699 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:07.850843 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0811 15:06:07.851326 (+ 483us) server_negotiation.cc:299] Negotiation successful
0811 15:06:07.851481 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":283,"thread_start_us":79,"threads_started":1}
I20260811 15:06:07.851266 4077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:07.844672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.67:33219 (local address 127.0.0.1:33934)
0811 15:06:07.845018 (+ 346us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:07.845065 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 15:06:07.845254 (+ 189us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:06:07.846319 (+ 1065us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:06:07.846328 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:06:07.846353 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:06:07.846548 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:06:07.846558 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:06:07.848205 (+ 1647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:06:07.848209 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:06:07.849593 (+ 1384us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:06:07.849612 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:06:07.850728 (+ 1116us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:06:07.850732 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:06:07.850864 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:07.850927 (+ 63us) client_negotiation.cc:769] Sending connection context
0811 15:06:07.850996 (+ 69us) client_negotiation.cc:240] Negotiation successful
0811 15:06:07.851069 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":175,"mutex_wait_us":196,"thread_start_us":99,"threads_started":1}
I20260811 15:06:07.851099 4078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:07.845043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.66:35841 (local address 127.0.0.1:35344)
0811 15:06:07.846222 (+ 1179us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:07.846235 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 15:06:07.846314 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:06:07.846912 (+ 598us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:06:07.846915 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:06:07.846929 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:06:07.847025 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:06:07.847033 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:06:07.848315 (+ 1282us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:06:07.848319 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:06:07.849597 (+ 1278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:06:07.849606 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:06:07.850390 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:06:07.850394 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:06:07.850644 (+ 250us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:07.850698 (+ 54us) client_negotiation.cc:769] Sending connection context
0811 15:06:07.850807 (+ 109us) client_negotiation.cc:240] Negotiation successful
0811 15:06:07.850932 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1117,"mutex_wait_us":32,"thread_start_us":102,"threads_started":1}
I20260811 15:06:07.854630 3676 tablet_service.cc:1467] Processing CreateTablet for tablet d85e337b55234ea29550ae0d787d858a (DEFAULT_TABLE table=test-table [id=0da920fad71047dcbd96a071eb68f3f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:06:07.854794 3988 tablet_service.cc:1467] Processing CreateTablet for tablet d85e337b55234ea29550ae0d787d858a (DEFAULT_TABLE table=test-table [id=0da920fad71047dcbd96a071eb68f3f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:06:07.854792 3832 tablet_service.cc:1467] Processing CreateTablet for tablet d85e337b55234ea29550ae0d787d858a (DEFAULT_TABLE table=test-table [id=0da920fad71047dcbd96a071eb68f3f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:06:07.855666 3676 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d85e337b55234ea29550ae0d787d858a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:06:07.855820 3832 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d85e337b55234ea29550ae0d787d858a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:06:07.855829 3988 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d85e337b55234ea29550ae0d787d858a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:06:07.861944 4083 tablet_bootstrap.cc:492] T d85e337b55234ea29550ae0d787d858a P c021852aca1a445ebd50c797ae4afa5a: Bootstrap starting.
I20260811 15:06:07.863600 4085 tablet_bootstrap.cc:492] T d85e337b55234ea29550ae0d787d858a P eec8d0c3c86e47c98651ecba3e80f6df: Bootstrap starting.
I20260811 15:06:07.864223 4083 tablet_bootstrap.cc:654] T d85e337b55234ea29550ae0d787d858a P c021852aca1a445ebd50c797ae4afa5a: Neither blocks nor log segments found. Creating new log.
I20260811 15:06:07.864895 4084 tablet_bootstrap.cc:492] T d85e337b55234ea29550ae0d787d858a P 17295ce6738a4eb594f9aeb25ec12052: Bootstrap starting.
I20260811 15:06:07.865446 4083 log.cc:824] T d85e337b55234ea29550ae0d787d858a P c021852aca1a445ebd50c797ae4afa5a: Log is configured to *not* fsync() on all Append() calls
I20260811 15:06:07.865667 4085 tablet_bootstrap.cc:654] T d85e337b55234ea29550ae0d787d858a P eec8d0c3c86e47c98651ecba3e80f6df: Neither blocks nor log segments found. Creating new log.
I20260811 15:06:07.866981 4085 log.cc:824] T d85e337b55234ea29550ae0d787d858a P eec8d0c3c86e47c98651ecba3e80f6df: Log is configured to *not* fsync() on all Append() calls
I20260811 15:06:07.867516 4083 tablet_bootstrap.cc:492] T d85e337b55234ea29550ae0d787d858a P c021852aca1a445ebd50c797ae4afa5a: No bootstrap required, opened a new log
I20260811 15:06:07.867641 4084 tablet_bootstrap.cc:654] T d85e337b55234ea29550ae0d787d858a P 17295ce6738a4eb594f9aeb25ec12052: Neither blocks nor log segments found. Creating new log.
I20260811 15:06:07.867729 4083 ts_tablet_manager.cc:1397] T d85e337b55234ea29550ae0d787d858a P c021852aca1a445ebd50c797ae4afa5a: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260811 15:06:07.868496 4084 log.cc:824] T d85e337b55234ea29550ae0d787d858a P 17295ce6738a4eb594f9aeb25ec12052: Log is configured to *not* fsync() on all Append() calls
I20260811 15:06:07.869166 4085 tablet_bootstrap.cc:492] T d85e337b55234ea29550ae0d787d858a P eec8d0c3c86e47c98651ecba3e80f6df: No bootstrap required, opened a new log
I20260811 15:06:07.869377 4085 ts_tablet_manager.cc:1397] T d85e337b55234ea29550ae0d787d858a P eec8d0c3c86e47c98651ecba3e80f6df: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260811 15:06:07.870535 4084 tablet_bootstrap.cc:492] T d85e337b55234ea29550ae0d787d858a P 17295ce6738a4eb594f9aeb25ec12052: No bootstrap required, opened a new log
I20260811 15:06:07.870776 4084 ts_tablet_manager.cc:1397] T d85e337b55234ea29550ae0d787d858a P 17295ce6738a4eb594f9aeb25ec12052: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260811 15:06:07.870820 4083 raft_consensus.cc:348] T d85e337b55234ea29550ae0d787d858a P c021852aca1a445ebd50c797ae4afa5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec8d0c3c86e47c98651ecba3e80f6df" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 33219 } } peers { permanent_uuid: "c021852aca1a445ebd50c797ae4afa5a" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 36747 } } peers { permanent_uuid: "17295ce6738a4eb594f9aeb25ec12052" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35841 } }
I20260811 15:06:07.871058 4083 raft_consensus.cc:374] T d85e337b55234ea29550ae0d787d858a P c021852aca1a445ebd50c797ae4afa5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:06:07.871111 4083 raft_consensus.cc:729] T d85e337b55234ea29550ae0d787d858a P c021852aca1a445ebd50c797ae4afa5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c021852aca1a445ebd50c797ae4afa5a, State: Initialized, Role: FOLLOWER
I20260811 15:06:07.871551 4083 consensus_queue.cc:260] T d85e337b55234ea29550ae0d787d858a P c021852aca1a445ebd50c797ae4afa5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec8d0c3c86e47c98651ecba3e80f6df" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 33219 } } peers { permanent_uuid: "c021852aca1a445ebd50c797ae4afa5a" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 36747 } } peers { permanent_uuid: "17295ce6738a4eb594f9aeb25ec12052" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35841 } }
I20260811 15:06:07.872201 3755 heartbeater.cc:503] Master 127.19.236.126:43737 was elected leader, sending a full tablet report...
I20260811 15:06:07.872503 4083 ts_tablet_manager.cc:1428] T d85e337b55234ea29550ae0d787d858a P c021852aca1a445ebd50c797ae4afa5a: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260811 15:06:07.873417 4085 raft_consensus.cc:348] T d85e337b55234ea29550ae0d787d858a P eec8d0c3c86e47c98651ecba3e80f6df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec8d0c3c86e47c98651ecba3e80f6df" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 33219 } } peers { permanent_uuid: "c021852aca1a445ebd50c797ae4afa5a" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 36747 } } peers { permanent_uuid: "17295ce6738a4eb594f9aeb25ec12052" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35841 } }
I20260811 15:06:07.873695 4085 raft_consensus.cc:374] T d85e337b55234ea29550ae0d787d858a P eec8d0c3c86e47c98651ecba3e80f6df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:06:07.873757 4085 raft_consensus.cc:729] T d85e337b55234ea29550ae0d787d858a P eec8d0c3c86e47c98651ecba3e80f6df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eec8d0c3c86e47c98651ecba3e80f6df, State: Initialized, Role: FOLLOWER
I20260811 15:06:07.874192 4085 consensus_queue.cc:260] T d85e337b55234ea29550ae0d787d858a P eec8d0c3c86e47c98651ecba3e80f6df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec8d0c3c86e47c98651ecba3e80f6df" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 33219 } } peers { permanent_uuid: "c021852aca1a445ebd50c797ae4afa5a" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 36747 } } peers { permanent_uuid: "17295ce6738a4eb594f9aeb25ec12052" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35841 } }
I20260811 15:06:07.874963 4063 heartbeater.cc:503] Master 127.19.236.126:43737 was elected leader, sending a full tablet report...
I20260811 15:06:07.875294 4085 ts_tablet_manager.cc:1428] T d85e337b55234ea29550ae0d787d858a P eec8d0c3c86e47c98651ecba3e80f6df: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260811 15:06:07.876013 4084 raft_consensus.cc:348] T d85e337b55234ea29550ae0d787d858a P 17295ce6738a4eb594f9aeb25ec12052 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec8d0c3c86e47c98651ecba3e80f6df" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 33219 } } peers { permanent_uuid: "c021852aca1a445ebd50c797ae4afa5a" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 36747 } } peers { permanent_uuid: "17295ce6738a4eb594f9aeb25ec12052" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35841 } }
I20260811 15:06:07.876295 4084 raft_consensus.cc:374] T d85e337b55234ea29550ae0d787d858a P 17295ce6738a4eb594f9aeb25ec12052 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:06:07.876362 4084 raft_consensus.cc:729] T d85e337b55234ea29550ae0d787d858a P 17295ce6738a4eb594f9aeb25ec12052 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17295ce6738a4eb594f9aeb25ec12052, State: Initialized, Role: FOLLOWER
I20260811 15:06:07.876857 4084 consensus_queue.cc:260] T d85e337b55234ea29550ae0d787d858a P 17295ce6738a4eb594f9aeb25ec12052 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec8d0c3c86e47c98651ecba3e80f6df" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 33219 } } peers { permanent_uuid: "c021852aca1a445ebd50c797ae4afa5a" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 36747 } } peers { permanent_uuid: "17295ce6738a4eb594f9aeb25ec12052" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35841 } }
I20260811 15:06:07.877512 3909 heartbeater.cc:503] Master 127.19.236.126:43737 was elected leader, sending a full tablet report...
I20260811 15:06:07.877856 4084 ts_tablet_manager.cc:1428] T d85e337b55234ea29550ae0d787d858a P 17295ce6738a4eb594f9aeb25ec12052: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260811 15:06:07.913054 4089 raft_consensus.cc:482] T d85e337b55234ea29550ae0d787d858a P c021852aca1a445ebd50c797ae4afa5a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 15:06:07.913305 4089 raft_consensus.cc:504] T d85e337b55234ea29550ae0d787d858a P c021852aca1a445ebd50c797ae4afa5a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec8d0c3c86e47c98651ecba3e80f6df" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 33219 } } peers { permanent_uuid: "c021852aca1a445ebd50c797ae4afa5a" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 36747 } } peers { permanent_uuid: "17295ce6738a4eb594f9aeb25ec12052" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35841 } }
I20260811 15:06:07.914469 4089 leader_election.cc:288] T d85e337b55234ea29550ae0d787d858a P c021852aca1a445ebd50c797ae4afa5a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eec8d0c3c86e47c98651ecba3e80f6df (127.19.236.67:33219), 17295ce6738a4eb594f9aeb25ec12052 (127.19.236.66:35841)
I20260811 15:06:07.918637 4082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:07.914873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.65:51461 (local address 127.19.236.66:35841)
0811 15:06:07.915021 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0811 15:06:07.915024 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 15:06:07.915375 (+ 351us) server_negotiation.cc:407] Connection header received
0811 15:06:07.915544 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:06:07.915547 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:06:07.915596 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:06:07.915678 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:06:07.915981 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:07.916491 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:07.917671 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:07.918065 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:07.918194 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:07.918250 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 15:06:07.918427 (+ 177us) server_negotiation.cc:299] Negotiation successful
0811 15:06:07.918502 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 15:06:07.918651 4092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:07.914729 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.66:35841 (local address 127.19.236.65:51461)
0811 15:06:07.915277 (+ 548us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:07.915290 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 15:06:07.915426 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:06:07.915692 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:06:07.915694 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:06:07.915711 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:06:07.915865 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:06:07.915871 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:06:07.916644 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:06:07.916648 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:06:07.917553 (+ 905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:06:07.917562 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:06:07.918201 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:06:07.918204 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:06:07.918295 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:07.918320 (+ 25us) client_negotiation.cc:769] Sending connection context
0811 15:06:07.918398 (+ 78us) client_negotiation.cc:240] Negotiation successful
0811 15:06:07.918470 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":487,"mutex_wait_us":40,"thread_start_us":354,"threads_started":1}
I20260811 15:06:07.918658 4080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:07.914867 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.65:57639 (local address 127.19.236.67:33219)
0811 15:06:07.915016 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0811 15:06:07.915020 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:06:07.915447 (+ 427us) server_negotiation.cc:407] Connection header received
0811 15:06:07.915610 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:06:07.915612 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:06:07.915653 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:06:07.915732 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:06:07.916037 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:07.916523 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:07.917685 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:07.918100 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:07.918222 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:07.918277 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 15:06:07.918459 (+ 182us) server_negotiation.cc:299] Negotiation successful
0811 15:06:07.918529 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 15:06:07.918681 4093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:07.914729 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.67:33219 (local address 127.19.236.65:57639)
0811 15:06:07.915349 (+ 620us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:07.915361 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 15:06:07.915479 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:06:07.915745 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:06:07.915748 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:06:07.915773 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:06:07.915924 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:06:07.915929 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:06:07.916656 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:06:07.916660 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:06:07.917554 (+ 894us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:06:07.917563 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:06:07.918223 (+ 660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:06:07.918227 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:06:07.918341 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:07.918359 (+ 18us) client_negotiation.cc:769] Sending connection context
0811 15:06:07.918441 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 15:06:07.918509 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":555,"mutex_wait_us":155,"spinlock_wait_cycles":768,"thread_start_us":319,"threads_started":1}
I20260811 15:06:07.919296 4010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d85e337b55234ea29550ae0d787d858a" candidate_uuid: "c021852aca1a445ebd50c797ae4afa5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eec8d0c3c86e47c98651ecba3e80f6df" is_pre_election: true
I20260811 15:06:07.919533 3856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d85e337b55234ea29550ae0d787d858a" candidate_uuid: "c021852aca1a445ebd50c797ae4afa5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17295ce6738a4eb594f9aeb25ec12052" is_pre_election: true
I20260811 15:06:07.919610 4010 raft_consensus.cc:2454] T d85e337b55234ea29550ae0d787d858a P eec8d0c3c86e47c98651ecba3e80f6df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c021852aca1a445ebd50c797ae4afa5a in term 0.
I20260811 15:06:07.919811 3856 raft_consensus.cc:2454] T d85e337b55234ea29550ae0d787d858a P 17295ce6738a4eb594f9aeb25ec12052 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c021852aca1a445ebd50c797ae4afa5a in term 0.
I20260811 15:06:07.920054 3626 leader_election.cc:302] T d85e337b55234ea29550ae0d787d858a P c021852aca1a445ebd50c797ae4afa5a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c021852aca1a445ebd50c797ae4afa5a, eec8d0c3c86e47c98651ecba3e80f6df; no voters:
I20260811 15:06:07.920351 4089 raft_consensus.cc:2781] T d85e337b55234ea29550ae0d787d858a P c021852aca1a445ebd50c797ae4afa5a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 15:06:07.920459 4089 raft_consensus.cc:482] T d85e337b55234ea29550ae0d787d858a P c021852aca1a445ebd50c797ae4afa5a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 15:06:07.920517 4089 raft_consensus.cc:3037] T d85e337b55234ea29550ae0d787d858a P c021852aca1a445ebd50c797ae4afa5a [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:06:07.921797 4089 raft_consensus.cc:504] T d85e337b55234ea29550ae0d787d858a P c021852aca1a445ebd50c797ae4afa5a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec8d0c3c86e47c98651ecba3e80f6df" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 33219 } } peers { permanent_uuid: "c021852aca1a445ebd50c797ae4afa5a" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 36747 } } peers { permanent_uuid: "17295ce6738a4eb594f9aeb25ec12052" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35841 } }
I20260811 15:06:07.922158 4089 leader_election.cc:288] T d85e337b55234ea29550ae0d787d858a P c021852aca1a445ebd50c797ae4afa5a [CANDIDATE]: Term 1 election: Requested vote from peers eec8d0c3c86e47c98651ecba3e80f6df (127.19.236.67:33219), 17295ce6738a4eb594f9aeb25ec12052 (127.19.236.66:35841)
I20260811 15:06:07.922523 3856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d85e337b55234ea29550ae0d787d858a" candidate_uuid: "c021852aca1a445ebd50c797ae4afa5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17295ce6738a4eb594f9aeb25ec12052"
I20260811 15:06:07.922531 4010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d85e337b55234ea29550ae0d787d858a" candidate_uuid: "c021852aca1a445ebd50c797ae4afa5a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eec8d0c3c86e47c98651ecba3e80f6df"
I20260811 15:06:07.922648 3856 raft_consensus.cc:3037] T d85e337b55234ea29550ae0d787d858a P 17295ce6738a4eb594f9aeb25ec12052 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:06:07.922660 4010 raft_consensus.cc:3037] T d85e337b55234ea29550ae0d787d858a P eec8d0c3c86e47c98651ecba3e80f6df [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:06:07.923651 3856 raft_consensus.cc:2454] T d85e337b55234ea29550ae0d787d858a P 17295ce6738a4eb594f9aeb25ec12052 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c021852aca1a445ebd50c797ae4afa5a in term 1.
I20260811 15:06:07.923702 4010 raft_consensus.cc:2454] T d85e337b55234ea29550ae0d787d858a P eec8d0c3c86e47c98651ecba3e80f6df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c021852aca1a445ebd50c797ae4afa5a in term 1.
I20260811 15:06:07.923960 3626 leader_election.cc:302] T d85e337b55234ea29550ae0d787d858a P c021852aca1a445ebd50c797ae4afa5a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c021852aca1a445ebd50c797ae4afa5a, eec8d0c3c86e47c98651ecba3e80f6df; no voters:
I20260811 15:06:07.924140 4089 raft_consensus.cc:2781] T d85e337b55234ea29550ae0d787d858a P c021852aca1a445ebd50c797ae4afa5a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:06:07.924386 4089 raft_consensus.cc:686] T d85e337b55234ea29550ae0d787d858a P c021852aca1a445ebd50c797ae4afa5a [term 1 LEADER]: Becoming Leader. State: Replica: c021852aca1a445ebd50c797ae4afa5a, State: Running, Role: LEADER
I20260811 15:06:07.924759 4089 consensus_queue.cc:237] T d85e337b55234ea29550ae0d787d858a P c021852aca1a445ebd50c797ae4afa5a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec8d0c3c86e47c98651ecba3e80f6df" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 33219 } } peers { permanent_uuid: "c021852aca1a445ebd50c797ae4afa5a" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 36747 } } peers { permanent_uuid: "17295ce6738a4eb594f9aeb25ec12052" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35841 } }
I20260811 15:06:07.928103 3531 catalog_manager.cc:5495] T d85e337b55234ea29550ae0d787d858a P c021852aca1a445ebd50c797ae4afa5a reported cstate change: term changed from 0 to 1, leader changed from <none> to c021852aca1a445ebd50c797ae4afa5a (127.19.236.65). New cstate: current_term: 1 leader_uuid: "c021852aca1a445ebd50c797ae4afa5a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec8d0c3c86e47c98651ecba3e80f6df" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 33219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c021852aca1a445ebd50c797ae4afa5a" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 36747 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17295ce6738a4eb594f9aeb25ec12052" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35841 } health_report { overall_health: UNKNOWN } } }
I20260811 15:06:07.955147 4081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:07.951549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54618 (local address 127.19.236.65:36747)
0811 15:06:07.951699 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0811 15:06:07.951705 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 15:06:07.951722 (+ 17us) server_negotiation.cc:407] Connection header received
0811 15:06:07.951820 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:06:07.951822 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:06:07.951876 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:06:07.951991 (+ 115us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 15:06:07.952250 (+ 259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:07.952798 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:07.953653 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:07.953875 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:07.953988 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:07.954303 (+ 315us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 15:06:07.954737 (+ 434us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 15:06:07.954869 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0811 15:06:07.954939 (+ 70us) server_negotiation.cc:299] Negotiation successful
0811 15:06:07.954998 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 15:06:07.961103 4010 raft_consensus.cc:1261] T d85e337b55234ea29550ae0d787d858a P eec8d0c3c86e47c98651ecba3e80f6df [term 1 FOLLOWER]: Refusing update from remote peer c021852aca1a445ebd50c797ae4afa5a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:06:07.961103 3856 raft_consensus.cc:1261] T d85e337b55234ea29550ae0d787d858a P 17295ce6738a4eb594f9aeb25ec12052 [term 1 FOLLOWER]: Refusing update from remote peer c021852aca1a445ebd50c797ae4afa5a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:06:07.961817 4089 consensus_queue.cc:1035] T d85e337b55234ea29550ae0d787d858a P c021852aca1a445ebd50c797ae4afa5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "17295ce6738a4eb594f9aeb25ec12052" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:06:07.962044 4094 consensus_queue.cc:1035] T d85e337b55234ea29550ae0d787d858a P c021852aca1a445ebd50c797ae4afa5a [LEADER]: Connected to new peer: Peer: permanent_uuid: "eec8d0c3c86e47c98651ecba3e80f6df" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 33219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:06:07.970918 4099 mvcc.cc:205] Tried to move back new op lower bound from 7317343305561354240 to 7317343305422450688. Current Snapshot: MvccSnapshot[applied={T|T < 7317343305561354240}]
I20260811 15:06:07.978874 3530 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36518:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 15:06:07.979046 3530 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36518:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 15:06:07.981521 3530 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b6742f0314744b19a6b25bc347fd6f10: Sending DeleteTablet for 3 replicas of tablet d85e337b55234ea29550ae0d787d858a
I20260811 15:06:07.982704 3988 tablet_service.cc:1514] Processing DeleteTablet for tablet d85e337b55234ea29550ae0d787d858a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:06:07 UTC) from {username='kudu', principal='kudu/127.19.236.126@KRBTEST.COM'} at 127.0.0.1:33934
I20260811 15:06:07.982684 3832 tablet_service.cc:1514] Processing DeleteTablet for tablet d85e337b55234ea29550ae0d787d858a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:06:07 UTC) from {username='kudu', principal='kudu/127.19.236.126@KRBTEST.COM'} at 127.0.0.1:35344
I20260811 15:06:07.982827 3676 tablet_service.cc:1514] Processing DeleteTablet for tablet d85e337b55234ea29550ae0d787d858a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:06:07 UTC) from {username='kudu', principal='kudu/127.19.236.126@KRBTEST.COM'} at 127.0.0.1:54606
I20260811 15:06:07.983377 4110 tablet_replica.cc:330] T d85e337b55234ea29550ae0d787d858a P c021852aca1a445ebd50c797ae4afa5a: stopping tablet replica
I20260811 15:06:07.983552 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 3604
I20260811 15:06:07.983565 4107 tablet_replica.cc:330] T d85e337b55234ea29550ae0d787d858a P 17295ce6738a4eb594f9aeb25ec12052: stopping tablet replica
I20260811 15:06:07.983753 4110 raft_consensus.cc:2229] T d85e337b55234ea29550ae0d787d858a P c021852aca1a445ebd50c797ae4afa5a [term 1 LEADER]: Raft consensus shutting down.
I20260811 15:06:07.984341 4107 raft_consensus.cc:2229] T d85e337b55234ea29550ae0d787d858a P 17295ce6738a4eb594f9aeb25ec12052 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 15:06:07.984737 4107 raft_consensus.cc:2258] T d85e337b55234ea29550ae0d787d858a P 17295ce6738a4eb594f9aeb25ec12052 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:06:07.985199 4109 tablet_replica.cc:330] T d85e337b55234ea29550ae0d787d858a P eec8d0c3c86e47c98651ecba3e80f6df: stopping tablet replica
I20260811 15:06:07.985574 4109 raft_consensus.cc:2229] T d85e337b55234ea29550ae0d787d858a P eec8d0c3c86e47c98651ecba3e80f6df [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 15:06:07.985891 4109 raft_consensus.cc:2258] T d85e337b55234ea29550ae0d787d858a P eec8d0c3c86e47c98651ecba3e80f6df [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:06:07.987808 4107 ts_tablet_manager.cc:1905] T d85e337b55234ea29550ae0d787d858a P 17295ce6738a4eb594f9aeb25ec12052: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 15:06:07.987844 4109 ts_tablet_manager.cc:1905] T d85e337b55234ea29550ae0d787d858a P eec8d0c3c86e47c98651ecba3e80f6df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 15:06:07.990724 4107 ts_tablet_manager.cc:1918] T d85e337b55234ea29550ae0d787d858a P 17295ce6738a4eb594f9aeb25ec12052: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 15:06:07.990724 4109 ts_tablet_manager.cc:1918] T d85e337b55234ea29550ae0d787d858a P eec8d0c3c86e47c98651ecba3e80f6df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 15:06:07.990839 4109 log.cc:1196] T d85e337b55234ea29550ae0d787d858a P eec8d0c3c86e47c98651ecba3e80f6df: Deleting WAL directory at /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-2/wal/wals/d85e337b55234ea29550ae0d787d858a
I20260811 15:06:07.990839 4107 log.cc:1196] T d85e337b55234ea29550ae0d787d858a P 17295ce6738a4eb594f9aeb25ec12052: Deleting WAL directory at /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-1/wal/wals/d85e337b55234ea29550ae0d787d858a
I20260811 15:06:07.991211 4109 ts_tablet_manager.cc:1939] T d85e337b55234ea29550ae0d787d858a P eec8d0c3c86e47c98651ecba3e80f6df: Deleting consensus metadata
I20260811 15:06:07.991211 4107 ts_tablet_manager.cc:1939] T d85e337b55234ea29550ae0d787d858a P 17295ce6738a4eb594f9aeb25ec12052: Deleting consensus metadata
I20260811 15:06:07.992672 3517 catalog_manager.cc:4841] TS eec8d0c3c86e47c98651ecba3e80f6df (127.19.236.67:33219): tablet d85e337b55234ea29550ae0d787d858a (table test-table [id=0da920fad71047dcbd96a071eb68f3f6]) successfully deleted
I20260811 15:06:07.992704 3516 catalog_manager.cc:4841] TS 17295ce6738a4eb594f9aeb25ec12052 (127.19.236.66:35841): tablet d85e337b55234ea29550ae0d787d858a (table test-table [id=0da920fad71047dcbd96a071eb68f3f6]) successfully deleted
W20260811 15:06:07.993470 3514 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.19.236.65:36747 (error 108)
I20260811 15:06:07.993772 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 3761
I20260811 15:06:07.995685 4078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:07.995309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.65:36747 (local address 127.0.0.1:54632)
0811 15:06:07.995484 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:07.995572 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.65:36747: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260811 15:06:07.995862 3514 catalog_manager.cc:4584] TS c021852aca1a445ebd50c797ae4afa5a (127.19.236.65:36747): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d85e337b55234ea29550ae0d787d858a: Network error: Client connection negotiation failed: client connection to 127.19.236.65:36747: connect: Connection refused (error 111)
I20260811 15:06:08.002897 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 3918
I20260811 15:06:08.010335 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 3496
I20260811 15:06:08.019366 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:43737
--webserver_interface=127.19.236.126
--webserver_port=34105
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab
--principal=kudu/127.19.236.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:42739
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.236.126:43737
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:06:08.135030 4112 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:06:08.135352 4112 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:06:08.135437 4112 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:06:08.139411 4112 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:06:08.139464 4112 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:06:08.139485 4112 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:06:08.139503 4112 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:06:08.139518 4112 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:06:08.144719 4112 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:42739
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.19.236.126:43737
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab
--principal=kudu/127.19.236.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:43737
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.236.126
--webserver_port=34105
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4112
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:06:08.145790 4112 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:06:08.146781 4112 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:06:08.160470 4120 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:06:08.160511 4123 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:06:08.160543 4112 server_base.cc:1034] running on GCE node
W20260811 15:06:08.160482 4119 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:06:08.161432 4112 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:06:08.162533 4112 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:06:08.163699 4112 hybrid_clock.cc:648] HybridClock initialized: now 1786460768163682 us; error 29 us; skew 500 ppm
Aug 11 15:06:08 dist-test-slave-8n49 krb5kdc[3481](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460768, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:06:08.166605 4112 init.cc:377] Logged in from keytab as kudu/127.19.236.126@KRBTEST.COM (short username kudu)
I20260811 15:06:08.167502 4112 webserver.cc:460] Webserver started at http://127.19.236.126:34105/ using document root <none> and password file <none>
I20260811 15:06:08.168102 4112 fs_manager.cc:359] Metadata directory not provided
I20260811 15:06:08.168180 4112 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:06:08.172204 4112 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260811 15:06:08.174459 4131 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:06:08.175673 4112 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260811 15:06:08.175810 4112 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/master-0/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/master-0/wal
uuid: "b6742f0314744b19a6b25bc347fd6f10"
format_stamp: "Formatted at 2026-08-11 15:06:07 on dist-test-slave-8n49"
server_key: "55ea0c75adfa2ed63a4f110431b1603d"
server_key_iv: "b1ee7335eb9069ed7cd34e1c0f1acab9"
server_key_version: "encryptionkey@0"
I20260811 15:06:08.176429 4112 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:06:08.200925 4112 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:06:08.204526 4112 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:06:08.204828 4112 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:06:08.212328 4112 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.126:43737
I20260811 15:06:08.212677 4193 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.126:43737 every 8 connection(s)
I20260811 15:06:08.213617 4112 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
I20260811 15:06:08.216850 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 4112
I20260811 15:06:08.217303 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.65:36747
--local_ip_for_outbound_sockets=127.19.236.65
--tserver_master_addrs=127.19.236.126:43737
--webserver_port=46161
--webserver_interface=127.19.236.65
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.65.keytab
--principal=kudu/127.19.236.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:42739
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 15:06:08.218405 4194 sys_catalog.cc:263] Verifying existing consensus state
I20260811 15:06:08.221150 4194 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b6742f0314744b19a6b25bc347fd6f10: Bootstrap starting.
I20260811 15:06:08.243518 4194 log.cc:824] T 00000000000000000000000000000000 P b6742f0314744b19a6b25bc347fd6f10: Log is configured to *not* fsync() on all Append() calls
I20260811 15:06:08.253352 4194 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b6742f0314744b19a6b25bc347fd6f10: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 15:06:08.253796 4194 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b6742f0314744b19a6b25bc347fd6f10: Bootstrap complete.
I20260811 15:06:08.258131 4194 raft_consensus.cc:348] T 00000000000000000000000000000000 P b6742f0314744b19a6b25bc347fd6f10 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6742f0314744b19a6b25bc347fd6f10" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 43737 } }
I20260811 15:06:08.258543 4194 raft_consensus.cc:729] T 00000000000000000000000000000000 P b6742f0314744b19a6b25bc347fd6f10 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6742f0314744b19a6b25bc347fd6f10, State: Initialized, Role: FOLLOWER
I20260811 15:06:08.259254 4194 consensus_queue.cc:260] T 00000000000000000000000000000000 P b6742f0314744b19a6b25bc347fd6f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6742f0314744b19a6b25bc347fd6f10" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 43737 } }
I20260811 15:06:08.259402 4194 raft_consensus.cc:388] T 00000000000000000000000000000000 P b6742f0314744b19a6b25bc347fd6f10 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 15:06:08.259495 4194 raft_consensus.cc:482] T 00000000000000000000000000000000 P b6742f0314744b19a6b25bc347fd6f10 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 15:06:08.259615 4194 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b6742f0314744b19a6b25bc347fd6f10 [term 1 FOLLOWER]: Advancing to term 2
I20260811 15:06:08.261677 4194 raft_consensus.cc:504] T 00000000000000000000000000000000 P b6742f0314744b19a6b25bc347fd6f10 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6742f0314744b19a6b25bc347fd6f10" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 43737 } }
I20260811 15:06:08.262044 4194 leader_election.cc:302] T 00000000000000000000000000000000 P b6742f0314744b19a6b25bc347fd6f10 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b6742f0314744b19a6b25bc347fd6f10; no voters:
I20260811 15:06:08.262368 4194 leader_election.cc:288] T 00000000000000000000000000000000 P b6742f0314744b19a6b25bc347fd6f10 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 15:06:08.262537 4198 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b6742f0314744b19a6b25bc347fd6f10 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 15:06:08.262785 4198 raft_consensus.cc:686] T 00000000000000000000000000000000 P b6742f0314744b19a6b25bc347fd6f10 [term 2 LEADER]: Becoming Leader. State: Replica: b6742f0314744b19a6b25bc347fd6f10, State: Running, Role: LEADER
I20260811 15:06:08.263208 4198 consensus_queue.cc:237] T 00000000000000000000000000000000 P b6742f0314744b19a6b25bc347fd6f10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6742f0314744b19a6b25bc347fd6f10" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 43737 } }
I20260811 15:06:08.263618 4194 sys_catalog.cc:564] T 00000000000000000000000000000000 P b6742f0314744b19a6b25bc347fd6f10 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:06:08.264233 4198 sys_catalog.cc:455] T 00000000000000000000000000000000 P b6742f0314744b19a6b25bc347fd6f10 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b6742f0314744b19a6b25bc347fd6f10. Latest consensus state: current_term: 2 leader_uuid: "b6742f0314744b19a6b25bc347fd6f10" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6742f0314744b19a6b25bc347fd6f10" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 43737 } } }
I20260811 15:06:08.264358 4198 sys_catalog.cc:458] T 00000000000000000000000000000000 P b6742f0314744b19a6b25bc347fd6f10 [sys.catalog]: This master's current role is: LEADER
I20260811 15:06:08.265046 4199 sys_catalog.cc:455] T 00000000000000000000000000000000 P b6742f0314744b19a6b25bc347fd6f10 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "b6742f0314744b19a6b25bc347fd6f10" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6742f0314744b19a6b25bc347fd6f10" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 43737 } } }
I20260811 15:06:08.265166 4199 sys_catalog.cc:458] T 00000000000000000000000000000000 P b6742f0314744b19a6b25bc347fd6f10 [sys.catalog]: This master's current role is: LEADER
I20260811 15:06:08.266050 4204 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:06:08.271723 4204 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:06:08.272413 4204 catalog_manager.cc:1259] Loaded cluster ID: a93c6095c5d64a53b6e596b67ef34bbe
I20260811 15:06:08.272477 4204 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:06:08.273912 4204 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260811 15:06:08.278435 4204 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260811 15:06:08.284086 4204 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:06:08.284933 4204 catalog_manager.cc:5879] T 00000000000000000000000000000000 P b6742f0314744b19a6b25bc347fd6f10: Loaded TSK: 0
I20260811 15:06:08.286159 4204 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 15:06:08.346829 4196 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:06:08.347111 4196 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:06:08.347157 4196 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:06:08.351349 4196 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:06:08.351418 4196 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:06:08.351511 4196 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.65
I20260811 15:06:08.356863 4196 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:42739
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.65.keytab
--principal=kudu/127.19.236.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.65:36747
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.236.65
--webserver_port=46161
--tserver_master_addrs=127.19.236.126:43737
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4196
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.65
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:06:08.357930 4196 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:06:08.358990 4196 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:06:08.370573 4222 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:06:08.370584 4221 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:06:08.370791 4224 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:06:08.370790 4196 server_base.cc:1034] running on GCE node
I20260811 15:06:08.371331 4196 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:06:08.372028 4196 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:06:08.373215 4196 hybrid_clock.cc:648] HybridClock initialized: now 1786460768373181 us; error 55 us; skew 500 ppm
Aug 11 15:06:08 dist-test-slave-8n49 krb5kdc[3481](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460768, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:06:08.376353 4196 init.cc:377] Logged in from keytab as kudu/127.19.236.65@KRBTEST.COM (short username kudu)
I20260811 15:06:08.377421 4196 webserver.cc:460] Webserver started at http://127.19.236.65:46161/ using document root <none> and password file <none>
I20260811 15:06:08.378033 4196 fs_manager.cc:359] Metadata directory not provided
I20260811 15:06:08.378109 4196 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:06:08.382699 4196 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.002s
I20260811 15:06:08.385212 4233 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:06:08.386593 4196 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 15:06:08.386722 4196 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-0/wal
uuid: "c021852aca1a445ebd50c797ae4afa5a"
format_stamp: "Formatted at 2026-08-11 15:06:07 on dist-test-slave-8n49"
server_key: "353d1470315869865dfe3274cbabd640"
server_key_iv: "a1502811da12d547a281551deb07db9f"
server_key_version: "encryptionkey@0"
I20260811 15:06:08.387333 4196 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:06:08.398983 4196 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:06:08.402349 4196 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:06:08.402556 4196 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:06:08.403185 4196 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:06:08.404363 4240 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 15:06:08.408584 4196 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 15:06:08.408651 4196 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.000s sys 0.000s
I20260811 15:06:08.408725 4196 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 15:06:08.410425 4196 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 15:06:08.410486 4196 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260811 15:06:08.410755 4240 tablet_bootstrap.cc:492] T d85e337b55234ea29550ae0d787d858a P c021852aca1a445ebd50c797ae4afa5a: Bootstrap starting.
I20260811 15:06:08.422118 4196 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.65:36747
I20260811 15:06:08.422220 4358 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.65:36747 every 8 connection(s)
I20260811 15:06:08.423453 4196 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
I20260811 15:06:08.425833 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 4196
I20260811 15:06:08.426393 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.66:35841
--local_ip_for_outbound_sockets=127.19.236.66
--tserver_master_addrs=127.19.236.126:43737
--webserver_port=34939
--webserver_interface=127.19.236.66
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.66.keytab
--principal=kudu/127.19.236.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:42739
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 15:06:08.433192 4240 log.cc:824] T d85e337b55234ea29550ae0d787d858a P c021852aca1a445ebd50c797ae4afa5a: Log is configured to *not* fsync() on all Append() calls
Aug 11 15:06:08 dist-test-slave-8n49 krb5kdc[3481](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460768, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.65@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
I20260811 15:06:08.441499 4240 tablet_bootstrap.cc:492] T d85e337b55234ea29550ae0d787d858a P c021852aca1a445ebd50c797ae4afa5a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 15:06:08.441927 4240 tablet_bootstrap.cc:492] T d85e337b55234ea29550ae0d787d858a P c021852aca1a445ebd50c797ae4afa5a: Bootstrap complete.
I20260811 15:06:08.443334 4240 ts_tablet_manager.cc:1397] T d85e337b55234ea29550ae0d787d858a P c021852aca1a445ebd50c797ae4afa5a: Time spent bootstrapping tablet: real 0.033s user 0.026s sys 0.004s
I20260811 15:06:08.443898 4361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:08.425769 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.65:54631 (local address 127.19.236.126:43737)
0811 15:06:08.426374 (+ 605us) server_negotiation.cc:206] Beginning negotiation
0811 15:06:08.426395 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0811 15:06:08.427162 (+ 767us) server_negotiation.cc:407] Connection header received
0811 15:06:08.428764 (+ 1602us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:06:08.428775 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:06:08.429088 (+ 313us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:06:08.429415 (+ 327us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:06:08.430805 (+ 1390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:08.432072 (+ 1267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:08.433431 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:08.434064 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:08.434262 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:08.437584 (+ 3322us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:06:08.437594 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:06:08.437616 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:06:08.437656 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:06:08.440044 (+ 2388us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:06:08.440733 (+ 689us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:06:08.440744 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:06:08.440752 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:06:08.440936 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:06:08.441346 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:06:08.441350 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:06:08.441352 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:06:08.441824 (+ 472us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:06:08.441963 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0811 15:06:08.442674 (+ 711us) server_negotiation.cc:299] Negotiation successful
0811 15:06:08.442981 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":438,"thread_start_us":127,"threads_started":1}
I20260811 15:06:08.443934 4362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:08.425725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:43737 (local address 127.19.236.65:54631)
0811 15:06:08.426941 (+ 1216us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:08.427005 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0811 15:06:08.428278 (+ 1273us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:06:08.429482 (+ 1204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:06:08.429491 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:06:08.429925 (+ 434us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:06:08.430566 (+ 641us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:06:08.430594 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:06:08.432242 (+ 1648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:06:08.432245 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:06:08.433281 (+ 1036us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:06:08.433292 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:06:08.434238 (+ 946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:06:08.434245 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:06:08.434512 (+ 267us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:08.435273 (+ 761us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:06:08.435299 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:06:08.437327 (+ 2028us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:06:08.440190 (+ 2863us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:06:08.440196 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:06:08.440208 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:06:08.440588 (+ 380us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:06:08.441053 (+ 465us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:06:08.441058 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:06:08.441060 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:06:08.441229 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:06:08.441955 (+ 726us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:06:08.441964 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:06:08.442320 (+ 356us) client_negotiation.cc:769] Sending connection context
0811 15:06:08.442522 (+ 202us) client_negotiation.cc:240] Negotiation successful
0811 15:06:08.442880 (+ 358us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":970,"thread_start_us":201,"threads_started":1}
I20260811 15:06:08.446125 4240 raft_consensus.cc:348] T d85e337b55234ea29550ae0d787d858a P c021852aca1a445ebd50c797ae4afa5a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec8d0c3c86e47c98651ecba3e80f6df" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 33219 } } peers { permanent_uuid: "c021852aca1a445ebd50c797ae4afa5a" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 36747 } } peers { permanent_uuid: "17295ce6738a4eb594f9aeb25ec12052" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35841 } }
I20260811 15:06:08.446664 4240 raft_consensus.cc:729] T d85e337b55234ea29550ae0d787d858a P c021852aca1a445ebd50c797ae4afa5a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c021852aca1a445ebd50c797ae4afa5a, State: Initialized, Role: FOLLOWER
I20260811 15:06:08.447109 4359 heartbeater.cc:347] Connected to a master server at 127.19.236.126:43737
I20260811 15:06:08.447168 4240 consensus_queue.cc:260] T d85e337b55234ea29550ae0d787d858a P c021852aca1a445ebd50c797ae4afa5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec8d0c3c86e47c98651ecba3e80f6df" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 33219 } } peers { permanent_uuid: "c021852aca1a445ebd50c797ae4afa5a" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 36747 } } peers { permanent_uuid: "17295ce6738a4eb594f9aeb25ec12052" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35841 } }
I20260811 15:06:08.447351 4359 heartbeater.cc:464] Registering TS with master...
I20260811 15:06:08.447971 4359 heartbeater.cc:511] Master 127.19.236.126:43737 requested a full tablet report, sending...
I20260811 15:06:08.448204 4240 ts_tablet_manager.cc:1428] T d85e337b55234ea29550ae0d787d858a P c021852aca1a445ebd50c797ae4afa5a: Time spent starting tablet: real 0.005s user 0.007s sys 0.000s
I20260811 15:06:08.450664 4150 ts_manager.cc:194] Registered new tserver with Master: c021852aca1a445ebd50c797ae4afa5a (127.19.236.65:36747)
I20260811 15:06:08.454392 4150 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.236.65@KRBTEST.COM'} at 127.19.236.65:54631
I20260811 15:06:08.457294 4359 heartbeater.cc:503] Master 127.19.236.126:43737 was elected leader, sending a full tablet report...
Aug 11 15:06:08 dist-test-slave-8n49 krb5kdc[3481](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460768, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.126@KRBTEST.COM for kudu/127.19.236.65@KRBTEST.COM
I20260811 15:06:08.463819 4368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:08.453512 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.65:36747 (local address 127.0.0.1:54638)
0811 15:06:08.453915 (+ 403us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:08.453960 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 15:06:08.454097 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:06:08.454734 (+ 637us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:06:08.454740 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:06:08.455176 (+ 436us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:06:08.455328 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:06:08.455338 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:06:08.456439 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:06:08.456442 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:06:08.457225 (+ 783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:06:08.457237 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:06:08.457956 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:06:08.457960 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:06:08.458086 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:08.458657 (+ 571us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:06:08.458669 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:06:08.460091 (+ 1422us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:06:08.461947 (+ 1856us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:06:08.461957 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:06:08.461962 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:06:08.462203 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:06:08.462530 (+ 327us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:06:08.462533 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:06:08.462535 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:06:08.462624 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:06:08.463079 (+ 455us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:06:08.463085 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:06:08.463229 (+ 144us) client_negotiation.cc:769] Sending connection context
0811 15:06:08.463391 (+ 162us) client_negotiation.cc:240] Negotiation successful
0811 15:06:08.463599 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":92,"threads_started":1}
I20260811 15:06:08.463861 4369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:08.453611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54638 (local address 127.19.236.65:36747)
0811 15:06:08.454247 (+ 636us) server_negotiation.cc:206] Beginning negotiation
0811 15:06:08.454259 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 15:06:08.454284 (+ 25us) server_negotiation.cc:407] Connection header received
0811 15:06:08.454353 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:06:08.454358 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:06:08.454566 (+ 208us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:06:08.454703 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:06:08.455471 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:08.456302 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:08.457359 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:08.457838 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:08.457952 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:08.460227 (+ 2275us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:06:08.460237 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:06:08.460251 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:06:08.460280 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:06:08.461829 (+ 1549us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:06:08.462321 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:06:08.462327 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:06:08.462333 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:06:08.462414 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:06:08.462715 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:06:08.462719 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:06:08.462721 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:06:08.462960 (+ 239us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:06:08.463106 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0811 15:06:08.463484 (+ 378us) server_negotiation.cc:299] Negotiation successful
0811 15:06:08.463655 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":26,"server-negotiator.queue_time_us":535,"thread_start_us":124,"threads_started":1}
I20260811 15:06:08.465181 4286 tablet_service.cc:1514] Processing DeleteTablet for tablet d85e337b55234ea29550ae0d787d858a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:06:07 UTC) from {username='kudu', principal='kudu/127.19.236.126@KRBTEST.COM'} at 127.0.0.1:54638
I20260811 15:06:08.466163 4370 tablet_replica.cc:330] stopping tablet replica
I20260811 15:06:08.466529 4370 raft_consensus.cc:2229] T d85e337b55234ea29550ae0d787d858a P c021852aca1a445ebd50c797ae4afa5a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 15:06:08.466827 4370 raft_consensus.cc:2258] T d85e337b55234ea29550ae0d787d858a P c021852aca1a445ebd50c797ae4afa5a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:06:08.468087 4370 ts_tablet_manager.cc:1905] T d85e337b55234ea29550ae0d787d858a P c021852aca1a445ebd50c797ae4afa5a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 15:06:08.473013 4370 ts_tablet_manager.cc:1918] T d85e337b55234ea29550ae0d787d858a P c021852aca1a445ebd50c797ae4afa5a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 15:06:08.473148 4370 log.cc:1196] T d85e337b55234ea29550ae0d787d858a P c021852aca1a445ebd50c797ae4afa5a: Deleting WAL directory at /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-0/wal/wals/d85e337b55234ea29550ae0d787d858a
I20260811 15:06:08.473474 4370 ts_tablet_manager.cc:1939] T d85e337b55234ea29550ae0d787d858a P c021852aca1a445ebd50c797ae4afa5a: Deleting consensus metadata
I20260811 15:06:08.475621 4132 catalog_manager.cc:4841] TS c021852aca1a445ebd50c797ae4afa5a (127.19.236.65:36747): tablet d85e337b55234ea29550ae0d787d858a (table test-table [id=0da920fad71047dcbd96a071eb68f3f6]) successfully deleted
W20260811 15:06:08.553370 4365 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:06:08.553644 4365 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:06:08.553689 4365 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:06:08.557780 4365 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:06:08.557843 4365 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:06:08.557941 4365 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.66
I20260811 15:06:08.563308 4365 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:42739
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.66.keytab
--principal=kudu/127.19.236.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.66:35841
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.236.66
--webserver_port=34939
--tserver_master_addrs=127.19.236.126:43737
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4365
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.66
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:06:08.564476 4365 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:06:08.565631 4365 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:06:08.575543 4377 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:06:08.575572 4379 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:06:08.575588 4376 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:06:08.575877 4365 server_base.cc:1034] running on GCE node
I20260811 15:06:08.576257 4365 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:06:08.576920 4365 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:06:08.578107 4365 hybrid_clock.cc:648] HybridClock initialized: now 1786460768578078 us; error 41 us; skew 500 ppm
Aug 11 15:06:08 dist-test-slave-8n49 krb5kdc[3481](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460768, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:06:08.581022 4365 init.cc:377] Logged in from keytab as kudu/127.19.236.66@KRBTEST.COM (short username kudu)
I20260811 15:06:08.581874 4365 webserver.cc:460] Webserver started at http://127.19.236.66:34939/ using document root <none> and password file <none>
I20260811 15:06:08.582410 4365 fs_manager.cc:359] Metadata directory not provided
I20260811 15:06:08.582484 4365 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:06:08.586381 4365 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 15:06:08.588483 4388 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:06:08.589797 4365 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 15:06:08.589920 4365 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-1/wal
uuid: "17295ce6738a4eb594f9aeb25ec12052"
format_stamp: "Formatted at 2026-08-11 15:06:07 on dist-test-slave-8n49"
server_key: "2d4f17d84e50fd78833b87eed9e306da"
server_key_iv: "76264519e19fc126422f552aaf16144b"
server_key_version: "encryptionkey@0"
I20260811 15:06:08.590533 4365 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:06:08.603693 4365 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:06:08.607014 4365 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:06:08.607221 4365 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:06:08.607853 4365 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:06:08.608777 4365 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:06:08.608827 4365 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:06:08.608898 4365 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:06:08.608932 4365 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:06:08.618460 4365 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.66:35841
I20260811 15:06:08.618480 4520 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.66:35841 every 8 connection(s)
I20260811 15:06:08.619571 4365 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
I20260811 15:06:08.626748 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 4365
I20260811 15:06:08.627231 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.67:33219
--local_ip_for_outbound_sockets=127.19.236.67
--tserver_master_addrs=127.19.236.126:43737
--webserver_port=34027
--webserver_interface=127.19.236.67
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.67.keytab
--principal=kudu/127.19.236.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:42739
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 15:06:08 dist-test-slave-8n49 krb5kdc[3481](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460768, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.66@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
I20260811 15:06:08.635288 4361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:08.621633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.66:37549 (local address 127.19.236.126:43737)
0811 15:06:08.621784 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0811 15:06:08.621788 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:06:08.622707 (+ 919us) server_negotiation.cc:407] Connection header received
0811 15:06:08.624085 (+ 1378us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:06:08.624088 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:06:08.624145 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:06:08.624232 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:06:08.625465 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:08.626002 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:08.627558 (+ 1556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:08.627805 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:08.627898 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:08.630944 (+ 3046us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:06:08.630951 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:06:08.630957 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:06:08.630993 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:06:08.632809 (+ 1816us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:06:08.633374 (+ 565us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:06:08.633379 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:06:08.633384 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:06:08.633490 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:06:08.633867 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:06:08.633872 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:06:08.633876 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:06:08.634172 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:06:08.634291 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0811 15:06:08.634850 (+ 559us) server_negotiation.cc:299] Negotiation successful
0811 15:06:08.635038 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 15:06:08.635985 4523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:08.622065 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:43737 (local address 127.19.236.66:37549)
0811 15:06:08.622543 (+ 478us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:08.622585 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 15:06:08.623858 (+ 1273us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:06:08.624393 (+ 535us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:06:08.624399 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:06:08.624838 (+ 439us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:06:08.625326 (+ 488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:06:08.625340 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:06:08.626123 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:06:08.626125 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:06:08.627438 (+ 1313us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:06:08.627452 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:06:08.627975 (+ 523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:06:08.627982 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:06:08.628227 (+ 245us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:08.628906 (+ 679us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:06:08.628935 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:06:08.630744 (+ 1809us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:06:08.632952 (+ 2208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:06:08.632958 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:06:08.632977 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:06:08.633265 (+ 288us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:06:08.633611 (+ 346us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:06:08.633614 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:06:08.633616 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:06:08.633761 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:06:08.634309 (+ 548us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:06:08.634315 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:06:08.634588 (+ 273us) client_negotiation.cc:769] Sending connection context
0811 15:06:08.634766 (+ 178us) client_negotiation.cc:240] Negotiation successful
0811 15:06:08.635047 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":287,"thread_start_us":118,"threads_started":1}
I20260811 15:06:08.637305 4521 heartbeater.cc:347] Connected to a master server at 127.19.236.126:43737
I20260811 15:06:08.637553 4521 heartbeater.cc:464] Registering TS with master...
I20260811 15:06:08.638072 4521 heartbeater.cc:511] Master 127.19.236.126:43737 requested a full tablet report, sending...
I20260811 15:06:08.639184 4150 ts_manager.cc:194] Registered new tserver with Master: 17295ce6738a4eb594f9aeb25ec12052 (127.19.236.66:35841)
I20260811 15:06:08.639772 4150 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.236.66@KRBTEST.COM'} at 127.19.236.66:37549
W20260811 15:06:08.743284 4525 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:06:08.743606 4525 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:06:08.743685 4525 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:06:08.747684 4525 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:06:08.747789 4525 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:06:08.747884 4525 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.67
I20260811 15:06:08.753513 4525 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:42739
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.67.keytab
--principal=kudu/127.19.236.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.67:33219
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.236.67
--webserver_port=34027
--tserver_master_addrs=127.19.236.126:43737
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4525
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.67
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:06:08.754694 4525 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:06:08.755779 4525 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:06:08.765965 4533 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:06:08.765969 4535 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:06:08.766224 4532 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:06:08.766492 4525 server_base.cc:1034] running on GCE node
I20260811 15:06:08.766898 4525 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:06:08.767571 4525 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:06:08.768754 4525 hybrid_clock.cc:648] HybridClock initialized: now 1786460768768735 us; error 28 us; skew 500 ppm
Aug 11 15:06:08 dist-test-slave-8n49 krb5kdc[3481](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460768, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:06:08.771520 4525 init.cc:377] Logged in from keytab as kudu/127.19.236.67@KRBTEST.COM (short username kudu)
I20260811 15:06:08.772488 4525 webserver.cc:460] Webserver started at http://127.19.236.67:34027/ using document root <none> and password file <none>
I20260811 15:06:08.773101 4525 fs_manager.cc:359] Metadata directory not provided
I20260811 15:06:08.773200 4525 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:06:08.777366 4525 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 15:06:08.779664 4545 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:06:08.781194 4525 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 15:06:08.781322 4525 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-2/wal
uuid: "eec8d0c3c86e47c98651ecba3e80f6df"
format_stamp: "Formatted at 2026-08-11 15:06:07 on dist-test-slave-8n49"
server_key: "dd5ceaca2c406852746fc04b543707f2"
server_key_iv: "4c8472338ba447e00e43795e8455dc09"
server_key_version: "encryptionkey@0"
I20260811 15:06:08.781983 4525 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:06:08.793212 4525 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:06:08.796372 4525 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:06:08.796617 4525 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:06:08.797240 4525 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:06:08.798089 4525 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:06:08.798138 4525 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:06:08.798200 4525 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:06:08.798233 4525 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:06:08.807690 4525 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.67:33219
I20260811 15:06:08.807714 4671 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.67:33219 every 8 connection(s)
I20260811 15:06:08.808796 4525 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
I20260811 15:06:08.815567 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 4525
Aug 11 15:06:08 dist-test-slave-8n49 krb5kdc[3481](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460768, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.67@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
I20260811 15:06:08.823824 4361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:08.810750 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.67:38493 (local address 127.19.236.126:43737)
0811 15:06:08.810941 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0811 15:06:08.810946 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:06:08.811857 (+ 911us) server_negotiation.cc:407] Connection header received
0811 15:06:08.813315 (+ 1458us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:06:08.813319 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:06:08.813372 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:06:08.813451 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:06:08.814650 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:08.815174 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:08.816614 (+ 1440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:08.816949 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:08.817050 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:08.819783 (+ 2733us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:06:08.819787 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:06:08.819789 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:06:08.819843 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:06:08.821507 (+ 1664us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:06:08.822096 (+ 589us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:06:08.822099 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:06:08.822100 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:06:08.822177 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:06:08.822641 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:06:08.822644 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:06:08.822645 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:06:08.822818 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:06:08.822901 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 15:06:08.823516 (+ 615us) server_negotiation.cc:299] Negotiation successful
0811 15:06:08.823616 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260811 15:06:08.824707 4677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:08.816270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36534 (local address 127.19.236.126:43737)
0811 15:06:08.816545 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0811 15:06:08.816585 (+ 40us) server_negotiation.cc:399] Waiting for connection header
0811 15:06:08.816711 (+ 126us) server_negotiation.cc:407] Connection header received
0811 15:06:08.816810 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:06:08.816813 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:06:08.816861 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:06:08.816957 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:06:08.817928 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:08.818434 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:08.819403 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:08.819751 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:08.819851 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:08.821493 (+ 1642us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:06:08.821497 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:06:08.821499 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:06:08.821520 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:06:08.823074 (+ 1554us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:06:08.823491 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:06:08.823494 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:06:08.823496 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:06:08.823583 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:06:08.823876 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:06:08.823879 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:06:08.823881 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:06:08.824087 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:06:08.824291 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0811 15:06:08.824430 (+ 139us) server_negotiation.cc:299] Negotiation successful
0811 15:06:08.824543 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":199,"thread_start_us":96,"threads_started":1}
I20260811 15:06:08.824944 4675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:08.811179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:43737 (local address 127.19.236.67:38493)
0811 15:06:08.811702 (+ 523us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:08.811744 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 15:06:08.813108 (+ 1364us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:06:08.813637 (+ 529us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:06:08.813643 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:06:08.814006 (+ 363us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:06:08.814486 (+ 480us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:06:08.814510 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:06:08.815323 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:06:08.815326 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:06:08.816404 (+ 1078us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:06:08.816420 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:06:08.817121 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:06:08.817127 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:06:08.817362 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:08.818031 (+ 669us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:06:08.818048 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:06:08.819598 (+ 1550us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:06:08.821609 (+ 2011us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:06:08.821615 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:06:08.821632 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:06:08.821995 (+ 363us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:06:08.822295 (+ 300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:06:08.822299 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:06:08.822302 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:06:08.822527 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:06:08.822930 (+ 403us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:06:08.822939 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:06:08.823269 (+ 330us) client_negotiation.cc:769] Sending connection context
0811 15:06:08.823452 (+ 183us) client_negotiation.cc:240] Negotiation successful
0811 15:06:08.823802 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":316,"thread_start_us":117,"threads_started":1}
I20260811 15:06:08.826058 4672 heartbeater.cc:347] Connected to a master server at 127.19.236.126:43737
I20260811 15:06:08.826314 4672 heartbeater.cc:464] Registering TS with master...
I20260811 15:06:08.826856 4672 heartbeater.cc:511] Master 127.19.236.126:43737 requested a full tablet report, sending...
I20260811 15:06:08.827801 4150 ts_manager.cc:194] Registered new tserver with Master: eec8d0c3c86e47c98651ecba3e80f6df (127.19.236.67:33219)
I20260811 15:06:08.828351 4150 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.236.67@KRBTEST.COM'} at 127.19.236.67:38493
I20260811 15:06:08.838670 20401 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 15:06:08.843263 4677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:08.839381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36544 (local address 127.19.236.126:43737)
0811 15:06:08.839541 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0811 15:06:08.839545 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:06:08.839737 (+ 192us) server_negotiation.cc:407] Connection header received
0811 15:06:08.839885 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:06:08.839887 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:06:08.840006 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:06:08.840103 (+ 97us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 15:06:08.840322 (+ 219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:08.840879 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:08.841767 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:08.842005 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:08.842111 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:08.842427 (+ 316us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 15:06:08.842908 (+ 481us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 15:06:08.843004 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0811 15:06:08.843085 (+ 81us) server_negotiation.cc:299] Negotiation successful
0811 15:06:08.843151 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 15:06:08.843987 4150 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:36544:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 15:06:08.847406 4150 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 15:06:08.855679 4286 tablet_service.cc:1467] Processing CreateTablet for tablet ff6e8850da8f4532ab09b1195e14e518 (DEFAULT_TABLE table=test-table [id=24142f94dcbf4eccbe5f3938421cc1cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:06:08.856410 4286 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff6e8850da8f4532ab09b1195e14e518. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:06:08.859365 4240 tablet_bootstrap.cc:492] T ff6e8850da8f4532ab09b1195e14e518 P c021852aca1a445ebd50c797ae4afa5a: Bootstrap starting.
I20260811 15:06:08.860046 4368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:08.854506 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.67:33219 (local address 127.0.0.1:33936)
0811 15:06:08.854642 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:08.854658 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 15:06:08.854741 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:06:08.855700 (+ 959us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:06:08.855707 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:06:08.855731 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:06:08.855841 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:06:08.855849 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:06:08.857345 (+ 1496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:06:08.857349 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:06:08.858533 (+ 1184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:06:08.858544 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:06:08.859594 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:06:08.859598 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:06:08.859699 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:08.859754 (+ 55us) client_negotiation.cc:769] Sending connection context
0811 15:06:08.859811 (+ 57us) client_negotiation.cc:240] Negotiation successful
0811 15:06:08.859903 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53}
I20260811 15:06:08.860355 4240 tablet_bootstrap.cc:654] T ff6e8850da8f4532ab09b1195e14e518 P c021852aca1a445ebd50c797ae4afa5a: Neither blocks nor log segments found. Creating new log.
I20260811 15:06:08.860781 4686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:08.854868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.66:35841 (local address 127.0.0.1:35358)
0811 15:06:08.855284 (+ 416us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:08.855297 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 15:06:08.855377 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:06:08.856122 (+ 745us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:06:08.856125 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:06:08.856143 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:06:08.856242 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:06:08.856248 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:06:08.858324 (+ 2076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:06:08.858330 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:06:08.859469 (+ 1139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:06:08.859480 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:06:08.860352 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:06:08.860355 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:06:08.860444 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:08.860467 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 15:06:08.860534 (+ 67us) client_negotiation.cc:240] Negotiation successful
0811 15:06:08.860647 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":355,"thread_start_us":81,"threads_started":1}
I20260811 15:06:08.860817 4687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:08.855303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35358 (local address 127.19.236.66:35841)
0811 15:06:08.855696 (+ 393us) server_negotiation.cc:206] Beginning negotiation
0811 15:06:08.855708 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 15:06:08.855729 (+ 21us) server_negotiation.cc:407] Connection header received
0811 15:06:08.855804 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:06:08.855809 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:06:08.855993 (+ 184us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:06:08.856140 (+ 147us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:06:08.856471 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:08.858158 (+ 1687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:08.859612 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:08.860246 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:08.860353 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:08.860504 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0811 15:06:08.860585 (+ 81us) server_negotiation.cc:299] Negotiation successful
0811 15:06:08.860670 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":289,"thread_start_us":167,"threads_started":1}
I20260811 15:06:08.860831 4684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:08.854671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33936 (local address 127.19.236.67:33219)
0811 15:06:08.855097 (+ 426us) server_negotiation.cc:206] Beginning negotiation
0811 15:06:08.855110 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 15:06:08.855136 (+ 26us) server_negotiation.cc:407] Connection header received
0811 15:06:08.855221 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:06:08.855228 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:06:08.855529 (+ 301us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:06:08.855707 (+ 178us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:06:08.856001 (+ 294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:08.857158 (+ 1157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:08.858662 (+ 1504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:08.859449 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:08.860244 (+ 795us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:08.860434 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0811 15:06:08.860499 (+ 65us) server_negotiation.cc:299] Negotiation successful
0811 15:06:08.860642 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":309,"thread_start_us":188,"threads_started":1}
I20260811 15:06:08.862313 4240 tablet_bootstrap.cc:492] T ff6e8850da8f4532ab09b1195e14e518 P c021852aca1a445ebd50c797ae4afa5a: No bootstrap required, opened a new log
I20260811 15:06:08.862421 4240 ts_tablet_manager.cc:1397] T ff6e8850da8f4532ab09b1195e14e518 P c021852aca1a445ebd50c797ae4afa5a: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 15:06:08.862839 4240 raft_consensus.cc:348] T ff6e8850da8f4532ab09b1195e14e518 P c021852aca1a445ebd50c797ae4afa5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec8d0c3c86e47c98651ecba3e80f6df" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 33219 } } peers { permanent_uuid: "17295ce6738a4eb594f9aeb25ec12052" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35841 } } peers { permanent_uuid: "c021852aca1a445ebd50c797ae4afa5a" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 36747 } }
I20260811 15:06:08.862963 4240 raft_consensus.cc:374] T ff6e8850da8f4532ab09b1195e14e518 P c021852aca1a445ebd50c797ae4afa5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:06:08.863020 4240 raft_consensus.cc:729] T ff6e8850da8f4532ab09b1195e14e518 P c021852aca1a445ebd50c797ae4afa5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c021852aca1a445ebd50c797ae4afa5a, State: Initialized, Role: FOLLOWER
I20260811 15:06:08.863588 4240 consensus_queue.cc:260] T ff6e8850da8f4532ab09b1195e14e518 P c021852aca1a445ebd50c797ae4afa5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec8d0c3c86e47c98651ecba3e80f6df" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 33219 } } peers { permanent_uuid: "17295ce6738a4eb594f9aeb25ec12052" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35841 } } peers { permanent_uuid: "c021852aca1a445ebd50c797ae4afa5a" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 36747 } }
I20260811 15:06:08.863914 4240 ts_tablet_manager.cc:1428] T ff6e8850da8f4532ab09b1195e14e518 P c021852aca1a445ebd50c797ae4afa5a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 15:06:08.863965 4444 tablet_service.cc:1467] Processing CreateTablet for tablet ff6e8850da8f4532ab09b1195e14e518 (DEFAULT_TABLE table=test-table [id=24142f94dcbf4eccbe5f3938421cc1cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:06:08.863965 4603 tablet_service.cc:1467] Processing CreateTablet for tablet ff6e8850da8f4532ab09b1195e14e518 (DEFAULT_TABLE table=test-table [id=24142f94dcbf4eccbe5f3938421cc1cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:06:08.865176 4603 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff6e8850da8f4532ab09b1195e14e518. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:06:08.865175 4444 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff6e8850da8f4532ab09b1195e14e518. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:06:08.874020 4690 tablet_bootstrap.cc:492] T ff6e8850da8f4532ab09b1195e14e518 P eec8d0c3c86e47c98651ecba3e80f6df: Bootstrap starting.
I20260811 15:06:08.874020 4689 tablet_bootstrap.cc:492] T ff6e8850da8f4532ab09b1195e14e518 P 17295ce6738a4eb594f9aeb25ec12052: Bootstrap starting.
I20260811 15:06:08.876660 4690 tablet_bootstrap.cc:654] T ff6e8850da8f4532ab09b1195e14e518 P eec8d0c3c86e47c98651ecba3e80f6df: Neither blocks nor log segments found. Creating new log.
I20260811 15:06:08.877197 4689 tablet_bootstrap.cc:654] T ff6e8850da8f4532ab09b1195e14e518 P 17295ce6738a4eb594f9aeb25ec12052: Neither blocks nor log segments found. Creating new log.
I20260811 15:06:08.878124 4690 log.cc:824] T ff6e8850da8f4532ab09b1195e14e518 P eec8d0c3c86e47c98651ecba3e80f6df: Log is configured to *not* fsync() on all Append() calls
I20260811 15:06:08.878124 4689 log.cc:824] T ff6e8850da8f4532ab09b1195e14e518 P 17295ce6738a4eb594f9aeb25ec12052: Log is configured to *not* fsync() on all Append() calls
I20260811 15:06:08.880232 4690 tablet_bootstrap.cc:492] T ff6e8850da8f4532ab09b1195e14e518 P eec8d0c3c86e47c98651ecba3e80f6df: No bootstrap required, opened a new log
I20260811 15:06:08.880447 4690 ts_tablet_manager.cc:1397] T ff6e8850da8f4532ab09b1195e14e518 P eec8d0c3c86e47c98651ecba3e80f6df: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.005s
I20260811 15:06:08.880945 4689 tablet_bootstrap.cc:492] T ff6e8850da8f4532ab09b1195e14e518 P 17295ce6738a4eb594f9aeb25ec12052: No bootstrap required, opened a new log
I20260811 15:06:08.881145 4689 ts_tablet_manager.cc:1397] T ff6e8850da8f4532ab09b1195e14e518 P 17295ce6738a4eb594f9aeb25ec12052: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.004s
I20260811 15:06:08.883950 4689 raft_consensus.cc:348] T ff6e8850da8f4532ab09b1195e14e518 P 17295ce6738a4eb594f9aeb25ec12052 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec8d0c3c86e47c98651ecba3e80f6df" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 33219 } } peers { permanent_uuid: "17295ce6738a4eb594f9aeb25ec12052" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35841 } } peers { permanent_uuid: "c021852aca1a445ebd50c797ae4afa5a" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 36747 } }
I20260811 15:06:08.883949 4690 raft_consensus.cc:348] T ff6e8850da8f4532ab09b1195e14e518 P eec8d0c3c86e47c98651ecba3e80f6df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec8d0c3c86e47c98651ecba3e80f6df" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 33219 } } peers { permanent_uuid: "17295ce6738a4eb594f9aeb25ec12052" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35841 } } peers { permanent_uuid: "c021852aca1a445ebd50c797ae4afa5a" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 36747 } }
I20260811 15:06:08.884199 4689 raft_consensus.cc:374] T ff6e8850da8f4532ab09b1195e14e518 P 17295ce6738a4eb594f9aeb25ec12052 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:06:08.884193 4690 raft_consensus.cc:374] T ff6e8850da8f4532ab09b1195e14e518 P eec8d0c3c86e47c98651ecba3e80f6df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:06:08.884274 4689 raft_consensus.cc:729] T ff6e8850da8f4532ab09b1195e14e518 P 17295ce6738a4eb594f9aeb25ec12052 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17295ce6738a4eb594f9aeb25ec12052, State: Initialized, Role: FOLLOWER
I20260811 15:06:08.884290 4690 raft_consensus.cc:729] T ff6e8850da8f4532ab09b1195e14e518 P eec8d0c3c86e47c98651ecba3e80f6df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eec8d0c3c86e47c98651ecba3e80f6df, State: Initialized, Role: FOLLOWER
I20260811 15:06:08.884755 4689 consensus_queue.cc:260] T ff6e8850da8f4532ab09b1195e14e518 P 17295ce6738a4eb594f9aeb25ec12052 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec8d0c3c86e47c98651ecba3e80f6df" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 33219 } } peers { permanent_uuid: "17295ce6738a4eb594f9aeb25ec12052" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35841 } } peers { permanent_uuid: "c021852aca1a445ebd50c797ae4afa5a" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 36747 } }
I20260811 15:06:08.884881 4690 consensus_queue.cc:260] T ff6e8850da8f4532ab09b1195e14e518 P eec8d0c3c86e47c98651ecba3e80f6df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec8d0c3c86e47c98651ecba3e80f6df" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 33219 } } peers { permanent_uuid: "17295ce6738a4eb594f9aeb25ec12052" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35841 } } peers { permanent_uuid: "c021852aca1a445ebd50c797ae4afa5a" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 36747 } }
I20260811 15:06:08.885509 4521 heartbeater.cc:503] Master 127.19.236.126:43737 was elected leader, sending a full tablet report...
I20260811 15:06:08.885560 4672 heartbeater.cc:503] Master 127.19.236.126:43737 was elected leader, sending a full tablet report...
I20260811 15:06:08.885859 4689 ts_tablet_manager.cc:1428] T ff6e8850da8f4532ab09b1195e14e518 P 17295ce6738a4eb594f9aeb25ec12052: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260811 15:06:08.885927 4690 ts_tablet_manager.cc:1428] T ff6e8850da8f4532ab09b1195e14e518 P eec8d0c3c86e47c98651ecba3e80f6df: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
W20260811 15:06:08.924779 4360 tablet.cc:2369] T ff6e8850da8f4532ab09b1195e14e518 P c021852aca1a445ebd50c797ae4afa5a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 15:06:09.007846 4695 raft_consensus.cc:482] T ff6e8850da8f4532ab09b1195e14e518 P eec8d0c3c86e47c98651ecba3e80f6df [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 15:06:09.008096 4695 raft_consensus.cc:504] T ff6e8850da8f4532ab09b1195e14e518 P eec8d0c3c86e47c98651ecba3e80f6df [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec8d0c3c86e47c98651ecba3e80f6df" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 33219 } } peers { permanent_uuid: "17295ce6738a4eb594f9aeb25ec12052" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35841 } } peers { permanent_uuid: "c021852aca1a445ebd50c797ae4afa5a" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 36747 } }
I20260811 15:06:09.009443 4695 leader_election.cc:288] T ff6e8850da8f4532ab09b1195e14e518 P eec8d0c3c86e47c98651ecba3e80f6df [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17295ce6738a4eb594f9aeb25ec12052 (127.19.236.66:35841), c021852aca1a445ebd50c797ae4afa5a (127.19.236.65:36747)
I20260811 15:06:09.014911 4697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:09.010163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.67:49253 (local address 127.19.236.65:36747)
0811 15:06:09.010459 (+ 296us) server_negotiation.cc:206] Beginning negotiation
0811 15:06:09.010463 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:06:09.010475 (+ 12us) server_negotiation.cc:407] Connection header received
0811 15:06:09.010543 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:06:09.010545 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:06:09.010612 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:06:09.010731 (+ 119us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:06:09.010980 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:09.011795 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:09.013700 (+ 1905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:09.014386 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:09.014499 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:09.014659 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0811 15:06:09.014695 (+ 36us) server_negotiation.cc:299] Negotiation successful
0811 15:06:09.014773 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":216,"thread_start_us":99,"threads_started":1}
I20260811 15:06:09.014911 4687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:09.010098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.67:49165 (local address 127.19.236.66:35841)
0811 15:06:09.010229 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0811 15:06:09.010237 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 15:06:09.010375 (+ 138us) server_negotiation.cc:407] Connection header received
0811 15:06:09.010595 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:06:09.010598 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:06:09.010647 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:06:09.010730 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:06:09.011134 (+ 404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:09.011859 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:09.013700 (+ 1841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:09.014293 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:09.014430 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:09.014504 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 15:06:09.014693 (+ 189us) server_negotiation.cc:299] Negotiation successful
0811 15:06:09.014769 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 15:06:09.014930 4675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:09.009737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.65:36747 (local address 127.19.236.67:49253)
0811 15:06:09.009852 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:09.009868 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 15:06:09.009970 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:06:09.010745 (+ 775us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:06:09.010747 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:06:09.010762 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:06:09.010867 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:06:09.010872 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:06:09.011970 (+ 1098us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:06:09.011975 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:06:09.013553 (+ 1578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:06:09.013566 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:06:09.014487 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:06:09.014490 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:06:09.014577 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:09.014604 (+ 27us) client_negotiation.cc:769] Sending connection context
0811 15:06:09.014663 (+ 59us) client_negotiation.cc:240] Negotiation successful
0811 15:06:09.014780 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34,"mutex_wait_us":103}
I20260811 15:06:09.014938 4696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:09.009737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.66:35841 (local address 127.19.236.67:49165)
0811 15:06:09.010278 (+ 541us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:09.010293 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 15:06:09.010471 (+ 178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:06:09.010959 (+ 488us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:06:09.010961 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:06:09.010970 (+ 9us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:06:09.011039 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:06:09.011042 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:06:09.011979 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:06:09.011982 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:06:09.013553 (+ 1571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:06:09.013566 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:06:09.014420 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:06:09.014423 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:06:09.014544 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:09.014577 (+ 33us) client_negotiation.cc:769] Sending connection context
0811 15:06:09.014663 (+ 86us) client_negotiation.cc:240] Negotiation successful
0811 15:06:09.014773 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":456,"mutex_wait_us":171,"thread_start_us":157,"threads_started":1}
I20260811 15:06:09.015761 4466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff6e8850da8f4532ab09b1195e14e518" candidate_uuid: "eec8d0c3c86e47c98651ecba3e80f6df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17295ce6738a4eb594f9aeb25ec12052" is_pre_election: true
I20260811 15:06:09.016077 4309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff6e8850da8f4532ab09b1195e14e518" candidate_uuid: "eec8d0c3c86e47c98651ecba3e80f6df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c021852aca1a445ebd50c797ae4afa5a" is_pre_election: true
I20260811 15:06:09.016141 4466 raft_consensus.cc:2454] T ff6e8850da8f4532ab09b1195e14e518 P 17295ce6738a4eb594f9aeb25ec12052 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eec8d0c3c86e47c98651ecba3e80f6df in term 0.
I20260811 15:06:09.016352 4309 raft_consensus.cc:2454] T ff6e8850da8f4532ab09b1195e14e518 P c021852aca1a445ebd50c797ae4afa5a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eec8d0c3c86e47c98651ecba3e80f6df in term 0.
I20260811 15:06:09.016673 4547 leader_election.cc:302] T ff6e8850da8f4532ab09b1195e14e518 P eec8d0c3c86e47c98651ecba3e80f6df [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17295ce6738a4eb594f9aeb25ec12052, eec8d0c3c86e47c98651ecba3e80f6df; no voters:
I20260811 15:06:09.016984 4695 raft_consensus.cc:2781] T ff6e8850da8f4532ab09b1195e14e518 P eec8d0c3c86e47c98651ecba3e80f6df [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 15:06:09.017067 4695 raft_consensus.cc:482] T ff6e8850da8f4532ab09b1195e14e518 P eec8d0c3c86e47c98651ecba3e80f6df [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 15:06:09.017099 4695 raft_consensus.cc:3037] T ff6e8850da8f4532ab09b1195e14e518 P eec8d0c3c86e47c98651ecba3e80f6df [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:06:09.018195 4695 raft_consensus.cc:504] T ff6e8850da8f4532ab09b1195e14e518 P eec8d0c3c86e47c98651ecba3e80f6df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec8d0c3c86e47c98651ecba3e80f6df" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 33219 } } peers { permanent_uuid: "17295ce6738a4eb594f9aeb25ec12052" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35841 } } peers { permanent_uuid: "c021852aca1a445ebd50c797ae4afa5a" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 36747 } }
I20260811 15:06:09.018585 4695 leader_election.cc:288] T ff6e8850da8f4532ab09b1195e14e518 P eec8d0c3c86e47c98651ecba3e80f6df [CANDIDATE]: Term 1 election: Requested vote from peers 17295ce6738a4eb594f9aeb25ec12052 (127.19.236.66:35841), c021852aca1a445ebd50c797ae4afa5a (127.19.236.65:36747)
I20260811 15:06:09.018939 4309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff6e8850da8f4532ab09b1195e14e518" candidate_uuid: "eec8d0c3c86e47c98651ecba3e80f6df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c021852aca1a445ebd50c797ae4afa5a"
I20260811 15:06:09.018956 4466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff6e8850da8f4532ab09b1195e14e518" candidate_uuid: "eec8d0c3c86e47c98651ecba3e80f6df" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17295ce6738a4eb594f9aeb25ec12052"
I20260811 15:06:09.019078 4309 raft_consensus.cc:3037] T ff6e8850da8f4532ab09b1195e14e518 P c021852aca1a445ebd50c797ae4afa5a [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:06:09.019093 4466 raft_consensus.cc:3037] T ff6e8850da8f4532ab09b1195e14e518 P 17295ce6738a4eb594f9aeb25ec12052 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:06:09.020078 4309 raft_consensus.cc:2454] T ff6e8850da8f4532ab09b1195e14e518 P c021852aca1a445ebd50c797ae4afa5a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eec8d0c3c86e47c98651ecba3e80f6df in term 1.
I20260811 15:06:09.020151 4466 raft_consensus.cc:2454] T ff6e8850da8f4532ab09b1195e14e518 P 17295ce6738a4eb594f9aeb25ec12052 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eec8d0c3c86e47c98651ecba3e80f6df in term 1.
I20260811 15:06:09.020416 4546 leader_election.cc:302] T ff6e8850da8f4532ab09b1195e14e518 P eec8d0c3c86e47c98651ecba3e80f6df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c021852aca1a445ebd50c797ae4afa5a, eec8d0c3c86e47c98651ecba3e80f6df; no voters:
I20260811 15:06:09.020650 4695 raft_consensus.cc:2781] T ff6e8850da8f4532ab09b1195e14e518 P eec8d0c3c86e47c98651ecba3e80f6df [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:06:09.020890 4695 raft_consensus.cc:686] T ff6e8850da8f4532ab09b1195e14e518 P eec8d0c3c86e47c98651ecba3e80f6df [term 1 LEADER]: Becoming Leader. State: Replica: eec8d0c3c86e47c98651ecba3e80f6df, State: Running, Role: LEADER
I20260811 15:06:09.021250 4695 consensus_queue.cc:237] T ff6e8850da8f4532ab09b1195e14e518 P eec8d0c3c86e47c98651ecba3e80f6df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec8d0c3c86e47c98651ecba3e80f6df" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 33219 } } peers { permanent_uuid: "17295ce6738a4eb594f9aeb25ec12052" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35841 } } peers { permanent_uuid: "c021852aca1a445ebd50c797ae4afa5a" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 36747 } }
I20260811 15:06:09.024449 4150 catalog_manager.cc:5495] T ff6e8850da8f4532ab09b1195e14e518 P eec8d0c3c86e47c98651ecba3e80f6df reported cstate change: term changed from 0 to 1, leader changed from <none> to eec8d0c3c86e47c98651ecba3e80f6df (127.19.236.67). New cstate: current_term: 1 leader_uuid: "eec8d0c3c86e47c98651ecba3e80f6df" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec8d0c3c86e47c98651ecba3e80f6df" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 33219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17295ce6738a4eb594f9aeb25ec12052" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c021852aca1a445ebd50c797ae4afa5a" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 36747 } health_report { overall_health: UNKNOWN } } }
I20260811 15:06:09.056504 4684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:09.052897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33942 (local address 127.19.236.67:33219)
0811 15:06:09.053058 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0811 15:06:09.053063 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:06:09.053084 (+ 21us) server_negotiation.cc:407] Connection header received
0811 15:06:09.053165 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:06:09.053167 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:06:09.053223 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:06:09.053321 (+ 98us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 15:06:09.053536 (+ 215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:09.054036 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:09.054912 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:09.055144 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:09.055237 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:09.055542 (+ 305us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 15:06:09.055981 (+ 439us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 15:06:09.056081 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0811 15:06:09.056213 (+ 132us) server_negotiation.cc:299] Negotiation successful
0811 15:06:09.056269 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
W20260811 15:06:09.059752 4674 tablet.cc:2369] T ff6e8850da8f4532ab09b1195e14e518 P eec8d0c3c86e47c98651ecba3e80f6df: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 15:06:09.063002 4466 raft_consensus.cc:1261] T ff6e8850da8f4532ab09b1195e14e518 P 17295ce6738a4eb594f9aeb25ec12052 [term 1 FOLLOWER]: Refusing update from remote peer eec8d0c3c86e47c98651ecba3e80f6df: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:06:09.063000 4309 raft_consensus.cc:1261] T ff6e8850da8f4532ab09b1195e14e518 P c021852aca1a445ebd50c797ae4afa5a [term 1 FOLLOWER]: Refusing update from remote peer eec8d0c3c86e47c98651ecba3e80f6df: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:06:09.063757 4698 consensus_queue.cc:1035] T ff6e8850da8f4532ab09b1195e14e518 P eec8d0c3c86e47c98651ecba3e80f6df [LEADER]: Connected to new peer: Peer: permanent_uuid: "c021852aca1a445ebd50c797ae4afa5a" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 36747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:06:09.063933 4695 consensus_queue.cc:1035] T ff6e8850da8f4532ab09b1195e14e518 P eec8d0c3c86e47c98651ecba3e80f6df [LEADER]: Connected to new peer: Peer: permanent_uuid: "17295ce6738a4eb594f9aeb25ec12052" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:06:09.072055 4702 mvcc.cc:205] Tried to move back new op lower bound from 7317343310074339328 to 7317343309913935872. Current Snapshot: MvccSnapshot[applied={T|T < 7317343310074339328}]
I20260811 15:06:09.072264 4703 mvcc.cc:205] Tried to move back new op lower bound from 7317343310074339328 to 7317343309913935872. Current Snapshot: MvccSnapshot[applied={T|T < 7317343310074339328}]
I20260811 15:06:09.078756 4150 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:36544:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 15:06:09.078967 4150 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:36544:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 15:06:09.081583 4150 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b6742f0314744b19a6b25bc347fd6f10: Sending DeleteTablet for 3 replicas of tablet ff6e8850da8f4532ab09b1195e14e518
I20260811 15:06:09.082347 4603 tablet_service.cc:1514] Processing DeleteTablet for tablet ff6e8850da8f4532ab09b1195e14e518 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:06:09 UTC) from {username='kudu', principal='kudu/127.19.236.126@KRBTEST.COM'} at 127.0.0.1:33936
I20260811 15:06:09.082429 4444 tablet_service.cc:1514] Processing DeleteTablet for tablet ff6e8850da8f4532ab09b1195e14e518 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:06:09 UTC) from {username='kudu', principal='kudu/127.19.236.126@KRBTEST.COM'} at 127.0.0.1:35358
I20260811 15:06:09.082686 4286 tablet_service.cc:1514] Processing DeleteTablet for tablet ff6e8850da8f4532ab09b1195e14e518 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:06:09 UTC) from {username='kudu', principal='kudu/127.19.236.126@KRBTEST.COM'} at 127.0.0.1:54638
I20260811 15:06:09.083079 4712 tablet_replica.cc:330] T ff6e8850da8f4532ab09b1195e14e518 P c021852aca1a445ebd50c797ae4afa5a: stopping tablet replica
I20260811 15:06:09.083247 4712 raft_consensus.cc:2229] T ff6e8850da8f4532ab09b1195e14e518 P c021852aca1a445ebd50c797ae4afa5a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 15:06:09.083282 4710 tablet_replica.cc:330] T ff6e8850da8f4532ab09b1195e14e518 P 17295ce6738a4eb594f9aeb25ec12052: stopping tablet replica
I20260811 15:06:09.083323 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 4196
I20260811 15:06:09.095034 4710 raft_consensus.cc:2229] T ff6e8850da8f4532ab09b1195e14e518 P 17295ce6738a4eb594f9aeb25ec12052 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 15:06:09.095628 4710 raft_consensus.cc:2258] T ff6e8850da8f4532ab09b1195e14e518 P 17295ce6738a4eb594f9aeb25ec12052 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:06:09.096635 4711 tablet_replica.cc:330] T ff6e8850da8f4532ab09b1195e14e518 P eec8d0c3c86e47c98651ecba3e80f6df: stopping tablet replica
I20260811 15:06:09.097008 4711 raft_consensus.cc:2229] T ff6e8850da8f4532ab09b1195e14e518 P eec8d0c3c86e47c98651ecba3e80f6df [term 1 LEADER]: Raft consensus shutting down.
I20260811 15:06:09.097518 4711 raft_consensus.cc:2258] T ff6e8850da8f4532ab09b1195e14e518 P eec8d0c3c86e47c98651ecba3e80f6df [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:06:09.097767 4710 ts_tablet_manager.cc:1905] T ff6e8850da8f4532ab09b1195e14e518 P 17295ce6738a4eb594f9aeb25ec12052: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 15:06:09.099184 4711 ts_tablet_manager.cc:1905] T ff6e8850da8f4532ab09b1195e14e518 P eec8d0c3c86e47c98651ecba3e80f6df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 15:06:09.100979 4710 ts_tablet_manager.cc:1918] T ff6e8850da8f4532ab09b1195e14e518 P 17295ce6738a4eb594f9aeb25ec12052: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 15:06:09.101176 4710 log.cc:1196] T ff6e8850da8f4532ab09b1195e14e518 P 17295ce6738a4eb594f9aeb25ec12052: Deleting WAL directory at /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-1/wal/wals/ff6e8850da8f4532ab09b1195e14e518
I20260811 15:06:09.101619 4710 ts_tablet_manager.cc:1939] T ff6e8850da8f4532ab09b1195e14e518 P 17295ce6738a4eb594f9aeb25ec12052: Deleting consensus metadata
I20260811 15:06:09.103120 4133 catalog_manager.cc:4841] TS 17295ce6738a4eb594f9aeb25ec12052 (127.19.236.66:35841): tablet ff6e8850da8f4532ab09b1195e14e518 (table test-table [id=24142f94dcbf4eccbe5f3938421cc1cd]) successfully deleted
W20260811 15:06:09.103588 4132 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.19.236.65:36747 (error 108)
I20260811 15:06:09.103858 4711 ts_tablet_manager.cc:1918] T ff6e8850da8f4532ab09b1195e14e518 P eec8d0c3c86e47c98651ecba3e80f6df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 15:06:09.103973 4711 log.cc:1196] T ff6e8850da8f4532ab09b1195e14e518 P eec8d0c3c86e47c98651ecba3e80f6df: Deleting WAL directory at /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-2/wal/wals/ff6e8850da8f4532ab09b1195e14e518
I20260811 15:06:09.104359 4711 ts_tablet_manager.cc:1939] T ff6e8850da8f4532ab09b1195e14e518 P eec8d0c3c86e47c98651ecba3e80f6df: Deleting consensus metadata
W20260811 15:06:09.105039 4686 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:06:09.104708 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.65:36747 (local address 127.0.0.1:54652)
0811 15:06:09.104853 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:09.104938 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.65:36747: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":50}
I20260811 15:06:09.105615 4134 catalog_manager.cc:4841] TS eec8d0c3c86e47c98651ecba3e80f6df (127.19.236.67:33219): tablet ff6e8850da8f4532ab09b1195e14e518 (table test-table [id=24142f94dcbf4eccbe5f3938421cc1cd]) successfully deleted
W20260811 15:06:09.105185 4132 catalog_manager.cc:4584] TS c021852aca1a445ebd50c797ae4afa5a (127.19.236.65:36747): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ff6e8850da8f4532ab09b1195e14e518: Network error: Client connection negotiation failed: client connection to 127.19.236.65:36747: connect: Connection reset by peer (error 104)
I20260811 15:06:09.106003 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 4365
I20260811 15:06:09.116228 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 4525
I20260811 15:06:09.126360 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 4112
I20260811 15:06:09.136792 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:43737
--webserver_interface=127.19.236.126
--webserver_port=34105
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab
--principal=kudu/127.19.236.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:42739
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.236.126:43737
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:06:09.252823 4715 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:06:09.253178 4715 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:06:09.253242 4715 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:06:09.257640 4715 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:06:09.257720 4715 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:06:09.257742 4715 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:06:09.257759 4715 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:06:09.257815 4715 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:06:09.263763 4715 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:42739
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.236.126:43737
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab
--principal=kudu/127.19.236.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:43737
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.236.126
--webserver_port=34105
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4715
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:06:09.265054 4715 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:06:09.266171 4715 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:06:09.275928 4721 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:06:09.275914 4720 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:06:09.275914 4723 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:06:09.276170 4715 server_base.cc:1034] running on GCE node
I20260811 15:06:09.276810 4715 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:06:09.278164 4715 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:06:09.279381 4715 hybrid_clock.cc:648] HybridClock initialized: now 1786460769279339 us; error 53 us; skew 500 ppm
Aug 11 15:06:09 dist-test-slave-8n49 krb5kdc[3481](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460769, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:06:09.282855 4715 init.cc:377] Logged in from keytab as kudu/127.19.236.126@KRBTEST.COM (short username kudu)
I20260811 15:06:09.284442 4715 webserver.cc:460] Webserver started at http://127.19.236.126:34105/ using document root <none> and password file <none>
I20260811 15:06:09.285301 4715 fs_manager.cc:359] Metadata directory not provided
I20260811 15:06:09.285394 4715 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:06:09.290588 4715 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 15:06:09.293385 4730 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:06:09.294916 4715 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 15:06:09.295077 4715 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/master-0/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/master-0/wal
uuid: "b6742f0314744b19a6b25bc347fd6f10"
format_stamp: "Formatted at 2026-08-11 15:06:07 on dist-test-slave-8n49"
server_key: "55ea0c75adfa2ed63a4f110431b1603d"
server_key_iv: "b1ee7335eb9069ed7cd34e1c0f1acab9"
server_key_version: "encryptionkey@0"
I20260811 15:06:09.295693 4715 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:06:09.306057 4715 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:06:09.309350 4715 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:06:09.309568 4715 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:06:09.317559 4715 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.126:43737
I20260811 15:06:09.317862 4787 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.126:43737 every 8 connection(s)
I20260811 15:06:09.318854 4715 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
I20260811 15:06:09.324332 4788 sys_catalog.cc:263] Verifying existing consensus state
I20260811 15:06:09.324373 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 4715
I20260811 15:06:09.324960 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.65:36747
--local_ip_for_outbound_sockets=127.19.236.65
--tserver_master_addrs=127.19.236.126:43737
--webserver_port=46161
--webserver_interface=127.19.236.65
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.65.keytab
--principal=kudu/127.19.236.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:42739
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 15:06:09.327008 4788 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b6742f0314744b19a6b25bc347fd6f10: Bootstrap starting.
I20260811 15:06:09.348634 4788 log.cc:824] T 00000000000000000000000000000000 P b6742f0314744b19a6b25bc347fd6f10: Log is configured to *not* fsync() on all Append() calls
I20260811 15:06:09.360224 4788 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b6742f0314744b19a6b25bc347fd6f10: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 15:06:09.360684 4788 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b6742f0314744b19a6b25bc347fd6f10: Bootstrap complete.
I20260811 15:06:09.364840 4788 raft_consensus.cc:348] T 00000000000000000000000000000000 P b6742f0314744b19a6b25bc347fd6f10 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6742f0314744b19a6b25bc347fd6f10" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 43737 } }
I20260811 15:06:09.365239 4788 raft_consensus.cc:729] T 00000000000000000000000000000000 P b6742f0314744b19a6b25bc347fd6f10 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6742f0314744b19a6b25bc347fd6f10, State: Initialized, Role: FOLLOWER
I20260811 15:06:09.365734 4788 consensus_queue.cc:260] T 00000000000000000000000000000000 P b6742f0314744b19a6b25bc347fd6f10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6742f0314744b19a6b25bc347fd6f10" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 43737 } }
I20260811 15:06:09.365845 4788 raft_consensus.cc:388] T 00000000000000000000000000000000 P b6742f0314744b19a6b25bc347fd6f10 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 15:06:09.365929 4788 raft_consensus.cc:482] T 00000000000000000000000000000000 P b6742f0314744b19a6b25bc347fd6f10 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 15:06:09.366043 4788 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b6742f0314744b19a6b25bc347fd6f10 [term 2 FOLLOWER]: Advancing to term 3
I20260811 15:06:09.367951 4788 raft_consensus.cc:504] T 00000000000000000000000000000000 P b6742f0314744b19a6b25bc347fd6f10 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6742f0314744b19a6b25bc347fd6f10" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 43737 } }
I20260811 15:06:09.368283 4788 leader_election.cc:302] T 00000000000000000000000000000000 P b6742f0314744b19a6b25bc347fd6f10 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b6742f0314744b19a6b25bc347fd6f10; no voters:
I20260811 15:06:09.368642 4788 leader_election.cc:288] T 00000000000000000000000000000000 P b6742f0314744b19a6b25bc347fd6f10 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260811 15:06:09.368769 4794 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b6742f0314744b19a6b25bc347fd6f10 [term 3 FOLLOWER]: Leader election won for term 3
I20260811 15:06:09.369110 4794 raft_consensus.cc:686] T 00000000000000000000000000000000 P b6742f0314744b19a6b25bc347fd6f10 [term 3 LEADER]: Becoming Leader. State: Replica: b6742f0314744b19a6b25bc347fd6f10, State: Running, Role: LEADER
I20260811 15:06:09.369453 4794 consensus_queue.cc:237] T 00000000000000000000000000000000 P b6742f0314744b19a6b25bc347fd6f10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6742f0314744b19a6b25bc347fd6f10" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 43737 } }
I20260811 15:06:09.370316 4788 sys_catalog.cc:564] T 00000000000000000000000000000000 P b6742f0314744b19a6b25bc347fd6f10 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:06:09.370863 4795 sys_catalog.cc:455] T 00000000000000000000000000000000 P b6742f0314744b19a6b25bc347fd6f10 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "b6742f0314744b19a6b25bc347fd6f10" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6742f0314744b19a6b25bc347fd6f10" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 43737 } } }
I20260811 15:06:09.370993 4795 sys_catalog.cc:458] T 00000000000000000000000000000000 P b6742f0314744b19a6b25bc347fd6f10 [sys.catalog]: This master's current role is: LEADER
I20260811 15:06:09.371241 4795 sys_catalog.cc:455] T 00000000000000000000000000000000 P b6742f0314744b19a6b25bc347fd6f10 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b6742f0314744b19a6b25bc347fd6f10. Latest consensus state: current_term: 3 leader_uuid: "b6742f0314744b19a6b25bc347fd6f10" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6742f0314744b19a6b25bc347fd6f10" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 43737 } } }
I20260811 15:06:09.371330 4795 sys_catalog.cc:458] T 00000000000000000000000000000000 P b6742f0314744b19a6b25bc347fd6f10 [sys.catalog]: This master's current role is: LEADER
I20260811 15:06:09.372191 4800 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:06:09.377969 4800 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:06:09.378685 4800 catalog_manager.cc:1259] Loaded cluster ID: a93c6095c5d64a53b6e596b67ef34bbe
I20260811 15:06:09.378746 4800 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260811 15:06:09.379830 4800 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f85965889ad google::LogMessage::Fail() at ??:0
@ 0x7f859658b88a google::LogMessage::SendToLog() at ??:0
@ 0x7f85965884de google::LogMessage::Flush() at ??:0
@ 0x7f8596589a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f85a0ec7fdd _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_ at ??:0
@ 0x7f85a0ec8d2f kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f85a0ec5579 _ZZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvENKUlvE_clEv at ??:0
@ 0x7f85a0f09640 _ZNSt17_Function_handlerIFvvEZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f85987da3d7 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f85987dac83 _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7f85987dc3f2 _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f85987cb512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f8599e0f6db start_thread at ??:0
@ 0x7f859508661f clone at ??:0
W20260811 15:06:09.471139 4791 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:06:09.471459 4791 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:06:09.471561 4791 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:06:09.476205 4791 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:06:09.476310 4791 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:06:09.476404 4791 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.65
I20260811 15:06:09.482295 4791 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:42739
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.65.keytab
--principal=kudu/127.19.236.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.65:36747
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.236.65
--webserver_port=46161
--tserver_master_addrs=127.19.236.126:43737
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4791
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.65
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:06:09.483542 4791 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:06:09.484778 4791 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:06:09.494912 4836 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:06:09.494917 4834 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:06:09.495390 4838 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:06:09.495534 4791 server_base.cc:1034] running on GCE node
I20260811 15:06:09.495936 4791 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:06:09.496657 4791 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:06:09.497850 4791 hybrid_clock.cc:648] HybridClock initialized: now 1786460769497817 us; error 53 us; skew 500 ppm
Aug 11 15:06:09 dist-test-slave-8n49 krb5kdc[3481](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460769, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:06:09.501225 4791 init.cc:377] Logged in from keytab as kudu/127.19.236.65@KRBTEST.COM (short username kudu)
I20260811 15:06:09.502535 4791 webserver.cc:460] Webserver started at http://127.19.236.65:46161/ using document root <none> and password file <none>
I20260811 15:06:09.503180 4791 fs_manager.cc:359] Metadata directory not provided
I20260811 15:06:09.503275 4791 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:06:09.507570 4791 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260811 15:06:09.510027 4849 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:06:09.511634 4791 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 15:06:09.511785 4791 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-0/wal
uuid: "c021852aca1a445ebd50c797ae4afa5a"
format_stamp: "Formatted at 2026-08-11 15:06:07 on dist-test-slave-8n49"
server_key: "353d1470315869865dfe3274cbabd640"
server_key_iv: "a1502811da12d547a281551deb07db9f"
server_key_version: "encryptionkey@0"
I20260811 15:06:09.512389 4791 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:06:09.543740 4791 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:06:09.547286 4791 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:06:09.547520 4791 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:06:09.548213 4791 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:06:09.549496 4857 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 15:06:09.554131 4791 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 15:06:09.554204 4791 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.001s sys 0.000s
I20260811 15:06:09.554260 4791 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 15:06:09.556028 4791 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 15:06:09.556092 4791 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260811 15:06:09.556362 4857 tablet_bootstrap.cc:492] T ff6e8850da8f4532ab09b1195e14e518 P c021852aca1a445ebd50c797ae4afa5a: Bootstrap starting.
I20260811 15:06:09.567412 4791 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.65:36747
I20260811 15:06:09.568295 4977 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.65:36747 every 8 connection(s)
I20260811 15:06:09.568822 4791 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
I20260811 15:06:09.576277 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 4791
I20260811 15:06:09.576848 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.66:35841
--local_ip_for_outbound_sockets=127.19.236.66
--tserver_master_addrs=127.19.236.126:43737
--webserver_port=34939
--webserver_interface=127.19.236.66
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.66.keytab
--principal=kudu/127.19.236.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:42739
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 15:06:09.577932 4857 log.cc:824] T ff6e8850da8f4532ab09b1195e14e518 P c021852aca1a445ebd50c797ae4afa5a: Log is configured to *not* fsync() on all Append() calls
I20260811 15:06:09.588498 4857 tablet_bootstrap.cc:492] T ff6e8850da8f4532ab09b1195e14e518 P c021852aca1a445ebd50c797ae4afa5a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 15:06:09.589072 4857 tablet_bootstrap.cc:492] T ff6e8850da8f4532ab09b1195e14e518 P c021852aca1a445ebd50c797ae4afa5a: Bootstrap complete.
I20260811 15:06:09.590587 4857 ts_tablet_manager.cc:1397] T ff6e8850da8f4532ab09b1195e14e518 P c021852aca1a445ebd50c797ae4afa5a: Time spent bootstrapping tablet: real 0.034s user 0.017s sys 0.015s
I20260811 15:06:09.594400 4857 raft_consensus.cc:348] T ff6e8850da8f4532ab09b1195e14e518 P c021852aca1a445ebd50c797ae4afa5a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec8d0c3c86e47c98651ecba3e80f6df" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 33219 } } peers { permanent_uuid: "17295ce6738a4eb594f9aeb25ec12052" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35841 } } peers { permanent_uuid: "c021852aca1a445ebd50c797ae4afa5a" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 36747 } }
I20260811 15:06:09.595278 4857 raft_consensus.cc:729] T ff6e8850da8f4532ab09b1195e14e518 P c021852aca1a445ebd50c797ae4afa5a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c021852aca1a445ebd50c797ae4afa5a, State: Initialized, Role: FOLLOWER
I20260811 15:06:09.596072 4857 consensus_queue.cc:260] T ff6e8850da8f4532ab09b1195e14e518 P c021852aca1a445ebd50c797ae4afa5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec8d0c3c86e47c98651ecba3e80f6df" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 33219 } } peers { permanent_uuid: "17295ce6738a4eb594f9aeb25ec12052" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35841 } } peers { permanent_uuid: "c021852aca1a445ebd50c797ae4afa5a" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 36747 } }
I20260811 15:06:09.597828 4857 ts_tablet_manager.cc:1428] T ff6e8850da8f4532ab09b1195e14e518 P c021852aca1a445ebd50c797ae4afa5a: Time spent starting tablet: real 0.007s user 0.006s sys 0.002s
W20260811 15:06:09.653573 4980 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:06:09.571628 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:43737 (local address 127.19.236.65:60419)
0811 15:06:09.572982 (+ 1354us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:09.573074 (+ 92us) client_negotiation.cc:174] Beginning negotiation
0811 15:06:09.574374 (+ 1300us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:06:09.652788 (+ 78414us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:43737: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":1049,"thread_start_us":168,"threads_started":1}
W20260811 15:06:09.654086 4978 heartbeater.cc:644] Failed to heartbeat to 127.19.236.126:43737 (0 consecutive failures): Network error: Failed to ping master at 127.19.236.126:43737: Client connection negotiation failed: client connection to 127.19.236.126:43737: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 15:06:09.654886 4980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:09.654635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:43737 (local address 127.19.236.65:60665)
0811 15:06:09.654767 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:09.654829 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:43737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260811 15:06:09.655496 4980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:09.655297 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:43737 (local address 127.19.236.65:41529)
0811 15:06:09.655402 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:09.655451 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:43737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260811 15:06:09.655661 4978 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 15:06:09.701773 4982 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:06:09.702065 4982 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:06:09.702137 4982 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:06:09.706276 4982 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:06:09.706362 4982 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:06:09.706455 4982 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.66
I20260811 15:06:09.711851 4982 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:42739
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.66.keytab
--principal=kudu/127.19.236.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.66:35841
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.236.66
--webserver_port=34939
--tserver_master_addrs=127.19.236.126:43737
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4982
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.66
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:06:09.713001 4982 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:06:09.714128 4982 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:06:09.724181 4991 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:06:09.724157 4989 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:06:09.724227 4982 server_base.cc:1034] running on GCE node
W20260811 15:06:09.724159 4988 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:06:09.724836 4982 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:06:09.725483 4982 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:06:09.726701 4982 hybrid_clock.cc:648] HybridClock initialized: now 1786460769726639 us; error 75 us; skew 500 ppm
Aug 11 15:06:09 dist-test-slave-8n49 krb5kdc[3481](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460769, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:06:09.730196 4982 init.cc:377] Logged in from keytab as kudu/127.19.236.66@KRBTEST.COM (short username kudu)
I20260811 15:06:09.731222 4982 webserver.cc:460] Webserver started at http://127.19.236.66:34939/ using document root <none> and password file <none>
I20260811 15:06:09.731814 4982 fs_manager.cc:359] Metadata directory not provided
I20260811 15:06:09.731905 4982 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:06:09.736112 4982 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260811 15:06:09.738552 5000 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:06:09.739936 4982 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 15:06:09.740093 4982 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-1/wal
uuid: "17295ce6738a4eb594f9aeb25ec12052"
format_stamp: "Formatted at 2026-08-11 15:06:07 on dist-test-slave-8n49"
server_key: "2d4f17d84e50fd78833b87eed9e306da"
server_key_iv: "76264519e19fc126422f552aaf16144b"
server_key_version: "encryptionkey@0"
I20260811 15:06:09.740819 4982 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:06:09.757663 4982 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:06:09.761953 4982 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:06:09.762250 4982 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:06:09.762956 4982 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:06:09.763866 4982 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:06:09.763948 4982 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:06:09.764021 4982 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:06:09.764062 4982 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:06:09.774395 5127 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.66:35841 every 8 connection(s)
I20260811 15:06:09.774441 4982 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.66:35841
I20260811 15:06:09.776265 4982 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
I20260811 15:06:09.781193 5130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:09.779167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:43737 (local address 127.19.236.66:39787)
0811 15:06:09.779697 (+ 530us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:09.779828 (+ 131us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:43737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":302,"thread_start_us":117,"threads_started":1}
W20260811 15:06:09.781797 5128 heartbeater.cc:644] Failed to heartbeat to 127.19.236.126:43737 (0 consecutive failures): Network error: Failed to ping master at 127.19.236.126:43737: Client connection negotiation failed: client connection to 127.19.236.126:43737: connect: Connection refused (error 111)
I20260811 15:06:09.782509 5130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:09.782253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:43737 (local address 127.19.236.66:37747)
0811 15:06:09.782397 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:09.782451 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:43737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260811 15:06:09.783571 5130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:09.783286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:43737 (local address 127.19.236.66:53101)
0811 15:06:09.783458 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:09.783512 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:43737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
W20260811 15:06:09.783846 5128 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 15:06:09.785450 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 4982
I20260811 15:06:09.785948 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.67:33219
--local_ip_for_outbound_sockets=127.19.236.67
--tserver_master_addrs=127.19.236.126:43737
--webserver_port=34027
--webserver_interface=127.19.236.67
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.67.keytab
--principal=kudu/127.19.236.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:42739
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:06:09.906313 5132 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:06:09.906570 5132 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:06:09.906612 5132 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:06:09.910614 5132 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:06:09.910670 5132 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:06:09.910727 5132 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.67
I20260811 15:06:09.916060 5132 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:42739
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.67.keytab
--principal=kudu/127.19.236.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.67:33219
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.236.67
--webserver_port=34027
--tserver_master_addrs=127.19.236.126:43737
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5132
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.67
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:06:09.917281 5132 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:06:09.918323 5132 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 15:06:09.928583 5132 server_base.cc:1034] running on GCE node
W20260811 15:06:09.928514 5141 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:06:09.928501 5139 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:06:09.928519 5137 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:06:09.929185 5132 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:06:09.929890 5132 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:06:09.931056 5132 hybrid_clock.cc:648] HybridClock initialized: now 1786460769931041 us; error 28 us; skew 500 ppm
Aug 11 15:06:09 dist-test-slave-8n49 krb5kdc[3481](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460769, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:06:09.933799 5132 init.cc:377] Logged in from keytab as kudu/127.19.236.67@KRBTEST.COM (short username kudu)
I20260811 15:06:09.934667 5132 webserver.cc:460] Webserver started at http://127.19.236.67:34027/ using document root <none> and password file <none>
I20260811 15:06:09.935225 5132 fs_manager.cc:359] Metadata directory not provided
I20260811 15:06:09.935286 5132 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:06:09.939129 5132 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260811 15:06:09.941270 5148 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:06:09.942502 5132 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 15:06:09.942629 5132 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-2/wal
uuid: "eec8d0c3c86e47c98651ecba3e80f6df"
format_stamp: "Formatted at 2026-08-11 15:06:07 on dist-test-slave-8n49"
server_key: "dd5ceaca2c406852746fc04b543707f2"
server_key_iv: "4c8472338ba447e00e43795e8455dc09"
server_key_version: "encryptionkey@0"
I20260811 15:06:09.943245 5132 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:06:09.960732 5132 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:06:09.964040 5132 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:06:09.964269 5132 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:06:09.964952 5132 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:06:09.965827 5132 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:06:09.965883 5132 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:06:09.965955 5132 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:06:09.965991 5132 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:06:09.975271 5132 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.67:33219
I20260811 15:06:09.975358 5287 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.67:33219 every 8 connection(s)
I20260811 15:06:09.976393 5132 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
I20260811 15:06:09.980486 5290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:09.978687 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:43737 (local address 127.19.236.67:49069)
0811 15:06:09.979203 (+ 516us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:09.979326 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:43737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":314,"thread_start_us":132,"threads_started":1}
W20260811 15:06:09.980965 5288 heartbeater.cc:644] Failed to heartbeat to 127.19.236.126:43737 (0 consecutive failures): Network error: Failed to ping master at 127.19.236.126:43737: Client connection negotiation failed: client connection to 127.19.236.126:43737: connect: Connection refused (error 111)
I20260811 15:06:09.981587 5290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:09.981362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:43737 (local address 127.19.236.67:34835)
0811 15:06:09.981475 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:09.981531 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:43737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260811 15:06:09.982149 5290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:09.981972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:43737 (local address 127.19.236.67:46409)
0811 15:06:09.982064 (+ 92us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:09.982104 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:43737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260811 15:06:09.982306 5288 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 15:06:09.983995 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 5132
I20260811 15:06:10.656772 5292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:10.656210 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:43737 (local address 127.19.236.65:53345)
0811 15:06:10.656530 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:10.656664 (+ 134us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:43737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":233,"thread_start_us":82,"threads_started":1}
I20260811 15:06:10.785115 5293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:10.784543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:43737 (local address 127.19.236.66:50375)
0811 15:06:10.784927 (+ 384us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:10.784999 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:43737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":220,"thread_start_us":85,"threads_started":1}
I20260811 15:06:10.983397 5294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:10.982963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:43737 (local address 127.19.236.67:33193)
0811 15:06:10.983229 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:10.983289 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:43737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":76,"threads_started":1}
I20260811 15:06:11.359961 5295 raft_consensus.cc:482] T ff6e8850da8f4532ab09b1195e14e518 P c021852aca1a445ebd50c797ae4afa5a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 15:06:11.360198 5295 raft_consensus.cc:504] T ff6e8850da8f4532ab09b1195e14e518 P c021852aca1a445ebd50c797ae4afa5a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec8d0c3c86e47c98651ecba3e80f6df" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 33219 } } peers { permanent_uuid: "17295ce6738a4eb594f9aeb25ec12052" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35841 } } peers { permanent_uuid: "c021852aca1a445ebd50c797ae4afa5a" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 36747 } }
I20260811 15:06:11.361423 5295 leader_election.cc:288] T ff6e8850da8f4532ab09b1195e14e518 P c021852aca1a445ebd50c797ae4afa5a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eec8d0c3c86e47c98651ecba3e80f6df (127.19.236.67:33219), 17295ce6738a4eb594f9aeb25ec12052 (127.19.236.66:35841)
Aug 11 15:06:11 dist-test-slave-8n49 krb5kdc[3481](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460769, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.65@KRBTEST.COM for kudu/127.19.236.67@KRBTEST.COM
Aug 11 15:06:11 dist-test-slave-8n49 krb5kdc[3481](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460769, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.65@KRBTEST.COM for kudu/127.19.236.66@KRBTEST.COM
I20260811 15:06:11.376957 5296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:11.361699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.66:35841 (local address 127.19.236.65:51023)
0811 15:06:11.362192 (+ 493us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:11.362204 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 15:06:11.362267 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:06:11.363797 (+ 1530us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:06:11.363804 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:06:11.364383 (+ 579us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:06:11.364916 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:06:11.364933 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:06:11.366226 (+ 1293us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:06:11.366231 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:06:11.367221 (+ 990us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:06:11.367232 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:06:11.367963 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:06:11.367967 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:06:11.368196 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:11.369608 (+ 1412us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:06:11.369663 (+ 55us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:06:11.371458 (+ 1795us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:06:11.374076 (+ 2618us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:06:11.374080 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:06:11.374082 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:06:11.374313 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:06:11.374822 (+ 509us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:06:11.374828 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:06:11.374830 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:06:11.374958 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:06:11.375801 (+ 843us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:06:11.375808 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:06:11.376132 (+ 324us) client_negotiation.cc:769] Sending connection context
0811 15:06:11.376322 (+ 190us) client_negotiation.cc:240] Negotiation successful
0811 15:06:11.376710 (+ 388us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":427,"mutex_wait_us":252,"spinlock_wait_cycles":91136,"thread_start_us":81,"threads_started":1}
I20260811 15:06:11.376978 5298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:11.361916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.65:51023 (local address 127.19.236.66:35841)
0811 15:06:11.362321 (+ 405us) server_negotiation.cc:206] Beginning negotiation
0811 15:06:11.362333 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 15:06:11.362372 (+ 39us) server_negotiation.cc:407] Connection header received
0811 15:06:11.363065 (+ 693us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:06:11.363071 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:06:11.363421 (+ 350us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:06:11.363743 (+ 322us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:06:11.365099 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:11.366087 (+ 988us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:11.367354 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:11.367815 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:11.367995 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:11.371676 (+ 3681us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:06:11.371686 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:06:11.371702 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:06:11.371741 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:06:11.373942 (+ 2201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:06:11.374450 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:06:11.374475 (+ 25us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:06:11.374483 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:06:11.374650 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:06:11.375045 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:06:11.375048 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:06:11.375050 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:06:11.375607 (+ 557us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:06:11.375779 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0811 15:06:11.376499 (+ 720us) server_negotiation.cc:299] Negotiation successful
0811 15:06:11.376837 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":308,"thread_start_us":77,"threads_started":1}
I20260811 15:06:11.377262 5299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:11.361914 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.65:41971 (local address 127.19.236.67:33219)
0811 15:06:11.362513 (+ 599us) server_negotiation.cc:206] Beginning negotiation
0811 15:06:11.362533 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0811 15:06:11.362570 (+ 37us) server_negotiation.cc:407] Connection header received
0811 15:06:11.363221 (+ 651us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:06:11.363226 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:06:11.363525 (+ 299us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:06:11.363816 (+ 291us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:06:11.365108 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:11.366074 (+ 966us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:11.367353 (+ 1279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:11.367815 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:11.367995 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:11.371228 (+ 3233us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:06:11.371234 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:06:11.371253 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:06:11.371289 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:06:11.373641 (+ 2352us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:06:11.374348 (+ 707us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:06:11.374356 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:06:11.374362 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:06:11.374538 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:06:11.374981 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:06:11.374987 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:06:11.374992 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:06:11.375592 (+ 600us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:06:11.375742 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0811 15:06:11.376765 (+ 1023us) server_negotiation.cc:299] Negotiation successful
0811 15:06:11.377045 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":486,"thread_start_us":81,"threads_started":1}
I20260811 15:06:11.377938 5297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:11.361699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.67:33219 (local address 127.19.236.65:41971)
0811 15:06:11.362094 (+ 395us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:11.362113 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 15:06:11.362238 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:06:11.363799 (+ 1561us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:06:11.363805 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:06:11.364377 (+ 572us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:06:11.364916 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:06:11.364932 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:06:11.366230 (+ 1298us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:06:11.366233 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:06:11.367220 (+ 987us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:06:11.367231 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:06:11.367947 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:06:11.367951 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:06:11.368172 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:11.368959 (+ 787us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:06:11.368984 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:06:11.371008 (+ 2024us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:06:11.373793 (+ 2785us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:06:11.373802 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:06:11.373817 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:06:11.374189 (+ 372us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:06:11.374668 (+ 479us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:06:11.374673 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:06:11.374676 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:06:11.374859 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:06:11.375801 (+ 942us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:06:11.375808 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:06:11.376104 (+ 296us) client_negotiation.cc:769] Sending connection context
0811 15:06:11.376317 (+ 213us) client_negotiation.cc:240] Negotiation successful
0811 15:06:11.377812 (+ 1495us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":308,"mutex_wait_us":1303,"spinlock_wait_cycles":3840,"thread_start_us":70,"threads_started":1}
W20260811 15:06:11.380371 4852 leader_election.cc:341] T ff6e8850da8f4532ab09b1195e14e518 P c021852aca1a445ebd50c797ae4afa5a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 17295ce6738a4eb594f9aeb25ec12052 (127.19.236.66:35841): Not found: Tablet not found: ff6e8850da8f4532ab09b1195e14e518
W20260811 15:06:11.380538 4853 leader_election.cc:341] T ff6e8850da8f4532ab09b1195e14e518 P c021852aca1a445ebd50c797ae4afa5a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer eec8d0c3c86e47c98651ecba3e80f6df (127.19.236.67:33219): Not found: Tablet not found: ff6e8850da8f4532ab09b1195e14e518
I20260811 15:06:11.380643 4853 leader_election.cc:302] T ff6e8850da8f4532ab09b1195e14e518 P c021852aca1a445ebd50c797ae4afa5a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c021852aca1a445ebd50c797ae4afa5a; no voters: 17295ce6738a4eb594f9aeb25ec12052, eec8d0c3c86e47c98651ecba3e80f6df
I20260811 15:06:11.380945 5295 raft_consensus.cc:2726] T ff6e8850da8f4532ab09b1195e14e518 P c021852aca1a445ebd50c797ae4afa5a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 15:06:11.657935 5297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:11.657624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:43737 (local address 127.19.236.65:39347)
0811 15:06:11.657781 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:11.657844 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:43737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260811 15:06:11.786621 5300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:11.786017 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:43737 (local address 127.19.236.66:34709)
0811 15:06:11.786436 (+ 419us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:11.786496 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:43737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":325,"thread_start_us":199,"threads_started":1}
I20260811 15:06:11.984786 5301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:11.984224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:43737 (local address 127.19.236.67:40279)
0811 15:06:11.984525 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:11.984656 (+ 131us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:43737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":124,"threads_started":1}
I20260811 15:06:12.659237 5302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:12.658789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:43737 (local address 127.19.236.65:41013)
0811 15:06:12.659072 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:12.659133 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:43737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":80,"threads_started":1}
I20260811 15:06:12.788106 5303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:12.787622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:43737 (local address 127.19.236.66:60547)
0811 15:06:12.787901 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:12.787991 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:43737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":108,"threads_started":1}
I20260811 15:06:12.986230 5305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:12.985737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:43737 (local address 127.19.236.67:35959)
0811 15:06:12.986022 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:12.986085 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:43737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":104,"threads_started":1}
I20260811 15:06:13.467228 5307 raft_consensus.cc:482] T ff6e8850da8f4532ab09b1195e14e518 P c021852aca1a445ebd50c797ae4afa5a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 15:06:13.467384 5307 raft_consensus.cc:504] T ff6e8850da8f4532ab09b1195e14e518 P c021852aca1a445ebd50c797ae4afa5a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec8d0c3c86e47c98651ecba3e80f6df" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 33219 } } peers { permanent_uuid: "17295ce6738a4eb594f9aeb25ec12052" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35841 } } peers { permanent_uuid: "c021852aca1a445ebd50c797ae4afa5a" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 36747 } }
I20260811 15:06:13.467799 5307 leader_election.cc:288] T ff6e8850da8f4532ab09b1195e14e518 P c021852aca1a445ebd50c797ae4afa5a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eec8d0c3c86e47c98651ecba3e80f6df (127.19.236.67:33219), 17295ce6738a4eb594f9aeb25ec12052 (127.19.236.66:35841)
W20260811 15:06:13.468760 4852 leader_election.cc:341] T ff6e8850da8f4532ab09b1195e14e518 P c021852aca1a445ebd50c797ae4afa5a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 17295ce6738a4eb594f9aeb25ec12052 (127.19.236.66:35841): Not found: Tablet not found: ff6e8850da8f4532ab09b1195e14e518
W20260811 15:06:13.468924 4853 leader_election.cc:341] T ff6e8850da8f4532ab09b1195e14e518 P c021852aca1a445ebd50c797ae4afa5a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer eec8d0c3c86e47c98651ecba3e80f6df (127.19.236.67:33219): Not found: Tablet not found: ff6e8850da8f4532ab09b1195e14e518
I20260811 15:06:13.469022 4853 leader_election.cc:302] T ff6e8850da8f4532ab09b1195e14e518 P c021852aca1a445ebd50c797ae4afa5a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c021852aca1a445ebd50c797ae4afa5a; no voters: 17295ce6738a4eb594f9aeb25ec12052, eec8d0c3c86e47c98651ecba3e80f6df
I20260811 15:06:13.469213 5307 raft_consensus.cc:2726] T ff6e8850da8f4532ab09b1195e14e518 P c021852aca1a445ebd50c797ae4afa5a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 15:06:13.660842 5308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:13.660230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:43737 (local address 127.19.236.65:36487)
0811 15:06:13.660628 (+ 398us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:13.660717 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:43737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":105,"threads_started":1}
I20260811 15:06:13.789791 5309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:13.789263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:43737 (local address 127.19.236.66:57901)
0811 15:06:13.789600 (+ 337us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:13.789664 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:43737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":99,"threads_started":1}
I20260811 15:06:13.987555 5310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:13.987060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:43737 (local address 127.19.236.67:46525)
0811 15:06:13.987371 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:13.987452 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:43737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":86,"threads_started":1}
I20260811 15:06:14.662372 5311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:14.661846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:43737 (local address 127.19.236.65:51441)
0811 15:06:14.662205 (+ 359us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:14.662267 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:43737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":266,"thread_start_us":79,"threads_started":1}
I20260811 15:06:14.791062 5312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:14.790594 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:43737 (local address 127.19.236.66:56229)
0811 15:06:14.790896 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:14.790955 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:43737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":96,"threads_started":1}
I20260811 15:06:14.988904 5313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:14.988427 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:43737 (local address 127.19.236.67:50547)
0811 15:06:14.988748 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:14.988805 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:43737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":248,"thread_start_us":165,"threads_started":1}
I20260811 15:06:15.663630 5314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:15.663191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:43737 (local address 127.19.236.65:47623)
0811 15:06:15.663458 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:15.663518 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:43737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":86,"threads_started":1}
I20260811 15:06:15.792639 5315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:15.792002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:43737 (local address 127.19.236.66:54341)
0811 15:06:15.792383 (+ 381us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:15.792454 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:43737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":268,"thread_start_us":105,"threads_started":1}
I20260811 15:06:15.900830 5316 raft_consensus.cc:482] T ff6e8850da8f4532ab09b1195e14e518 P c021852aca1a445ebd50c797ae4afa5a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 15:06:15.901010 5316 raft_consensus.cc:504] T ff6e8850da8f4532ab09b1195e14e518 P c021852aca1a445ebd50c797ae4afa5a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec8d0c3c86e47c98651ecba3e80f6df" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 33219 } } peers { permanent_uuid: "17295ce6738a4eb594f9aeb25ec12052" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35841 } } peers { permanent_uuid: "c021852aca1a445ebd50c797ae4afa5a" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 36747 } }
I20260811 15:06:15.901557 5316 leader_election.cc:288] T ff6e8850da8f4532ab09b1195e14e518 P c021852aca1a445ebd50c797ae4afa5a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eec8d0c3c86e47c98651ecba3e80f6df (127.19.236.67:33219), 17295ce6738a4eb594f9aeb25ec12052 (127.19.236.66:35841)
W20260811 15:06:15.902401 4852 leader_election.cc:341] T ff6e8850da8f4532ab09b1195e14e518 P c021852aca1a445ebd50c797ae4afa5a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 17295ce6738a4eb594f9aeb25ec12052 (127.19.236.66:35841): Not found: Tablet not found: ff6e8850da8f4532ab09b1195e14e518
W20260811 15:06:15.902511 4853 leader_election.cc:341] T ff6e8850da8f4532ab09b1195e14e518 P c021852aca1a445ebd50c797ae4afa5a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer eec8d0c3c86e47c98651ecba3e80f6df (127.19.236.67:33219): Not found: Tablet not found: ff6e8850da8f4532ab09b1195e14e518
I20260811 15:06:15.902619 4853 leader_election.cc:302] T ff6e8850da8f4532ab09b1195e14e518 P c021852aca1a445ebd50c797ae4afa5a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c021852aca1a445ebd50c797ae4afa5a; no voters: 17295ce6738a4eb594f9aeb25ec12052, eec8d0c3c86e47c98651ecba3e80f6df
I20260811 15:06:15.902814 5316 raft_consensus.cc:2726] T ff6e8850da8f4532ab09b1195e14e518 P c021852aca1a445ebd50c797ae4afa5a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 15:06:15.990307 5317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:15.989831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:43737 (local address 127.19.236.67:58095)
0811 15:06:15.990143 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:15.990206 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:43737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":104,"threads_started":1}
I20260811 15:06:16.665220 5319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:16.664676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:43737 (local address 127.19.236.65:39431)
0811 15:06:16.665051 (+ 375us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:16.665118 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:43737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":288,"thread_start_us":83,"threads_started":1}
I20260811 15:06:16.793964 5320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:16.793473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:43737 (local address 127.19.236.66:46933)
0811 15:06:16.793799 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:16.793858 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:43737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":249,"thread_start_us":80,"threads_started":1}
I20260811 15:06:16.991865 5321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:16.991298 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:43737 (local address 127.19.236.67:45151)
0811 15:06:16.991695 (+ 397us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:16.991759 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:43737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":310,"thread_start_us":106,"threads_started":1}
I20260811 15:06:17.666494 5322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:17.666015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:43737 (local address 127.19.236.65:44517)
0811 15:06:17.666323 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:17.666381 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:43737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":80,"threads_started":1}
I20260811 15:06:17.795537 5323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:17.795022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:43737 (local address 127.19.236.66:37059)
0811 15:06:17.795350 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:17.795417 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:43737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":239,"thread_start_us":110,"threads_started":1}
I20260811 15:06:17.993227 5324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:17.992747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:43737 (local address 127.19.236.67:58425)
0811 15:06:17.993062 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:17.993126 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:43737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":79,"threads_started":1}
I20260811 15:06:18.668059 5325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:18.667480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:43737 (local address 127.19.236.65:34907)
0811 15:06:18.667886 (+ 406us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:18.667955 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:43737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":295,"thread_start_us":86,"threads_started":1}
I20260811 15:06:18.797010 5326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:18.796508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:43737 (local address 127.19.236.66:60279)
0811 15:06:18.796843 (+ 335us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:18.796907 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:43737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":149,"threads_started":1}
I20260811 15:06:18.994881 5327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:18.994404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:43737 (local address 127.19.236.67:43121)
0811 15:06:18.994715 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:18.994776 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:43737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":96,"threads_started":1}
I20260811 15:06:19.669579 5328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:19.669138 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:43737 (local address 127.19.236.65:57623)
0811 15:06:19.669423 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:19.669479 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:43737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":97,"threads_started":1}
I20260811 15:06:19.798509 5329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:19.797933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:43737 (local address 127.19.236.66:57283)
0811 15:06:19.798267 (+ 334us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:19.798332 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:43737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":96,"threads_started":1}
I20260811 15:06:19.996361 5330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:19.995864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:43737 (local address 127.19.236.67:36331)
0811 15:06:19.996191 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:19.996255 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:43737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":104,"threads_started":1}
I20260811 15:06:20.307152 5331 raft_consensus.cc:482] T ff6e8850da8f4532ab09b1195e14e518 P c021852aca1a445ebd50c797ae4afa5a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 15:06:20.307312 5331 raft_consensus.cc:504] T ff6e8850da8f4532ab09b1195e14e518 P c021852aca1a445ebd50c797ae4afa5a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec8d0c3c86e47c98651ecba3e80f6df" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 33219 } } peers { permanent_uuid: "17295ce6738a4eb594f9aeb25ec12052" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35841 } } peers { permanent_uuid: "c021852aca1a445ebd50c797ae4afa5a" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 36747 } }
I20260811 15:06:20.307794 5331 leader_election.cc:288] T ff6e8850da8f4532ab09b1195e14e518 P c021852aca1a445ebd50c797ae4afa5a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eec8d0c3c86e47c98651ecba3e80f6df (127.19.236.67:33219), 17295ce6738a4eb594f9aeb25ec12052 (127.19.236.66:35841)
W20260811 15:06:20.308743 4853 leader_election.cc:341] T ff6e8850da8f4532ab09b1195e14e518 P c021852aca1a445ebd50c797ae4afa5a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer eec8d0c3c86e47c98651ecba3e80f6df (127.19.236.67:33219): Not found: Tablet not found: ff6e8850da8f4532ab09b1195e14e518
W20260811 15:06:20.308893 4852 leader_election.cc:341] T ff6e8850da8f4532ab09b1195e14e518 P c021852aca1a445ebd50c797ae4afa5a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 17295ce6738a4eb594f9aeb25ec12052 (127.19.236.66:35841): Not found: Tablet not found: ff6e8850da8f4532ab09b1195e14e518
I20260811 15:06:20.308995 4852 leader_election.cc:302] T ff6e8850da8f4532ab09b1195e14e518 P c021852aca1a445ebd50c797ae4afa5a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c021852aca1a445ebd50c797ae4afa5a; no voters: 17295ce6738a4eb594f9aeb25ec12052, eec8d0c3c86e47c98651ecba3e80f6df
I20260811 15:06:20.309175 5331 raft_consensus.cc:2726] T ff6e8850da8f4532ab09b1195e14e518 P c021852aca1a445ebd50c797ae4afa5a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 15:06:20.670991 5335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:20.670495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:43737 (local address 127.19.236.65:59687)
0811 15:06:20.670821 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:20.670890 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:43737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":242,"thread_start_us":114,"threads_started":1}
I20260811 15:06:20.799851 5336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:20.799390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:43737 (local address 127.19.236.66:47017)
0811 15:06:20.799694 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:20.799750 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:43737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":80,"threads_started":1}
I20260811 15:06:20.997822 5337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:20.997292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:43737 (local address 127.19.236.67:55691)
0811 15:06:20.997608 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:20.997667 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:43737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":125,"threads_started":1}
I20260811 15:06:21.672484 5339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:21.671974 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:43737 (local address 127.19.236.65:41745)
0811 15:06:21.672314 (+ 340us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:21.672381 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:43737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":264,"thread_start_us":121,"threads_started":1}
I20260811 15:06:21.801386 5340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:21.800896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:43737 (local address 127.19.236.66:49595)
0811 15:06:21.801218 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:21.801283 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:43737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":236,"thread_start_us":96,"threads_started":1}
I20260811 15:06:21.999423 5341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:21.998863 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:43737 (local address 127.19.236.67:41261)
0811 15:06:21.999247 (+ 384us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:21.999318 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:43737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":295,"thread_start_us":122,"threads_started":1}
I20260811 15:06:22.673959 5342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:22.673450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:43737 (local address 127.19.236.65:33715)
0811 15:06:22.673754 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:22.673842 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:43737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":83,"threads_started":1}
I20260811 15:06:22.802933 5343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:22.802414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:43737 (local address 127.19.236.66:39619)
0811 15:06:22.802757 (+ 343us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:22.802824 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:43737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":90,"threads_started":1}
I20260811 15:06:23.000922 5344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:23.000411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:43737 (local address 127.19.236.67:42743)
0811 15:06:23.000751 (+ 340us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:23.000814 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:43737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":82,"threads_started":1}
I20260811 15:06:23.675261 5345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:23.674808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:43737 (local address 127.19.236.65:57769)
0811 15:06:23.675096 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:23.675156 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:43737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":82,"threads_started":1}
I20260811 15:06:23.804667 5346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:23.804097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:43737 (local address 127.19.236.66:34083)
0811 15:06:23.804423 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:23.804489 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:43737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":122,"threads_started":1}
I20260811 15:06:23.908944 5347 raft_consensus.cc:482] T ff6e8850da8f4532ab09b1195e14e518 P c021852aca1a445ebd50c797ae4afa5a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 15:06:23.909086 5347 raft_consensus.cc:504] T ff6e8850da8f4532ab09b1195e14e518 P c021852aca1a445ebd50c797ae4afa5a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eec8d0c3c86e47c98651ecba3e80f6df" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 33219 } } peers { permanent_uuid: "17295ce6738a4eb594f9aeb25ec12052" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 35841 } } peers { permanent_uuid: "c021852aca1a445ebd50c797ae4afa5a" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 36747 } }
I20260811 15:06:23.909562 5347 leader_election.cc:288] T ff6e8850da8f4532ab09b1195e14e518 P c021852aca1a445ebd50c797ae4afa5a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eec8d0c3c86e47c98651ecba3e80f6df (127.19.236.67:33219), 17295ce6738a4eb594f9aeb25ec12052 (127.19.236.66:35841)
W20260811 15:06:23.910415 4853 leader_election.cc:341] T ff6e8850da8f4532ab09b1195e14e518 P c021852aca1a445ebd50c797ae4afa5a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer eec8d0c3c86e47c98651ecba3e80f6df (127.19.236.67:33219): Not found: Tablet not found: ff6e8850da8f4532ab09b1195e14e518
W20260811 15:06:23.910552 4852 leader_election.cc:341] T ff6e8850da8f4532ab09b1195e14e518 P c021852aca1a445ebd50c797ae4afa5a [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 17295ce6738a4eb594f9aeb25ec12052 (127.19.236.66:35841): Not found: Tablet not found: ff6e8850da8f4532ab09b1195e14e518
I20260811 15:06:23.910652 4852 leader_election.cc:302] T ff6e8850da8f4532ab09b1195e14e518 P c021852aca1a445ebd50c797ae4afa5a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c021852aca1a445ebd50c797ae4afa5a; no voters: 17295ce6738a4eb594f9aeb25ec12052, eec8d0c3c86e47c98651ecba3e80f6df
I20260811 15:06:23.910851 5347 raft_consensus.cc:2726] T ff6e8850da8f4532ab09b1195e14e518 P c021852aca1a445ebd50c797ae4afa5a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 15:06:24.002542 5348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:24.002039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:43737 (local address 127.19.236.67:33345)
0811 15:06:24.002360 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:24.002424 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:43737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":93,"threads_started":1}
I20260811 15:06:24.676848 5350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:24.676369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:43737 (local address 127.19.236.65:35099)
0811 15:06:24.676687 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:24.676748 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:43737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":240,"thread_start_us":81,"threads_started":1}
I20260811 15:06:24.806288 5351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:24.805779 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:43737 (local address 127.19.236.66:33389)
0811 15:06:24.806122 (+ 343us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:24.806184 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:43737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":109,"threads_started":1}
I20260811 15:06:24.986641 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 4791
I20260811 15:06:24.998339 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 4982
I20260811 15:06:25.004135 5352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:25.003669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:43737 (local address 127.19.236.67:41133)
0811 15:06:25.003971 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:25.004033 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:43737: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":93,"threads_started":1}
I20260811 15:06:25.007822 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 5132
2026-08-11T15:06:25Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (19391 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 15:06:25 dist-test-slave-8n49 krb5kdc[5356](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 15:06:25 dist-test-slave-8n49 krb5kdc[5356](info): set up 2 sockets
Aug 11 15:06:25 dist-test-slave-8n49 krb5kdc[5356](info): commencing operation
krb5kdc: starting...
W20260811 15:06:26.131333 20401 mini_kdc.cc:121] Time spent starting KDC: real 1.097s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/krb5kdc/test-user.keytab.
Aug 11 15:06:26 dist-test-slave-8n49 krb5kdc[5356](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460786, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T15:06:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T15:06:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.236.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.236.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.236.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab.
Entry for principal kudu/127.19.236.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab.
I20260811 15:06:26.259006 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:42765
--webserver_interface=127.19.236.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab
--principal=kudu/127.19.236.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:43709
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.236.126:42765
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:06:26.373909 5373 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:06:26.374203 5373 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:06:26.374245 5373 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:06:26.378301 5373 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 15:06:26.378361 5373 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 15:06:26.378377 5373 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 15:06:26.378391 5373 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:06:26.378410 5373 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:06:26.378428 5373 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:06:26.378444 5373 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:06:26.378459 5373 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:06:26.383822 5373 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:43709
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.19.236.126:42765
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab
--principal=kudu/127.19.236.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:42765
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.236.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5373
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:06:26.384948 5373 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:06:26.385967 5373 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:06:26.394763 5378 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:06:26.394762 5379 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:06:26.394780 5381 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:06:26.395085 5373 server_base.cc:1034] running on GCE node
I20260811 15:06:26.395710 5373 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:06:26.396885 5373 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:06:26.398046 5373 hybrid_clock.cc:648] HybridClock initialized: now 1786460786398018 us; error 43 us; skew 500 ppm
Aug 11 15:06:26 dist-test-slave-8n49 krb5kdc[5356](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460786, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:06:26.400858 5373 init.cc:377] Logged in from keytab as kudu/127.19.236.126@KRBTEST.COM (short username kudu)
I20260811 15:06:26.401806 5373 webserver.cc:460] Webserver started at http://127.19.236.126:39061/ using document root <none> and password file <none>
I20260811 15:06:26.402385 5373 fs_manager.cc:359] Metadata directory not provided
I20260811 15:06:26.402480 5373 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:06:26.402724 5373 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:06:26.404877 5373 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/master-0/data/instance:
uuid: "bbac445142d44bb88e8007cbf65f9397"
format_stamp: "Formatted at 2026-08-11 15:06:26 on dist-test-slave-8n49"
server_key: "5165d26abeb91ab3809442f4a6ed0352"
server_key_iv: "981f56a8b68aa637908fcc5109ab68ce"
server_key_version: "encryptionkey@0"
I20260811 15:06:26.405462 5373 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/master-0/wal/instance:
uuid: "bbac445142d44bb88e8007cbf65f9397"
format_stamp: "Formatted at 2026-08-11 15:06:26 on dist-test-slave-8n49"
server_key: "5165d26abeb91ab3809442f4a6ed0352"
server_key_iv: "981f56a8b68aa637908fcc5109ab68ce"
server_key_version: "encryptionkey@0"
I20260811 15:06:26.409299 5373 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.003s
I20260811 15:06:26.411902 5389 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:06:26.413362 5373 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 15:06:26.413537 5373 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/master-0/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/master-0/wal
uuid: "bbac445142d44bb88e8007cbf65f9397"
format_stamp: "Formatted at 2026-08-11 15:06:26 on dist-test-slave-8n49"
server_key: "5165d26abeb91ab3809442f4a6ed0352"
server_key_iv: "981f56a8b68aa637908fcc5109ab68ce"
server_key_version: "encryptionkey@0"
I20260811 15:06:26.413662 5373 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:06:26.427474 5373 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:06:26.430919 5373 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:06:26.431164 5373 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:06:26.438748 5373 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.126:42765
I20260811 15:06:26.439044 5455 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.126:42765 every 8 connection(s)
I20260811 15:06:26.439814 5373 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
I20260811 15:06:26.442674 5456 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:06:26.446345 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 5373
I20260811 15:06:26.446485 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/master-0/wal/instance
I20260811 15:06:26.446810 20401 external_mini_cluster.cc:1428] Setting key 7b4ff84094933099aabe68de8cc72978
I20260811 15:06:26.448915 5456 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bbac445142d44bb88e8007cbf65f9397: Bootstrap starting.
I20260811 15:06:26.451584 5456 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bbac445142d44bb88e8007cbf65f9397: Neither blocks nor log segments found. Creating new log.
I20260811 15:06:26.452417 5456 log.cc:824] T 00000000000000000000000000000000 P bbac445142d44bb88e8007cbf65f9397: Log is configured to *not* fsync() on all Append() calls
I20260811 15:06:26.454309 5456 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bbac445142d44bb88e8007cbf65f9397: No bootstrap required, opened a new log
Aug 11 15:06:26 dist-test-slave-8n49 krb5kdc[5356](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460786, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
I20260811 15:06:26.458226 5456 raft_consensus.cc:348] T 00000000000000000000000000000000 P bbac445142d44bb88e8007cbf65f9397 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbac445142d44bb88e8007cbf65f9397" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 42765 } }
I20260811 15:06:26.458447 5456 raft_consensus.cc:374] T 00000000000000000000000000000000 P bbac445142d44bb88e8007cbf65f9397 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:06:26.458508 5456 raft_consensus.cc:729] T 00000000000000000000000000000000 P bbac445142d44bb88e8007cbf65f9397 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbac445142d44bb88e8007cbf65f9397, State: Initialized, Role: FOLLOWER
I20260811 15:06:26.458935 5456 consensus_queue.cc:260] T 00000000000000000000000000000000 P bbac445142d44bb88e8007cbf65f9397 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbac445142d44bb88e8007cbf65f9397" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 42765 } }
I20260811 15:06:26.459060 5456 raft_consensus.cc:388] T 00000000000000000000000000000000 P bbac445142d44bb88e8007cbf65f9397 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 15:06:26.459183 5456 raft_consensus.cc:482] T 00000000000000000000000000000000 P bbac445142d44bb88e8007cbf65f9397 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 15:06:26.459301 5456 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bbac445142d44bb88e8007cbf65f9397 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:06:26.460284 5456 raft_consensus.cc:504] T 00000000000000000000000000000000 P bbac445142d44bb88e8007cbf65f9397 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbac445142d44bb88e8007cbf65f9397" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 42765 } }
I20260811 15:06:26.460681 5456 leader_election.cc:302] T 00000000000000000000000000000000 P bbac445142d44bb88e8007cbf65f9397 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bbac445142d44bb88e8007cbf65f9397; no voters:
I20260811 15:06:26.461048 5456 leader_election.cc:288] T 00000000000000000000000000000000 P bbac445142d44bb88e8007cbf65f9397 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 15:06:26.461150 5462 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bbac445142d44bb88e8007cbf65f9397 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:06:26.461381 5462 raft_consensus.cc:686] T 00000000000000000000000000000000 P bbac445142d44bb88e8007cbf65f9397 [term 1 LEADER]: Becoming Leader. State: Replica: bbac445142d44bb88e8007cbf65f9397, State: Running, Role: LEADER
I20260811 15:06:26.461759 5462 consensus_queue.cc:237] T 00000000000000000000000000000000 P bbac445142d44bb88e8007cbf65f9397 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbac445142d44bb88e8007cbf65f9397" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 42765 } }
I20260811 15:06:26.462368 5459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:26.448303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55142 (local address 127.19.236.126:42765)
0811 15:06:26.448762 (+ 459us) server_negotiation.cc:206] Beginning negotiation
0811 15:06:26.448778 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 15:06:26.448815 (+ 37us) server_negotiation.cc:407] Connection header received
0811 15:06:26.449497 (+ 682us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:06:26.449515 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:06:26.449977 (+ 462us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:06:26.450375 (+ 398us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:06:26.451616 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:26.452780 (+ 1164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:26.453647 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:26.454119 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:26.454289 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:26.457059 (+ 2770us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:06:26.457064 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:06:26.457077 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:06:26.457104 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:06:26.459069 (+ 1965us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:06:26.459596 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:06:26.459602 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:06:26.459608 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:06:26.459726 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:06:26.460028 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:06:26.460031 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:06:26.460033 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:06:26.460470 (+ 437us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:06:26.460749 (+ 279us) server_negotiation.cc:1035] Waiting for connection context
0811 15:06:26.461036 (+ 287us) server_negotiation.cc:299] Negotiation successful
0811 15:06:26.461423 (+ 387us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":320,"thread_start_us":140,"threads_started":1}
I20260811 15:06:26.462469 5456 sys_catalog.cc:564] T 00000000000000000000000000000000 P bbac445142d44bb88e8007cbf65f9397 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:06:26.463500 5465 sys_catalog.cc:455] T 00000000000000000000000000000000 P bbac445142d44bb88e8007cbf65f9397 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bbac445142d44bb88e8007cbf65f9397" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbac445142d44bb88e8007cbf65f9397" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 42765 } } }
I20260811 15:06:26.463639 5465 sys_catalog.cc:458] T 00000000000000000000000000000000 P bbac445142d44bb88e8007cbf65f9397 [sys.catalog]: This master's current role is: LEADER
I20260811 15:06:26.463969 5466 sys_catalog.cc:455] T 00000000000000000000000000000000 P bbac445142d44bb88e8007cbf65f9397 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bbac445142d44bb88e8007cbf65f9397. Latest consensus state: current_term: 1 leader_uuid: "bbac445142d44bb88e8007cbf65f9397" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbac445142d44bb88e8007cbf65f9397" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 42765 } } }
I20260811 15:06:26.464048 5466 sys_catalog.cc:458] T 00000000000000000000000000000000 P bbac445142d44bb88e8007cbf65f9397 [sys.catalog]: This master's current role is: LEADER
I20260811 15:06:26.464068 5474 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:06:26.467391 5474 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:06:26.473384 5474 catalog_manager.cc:1347] Generated new cluster ID: 0b6d5e69c5a64105a6b35654e2e56b44
I20260811 15:06:26.473467 5474 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:06:26.482972 5474 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 15:06:26.484294 5474 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:06:26.492072 5474 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bbac445142d44bb88e8007cbf65f9397: Generated new TSK 0
I20260811 15:06:26.492972 5474 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.236.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.236.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.236.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.65.keytab.
Entry for principal kudu/127.19.236.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.65.keytab.
I20260811 15:06:26.531963 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.65:0
--local_ip_for_outbound_sockets=127.19.236.65
--webserver_interface=127.19.236.65
--webserver_port=0
--tserver_master_addrs=127.19.236.126:42765
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.65.keytab
--principal=kudu/127.19.236.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:43709
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:06:26.663653 5489 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:06:26.663970 5489 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:06:26.664016 5489 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:06:26.668246 5489 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:06:26.668314 5489 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:06:26.668412 5489 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.65
I20260811 15:06:26.673800 5489 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:43709
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.65.keytab
--principal=kudu/127.19.236.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.236.65
--webserver_port=0
--tserver_master_addrs=127.19.236.126:42765
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5489
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.65
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:06:26.674925 5489 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:06:26.675992 5489 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:06:26.686062 5496 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:06:26.686062 5495 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:06:26.686066 5498 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:06:26.686301 5489 server_base.cc:1034] running on GCE node
I20260811 15:06:26.686724 5489 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:06:26.687395 5489 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:06:26.688653 5489 hybrid_clock.cc:648] HybridClock initialized: now 1786460786688635 us; error 29 us; skew 500 ppm
Aug 11 15:06:26 dist-test-slave-8n49 krb5kdc[5356](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460786, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:06:26.691494 5489 init.cc:377] Logged in from keytab as kudu/127.19.236.65@KRBTEST.COM (short username kudu)
I20260811 15:06:26.692401 5489 webserver.cc:460] Webserver started at http://127.19.236.65:46039/ using document root <none> and password file <none>
I20260811 15:06:26.693003 5489 fs_manager.cc:359] Metadata directory not provided
I20260811 15:06:26.693068 5489 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:06:26.693240 5489 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:06:26.695310 5489 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-0/data/instance:
uuid: "82a851e21fb94256845678248f310c6b"
format_stamp: "Formatted at 2026-08-11 15:06:26 on dist-test-slave-8n49"
server_key: "867a76624834415a3be315452b2416d8"
server_key_iv: "03f5d0e86332fc3c59ae05d14480f6ae"
server_key_version: "encryptionkey@0"
I20260811 15:06:26.695816 5489 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-0/wal/instance:
uuid: "82a851e21fb94256845678248f310c6b"
format_stamp: "Formatted at 2026-08-11 15:06:26 on dist-test-slave-8n49"
server_key: "867a76624834415a3be315452b2416d8"
server_key_iv: "03f5d0e86332fc3c59ae05d14480f6ae"
server_key_version: "encryptionkey@0"
I20260811 15:06:26.699695 5489 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260811 15:06:26.702153 5506 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:06:26.703404 5489 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 15:06:26.703518 5489 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-0/wal
uuid: "82a851e21fb94256845678248f310c6b"
format_stamp: "Formatted at 2026-08-11 15:06:26 on dist-test-slave-8n49"
server_key: "867a76624834415a3be315452b2416d8"
server_key_iv: "03f5d0e86332fc3c59ae05d14480f6ae"
server_key_version: "encryptionkey@0"
I20260811 15:06:26.703609 5489 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:06:26.717128 5489 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:06:26.720356 5489 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:06:26.720518 5489 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:06:26.721131 5489 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:06:26.721920 5489 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:06:26.721964 5489 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:06:26.722003 5489 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:06:26.722025 5489 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:06:26.731297 5489 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.65:42465
I20260811 15:06:26.731324 5638 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.65:42465 every 8 connection(s)
I20260811 15:06:26.732211 5489 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
I20260811 15:06:26.740371 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 5489
I20260811 15:06:26.740520 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-0/wal/instance
I20260811 15:06:26.740882 20401 external_mini_cluster.cc:1428] Setting key ac505c48621e6b7011c93f6f010e3cf2
Aug 11 15:06:26 dist-test-slave-8n49 krb5kdc[5356](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460786, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.65@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
I20260811 15:06:26.746814 5459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:26.734140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.65:46439 (local address 127.19.236.126:42765)
0811 15:06:26.734316 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0811 15:06:26.734319 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 15:06:26.735531 (+ 1212us) server_negotiation.cc:407] Connection header received
0811 15:06:26.736463 (+ 932us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:06:26.736466 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:06:26.736520 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:06:26.736666 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:06:26.737833 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:26.738416 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:26.739543 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:26.739789 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:26.739929 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:26.742719 (+ 2790us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:06:26.742725 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:06:26.742731 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:06:26.742763 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:06:26.744425 (+ 1662us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:06:26.745091 (+ 666us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:06:26.745093 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:06:26.745095 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:06:26.745170 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:06:26.745560 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:06:26.745563 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:06:26.745564 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:06:26.745733 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:06:26.745808 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 15:06:26.746415 (+ 607us) server_negotiation.cc:299] Negotiation successful
0811 15:06:26.746568 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260811 15:06:26.747483 5641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:26.734484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42765 (local address 127.19.236.65:46439)
0811 15:06:26.735374 (+ 890us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:26.735430 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0811 15:06:26.736248 (+ 818us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:06:26.736839 (+ 591us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:06:26.736846 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:06:26.737207 (+ 361us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:06:26.737678 (+ 471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:06:26.737691 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:06:26.738542 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:06:26.738546 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:06:26.739413 (+ 867us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:06:26.739422 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:06:26.739976 (+ 554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:06:26.739980 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:06:26.740148 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:26.740787 (+ 639us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:06:26.740803 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:06:26.742537 (+ 1734us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:06:26.744591 (+ 2054us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:06:26.744601 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:06:26.744617 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:06:26.744987 (+ 370us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:06:26.745265 (+ 278us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:06:26.745270 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:06:26.745274 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:06:26.745462 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:06:26.745841 (+ 379us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:06:26.745850 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:06:26.746149 (+ 299us) client_negotiation.cc:769] Sending connection context
0811 15:06:26.746328 (+ 179us) client_negotiation.cc:240] Negotiation successful
0811 15:06:26.746590 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":709,"thread_start_us":558,"threads_started":1}
I20260811 15:06:26.748996 5639 heartbeater.cc:347] Connected to a master server at 127.19.236.126:42765
I20260811 15:06:26.749284 5639 heartbeater.cc:464] Registering TS with master...
I20260811 15:06:26.749928 5639 heartbeater.cc:511] Master 127.19.236.126:42765 requested a full tablet report, sending...
I20260811 15:06:26.751525 5409 ts_manager.cc:194] Registered new tserver with Master: 82a851e21fb94256845678248f310c6b (127.19.236.65:42465)
WARNING: no policy specified for kudu/127.19.236.66@KRBTEST.COM; defaulting to no policy
I20260811 15:06:26.752826 5409 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.236.65@KRBTEST.COM'} at 127.19.236.65:46439
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.236.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.236.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.66.keytab.
Entry for principal kudu/127.19.236.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.66.keytab.
I20260811 15:06:26.771510 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.66:0
--local_ip_for_outbound_sockets=127.19.236.66
--webserver_interface=127.19.236.66
--webserver_port=0
--tserver_master_addrs=127.19.236.126:42765
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.66.keytab
--principal=kudu/127.19.236.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:43709
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:06:26.883955 5645 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:06:26.884203 5645 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:06:26.884279 5645 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:06:26.888339 5645 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:06:26.888394 5645 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:06:26.888502 5645 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.66
I20260811 15:06:26.893921 5645 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:43709
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.66.keytab
--principal=kudu/127.19.236.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.236.66
--webserver_port=0
--tserver_master_addrs=127.19.236.126:42765
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5645
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.66
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:06:26.894968 5645 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:06:26.895975 5645 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:06:26.905656 5653 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:06:26.905699 5650 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:06:26.905782 5651 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:06:26.905808 5645 server_base.cc:1034] running on GCE node
I20260811 15:06:26.906356 5645 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:06:26.907023 5645 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:06:26.908212 5645 hybrid_clock.cc:648] HybridClock initialized: now 1786460786908183 us; error 43 us; skew 500 ppm
Aug 11 15:06:26 dist-test-slave-8n49 krb5kdc[5356](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460786, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:06:26.911708 5645 init.cc:377] Logged in from keytab as kudu/127.19.236.66@KRBTEST.COM (short username kudu)
I20260811 15:06:26.912817 5645 webserver.cc:460] Webserver started at http://127.19.236.66:42199/ using document root <none> and password file <none>
I20260811 15:06:26.913407 5645 fs_manager.cc:359] Metadata directory not provided
I20260811 15:06:26.913471 5645 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:06:26.913650 5645 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:06:26.915819 5645 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-1/data/instance:
uuid: "b0fbc76c8a3147ce96b7c4dcdfec596a"
format_stamp: "Formatted at 2026-08-11 15:06:26 on dist-test-slave-8n49"
server_key: "fceb74f8afe31f1f3a2f4de14985ffc3"
server_key_iv: "9541c6c6dc638ff67cf591bc68dc7119"
server_key_version: "encryptionkey@0"
I20260811 15:06:26.916460 5645 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-1/wal/instance:
uuid: "b0fbc76c8a3147ce96b7c4dcdfec596a"
format_stamp: "Formatted at 2026-08-11 15:06:26 on dist-test-slave-8n49"
server_key: "fceb74f8afe31f1f3a2f4de14985ffc3"
server_key_iv: "9541c6c6dc638ff67cf591bc68dc7119"
server_key_version: "encryptionkey@0"
I20260811 15:06:26.920717 5645 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260811 15:06:26.923341 5661 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:06:26.924746 5645 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 15:06:26.924894 5645 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-1/wal
uuid: "b0fbc76c8a3147ce96b7c4dcdfec596a"
format_stamp: "Formatted at 2026-08-11 15:06:26 on dist-test-slave-8n49"
server_key: "fceb74f8afe31f1f3a2f4de14985ffc3"
server_key_iv: "9541c6c6dc638ff67cf591bc68dc7119"
server_key_version: "encryptionkey@0"
I20260811 15:06:26.925048 5645 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:06:26.949972 5645 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:06:26.953502 5645 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:06:26.953724 5645 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:06:26.954372 5645 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:06:26.955281 5645 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:06:26.955356 5645 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:06:26.955431 5645 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:06:26.955494 5645 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:06:26.965319 5645 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.66:34003
I20260811 15:06:26.965384 5792 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.66:34003 every 8 connection(s)
I20260811 15:06:26.966281 5645 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
I20260811 15:06:26.968541 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 5645
I20260811 15:06:26.968711 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-1/wal/instance
I20260811 15:06:26.968986 20401 external_mini_cluster.cc:1428] Setting key d6c15ed285c93535100567cb63afd5e9
Aug 11 15:06:26 dist-test-slave-8n49 krb5kdc[5356](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460786, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.66@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.19.236.67@KRBTEST.COM; defaulting to no policy
I20260811 15:06:26.981280 5459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:26.968093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.66:39775 (local address 127.19.236.126:42765)
0811 15:06:26.968235 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0811 15:06:26.968238 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 15:06:26.969133 (+ 895us) server_negotiation.cc:407] Connection header received
0811 15:06:26.970741 (+ 1608us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:06:26.970745 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:06:26.970809 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:06:26.970906 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:06:26.972103 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:26.972872 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:26.974225 (+ 1353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:26.974448 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:26.974533 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:26.977496 (+ 2963us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:06:26.977502 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:06:26.977510 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:06:26.977534 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:06:26.979021 (+ 1487us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:06:26.979562 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:06:26.979570 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:06:26.979572 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:06:26.979649 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:06:26.980030 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:06:26.980033 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:06:26.980035 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:06:26.980234 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:06:26.980349 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0811 15:06:26.980958 (+ 609us) server_negotiation.cc:299] Negotiation successful
0811 15:06:26.981102 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.236.67@KRBTEST.COM" created.
I20260811 15:06:26.982291 5795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:26.968421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42765 (local address 127.19.236.66:39775)
0811 15:06:26.968982 (+ 561us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:26.969035 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 15:06:26.970539 (+ 1504us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:06:26.971086 (+ 547us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:06:26.971093 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:06:26.971439 (+ 346us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:06:26.971922 (+ 483us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:06:26.971936 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:06:26.973005 (+ 1069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:06:26.973009 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:06:26.974096 (+ 1087us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:06:26.974112 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:06:26.974619 (+ 507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:06:26.974626 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:06:26.974867 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:26.975529 (+ 662us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:06:26.975559 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:06:26.977316 (+ 1757us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:06:26.979157 (+ 1841us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:06:26.979163 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:06:26.979179 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:06:26.979446 (+ 267us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:06:26.979746 (+ 300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:06:26.979749 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:06:26.979751 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:06:26.979925 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:06:26.980348 (+ 423us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:06:26.980357 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:06:26.980712 (+ 355us) client_negotiation.cc:769] Sending connection context
0811 15:06:26.980913 (+ 201us) client_negotiation.cc:240] Negotiation successful
0811 15:06:26.981245 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":361,"thread_start_us":196,"threads_started":1}
I20260811 15:06:26.983572 5793 heartbeater.cc:347] Connected to a master server at 127.19.236.126:42765
I20260811 15:06:26.983829 5793 heartbeater.cc:464] Registering TS with master...
I20260811 15:06:26.984434 5793 heartbeater.cc:511] Master 127.19.236.126:42765 requested a full tablet report, sending...
I20260811 15:06:26.985725 5409 ts_manager.cc:194] Registered new tserver with Master: b0fbc76c8a3147ce96b7c4dcdfec596a (127.19.236.66:34003)
I20260811 15:06:26.986313 5409 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.236.66@KRBTEST.COM'} at 127.19.236.66:39775
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.236.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.67.keytab.
Entry for principal kudu/127.19.236.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.67.keytab.
I20260811 15:06:26.999294 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.67:0
--local_ip_for_outbound_sockets=127.19.236.67
--webserver_interface=127.19.236.67
--webserver_port=0
--tserver_master_addrs=127.19.236.126:42765
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.67.keytab
--principal=kudu/127.19.236.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:43709
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:06:27.116575 5798 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:06:27.116917 5798 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:06:27.116968 5798 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:06:27.121147 5798 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:06:27.121207 5798 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:06:27.121266 5798 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.67
I20260811 15:06:27.126621 5798 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:43709
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.67.keytab
--principal=kudu/127.19.236.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.236.67
--webserver_port=0
--tserver_master_addrs=127.19.236.126:42765
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5798
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.67
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:06:27.127688 5798 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:06:27.128757 5798 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:06:27.138705 5803 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:06:27.138839 5798 server_base.cc:1034] running on GCE node
W20260811 15:06:27.138715 5806 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:06:27.138731 5804 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:06:27.139405 5798 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:06:27.140139 5798 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:06:27.141335 5798 hybrid_clock.cc:648] HybridClock initialized: now 1786460787141295 us; error 50 us; skew 500 ppm
Aug 11 15:06:27 dist-test-slave-8n49 krb5kdc[5356](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460787, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:06:27.144372 5798 init.cc:377] Logged in from keytab as kudu/127.19.236.67@KRBTEST.COM (short username kudu)
I20260811 15:06:27.145393 5798 webserver.cc:460] Webserver started at http://127.19.236.67:46151/ using document root <none> and password file <none>
I20260811 15:06:27.146005 5798 fs_manager.cc:359] Metadata directory not provided
I20260811 15:06:27.146102 5798 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:06:27.146351 5798 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:06:27.148470 5798 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-2/data/instance:
uuid: "86273d33275e487f93e29fc595be3a21"
format_stamp: "Formatted at 2026-08-11 15:06:27 on dist-test-slave-8n49"
server_key: "ec5747d009020fae3a82bba9247e1413"
server_key_iv: "b4f6c907d3f14458b2245c9f88e5c18b"
server_key_version: "encryptionkey@0"
I20260811 15:06:27.149124 5798 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-2/wal/instance:
uuid: "86273d33275e487f93e29fc595be3a21"
format_stamp: "Formatted at 2026-08-11 15:06:27 on dist-test-slave-8n49"
server_key: "ec5747d009020fae3a82bba9247e1413"
server_key_iv: "b4f6c907d3f14458b2245c9f88e5c18b"
server_key_version: "encryptionkey@0"
I20260811 15:06:27.153105 5798 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260811 15:06:27.155700 5814 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:06:27.157269 5798 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 15:06:27.157424 5798 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-2/wal
uuid: "86273d33275e487f93e29fc595be3a21"
format_stamp: "Formatted at 2026-08-11 15:06:27 on dist-test-slave-8n49"
server_key: "ec5747d009020fae3a82bba9247e1413"
server_key_iv: "b4f6c907d3f14458b2245c9f88e5c18b"
server_key_version: "encryptionkey@0"
I20260811 15:06:27.157552 5798 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:06:27.175613 5798 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:06:27.179152 5798 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:06:27.179378 5798 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:06:27.180028 5798 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:06:27.180925 5798 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:06:27.181000 5798 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:06:27.181077 5798 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:06:27.181131 5798 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:06:27.189967 5798 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.67:37905
I20260811 15:06:27.189993 5948 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.67:37905 every 8 connection(s)
I20260811 15:06:27.190842 5798 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
I20260811 15:06:27.197116 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 5798
I20260811 15:06:27.197252 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-2/wal/instance
I20260811 15:06:27.197561 20401 external_mini_cluster.cc:1428] Setting key c67d6dfa2328258410a891830e543e39
Aug 11 15:06:27 dist-test-slave-8n49 krb5kdc[5356](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460787, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.67@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
I20260811 15:06:27.205147 5459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:27.192720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.67:43033 (local address 127.19.236.126:42765)
0811 15:06:27.192875 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0811 15:06:27.192879 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:06:27.193757 (+ 878us) server_negotiation.cc:407] Connection header received
0811 15:06:27.195136 (+ 1379us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:06:27.195140 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:06:27.195199 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:06:27.195315 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:06:27.196582 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:27.197153 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:27.198697 (+ 1544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:27.198928 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:27.199044 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:27.201570 (+ 2526us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:06:27.201574 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:06:27.201577 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:06:27.201607 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:06:27.202976 (+ 1369us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:06:27.203507 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:06:27.203511 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:06:27.203513 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:06:27.203598 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:06:27.203970 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:06:27.203974 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:06:27.203976 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:06:27.204168 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:06:27.204284 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0811 15:06:27.204848 (+ 564us) server_negotiation.cc:299] Negotiation successful
0811 15:06:27.204976 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 15:06:27.205940 5951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:27.193095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42765 (local address 127.19.236.67:43033)
0811 15:06:27.193609 (+ 514us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:27.193650 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 15:06:27.194916 (+ 1266us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:06:27.195488 (+ 572us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:06:27.195495 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:06:27.195945 (+ 450us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:06:27.196410 (+ 465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:06:27.196425 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:06:27.197287 (+ 862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:06:27.197291 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:06:27.198563 (+ 1272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:06:27.198574 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:06:27.199085 (+ 511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:06:27.199090 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:06:27.199280 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:27.199908 (+ 628us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:06:27.199931 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:06:27.201401 (+ 1470us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:06:27.203108 (+ 1707us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:06:27.203114 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:06:27.203128 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:06:27.203391 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:06:27.203697 (+ 306us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:06:27.203701 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:06:27.203703 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:06:27.203848 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:06:27.204285 (+ 437us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:06:27.204292 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:06:27.204542 (+ 250us) client_negotiation.cc:769] Sending connection context
0811 15:06:27.204803 (+ 261us) client_negotiation.cc:240] Negotiation successful
0811 15:06:27.205131 (+ 328us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":328,"thread_start_us":169,"threads_started":1}
I20260811 15:06:27.207043 5949 heartbeater.cc:347] Connected to a master server at 127.19.236.126:42765
I20260811 15:06:27.207278 5949 heartbeater.cc:464] Registering TS with master...
I20260811 15:06:27.207729 5949 heartbeater.cc:511] Master 127.19.236.126:42765 requested a full tablet report, sending...
I20260811 15:06:27.208786 5409 ts_manager.cc:194] Registered new tserver with Master: 86273d33275e487f93e29fc595be3a21 (127.19.236.67:37905)
I20260811 15:06:27.209395 5409 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.236.67@KRBTEST.COM'} at 127.19.236.67:43033
I20260811 15:06:27.211373 20401 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 15:06:27.220808 5459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:27.213466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55158 (local address 127.19.236.126:42765)
0811 15:06:27.213605 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0811 15:06:27.213608 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 15:06:27.213830 (+ 222us) server_negotiation.cc:407] Connection header received
0811 15:06:27.213911 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:06:27.213913 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:06:27.213947 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:06:27.214014 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:06:27.214685 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:27.215166 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:27.215972 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:27.216173 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:27.216248 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:27.217670 (+ 1422us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:06:27.217673 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:06:27.217675 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:06:27.217696 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:06:27.219163 (+ 1467us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:06:27.219577 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:06:27.219580 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:06:27.219581 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:06:27.219655 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:06:27.219933 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:06:27.219936 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:06:27.219937 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:06:27.220166 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:06:27.220283 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0811 15:06:27.220519 (+ 236us) server_negotiation.cc:299] Negotiation successful
0811 15:06:27.220691 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260811 15:06:27.223594 5409 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55158:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 15:06:27.226754 5409 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 15:06:27.241619 5961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:27.235218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.65:42465 (local address 127.0.0.1:36944)
0811 15:06:27.236282 (+ 1064us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:27.236335 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 15:06:27.236490 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:06:27.237335 (+ 845us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:06:27.237342 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:06:27.237377 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:06:27.237634 (+ 257us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:06:27.237642 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:06:27.238695 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:06:27.238701 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:06:27.239881 (+ 1180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:06:27.239891 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:06:27.241022 (+ 1131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:06:27.241026 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:06:27.241140 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:27.241200 (+ 60us) client_negotiation.cc:769] Sending connection context
0811 15:06:27.241330 (+ 130us) client_negotiation.cc:240] Negotiation successful
0811 15:06:27.241460 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":924,"mutex_wait_us":105,"spinlock_wait_cycles":15360,"thread_start_us":98,"threads_started":1}
I20260811 15:06:27.241663 5963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:27.235428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36944 (local address 127.19.236.65:42465)
0811 15:06:27.236071 (+ 643us) server_negotiation.cc:206] Beginning negotiation
0811 15:06:27.236087 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 15:06:27.236431 (+ 344us) server_negotiation.cc:407] Connection header received
0811 15:06:27.236772 (+ 341us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:06:27.236778 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:06:27.236985 (+ 207us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:06:27.237140 (+ 155us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:06:27.237749 (+ 609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:27.238544 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:27.240014 (+ 1470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:27.240882 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:27.241007 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:27.241170 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0811 15:06:27.241363 (+ 193us) server_negotiation.cc:299] Negotiation successful
0811 15:06:27.241463 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":533,"thread_start_us":125,"threads_started":1}
I20260811 15:06:27.241981 5967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:27.236081 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42810 (local address 127.19.236.67:37905)
0811 15:06:27.236801 (+ 720us) server_negotiation.cc:206] Beginning negotiation
0811 15:06:27.236817 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 15:06:27.237045 (+ 228us) server_negotiation.cc:407] Connection header received
0811 15:06:27.237213 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:06:27.237219 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:06:27.237371 (+ 152us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:06:27.237528 (+ 157us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:06:27.237856 (+ 328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:27.238588 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:27.240227 (+ 1639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:27.241029 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:27.241140 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:27.241262 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0811 15:06:27.241693 (+ 431us) server_negotiation.cc:299] Negotiation successful
0811 15:06:27.241868 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":620,"thread_start_us":154,"threads_started":1}
I20260811 15:06:27.242342 5966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:27.235897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.67:37905 (local address 127.0.0.1:42810)
0811 15:06:27.236936 (+ 1039us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:27.236947 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 15:06:27.237071 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:06:27.237510 (+ 439us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:06:27.237513 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:06:27.237532 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:06:27.237679 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:06:27.237685 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:06:27.238772 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:06:27.238778 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:06:27.240070 (+ 1292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:06:27.240083 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:06:27.241351 (+ 1268us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:06:27.241355 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:06:27.241441 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:27.241463 (+ 22us) client_negotiation.cc:769] Sending connection context
0811 15:06:27.241538 (+ 75us) client_negotiation.cc:240] Negotiation successful
0811 15:06:27.241609 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":988,"mutex_wait_us":59,"thread_start_us":86,"threads_started":1}
I20260811 15:06:27.242753 5962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:27.235113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.66:34003 (local address 127.0.0.1:54918)
0811 15:06:27.236282 (+ 1169us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:27.236335 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 15:06:27.236490 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:06:27.237335 (+ 845us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:06:27.237342 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:06:27.237376 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:06:27.237634 (+ 258us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:06:27.237642 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:06:27.240242 (+ 2600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:06:27.240247 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:06:27.241085 (+ 838us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:06:27.241094 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:06:27.242383 (+ 1289us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:06:27.242388 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:06:27.242475 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:27.242496 (+ 21us) client_negotiation.cc:769] Sending connection context
0811 15:06:27.242567 (+ 71us) client_negotiation.cc:240] Negotiation successful
0811 15:06:27.242629 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":787,"mutex_wait_us":54,"spinlock_wait_cycles":5760,"thread_start_us":129,"threads_started":1}
I20260811 15:06:27.243178 5964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:27.235606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54918 (local address 127.19.236.66:34003)
0811 15:06:27.236018 (+ 412us) server_negotiation.cc:206] Beginning negotiation
0811 15:06:27.236030 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 15:06:27.236493 (+ 463us) server_negotiation.cc:407] Connection header received
0811 15:06:27.236772 (+ 279us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:06:27.236778 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:06:27.236985 (+ 207us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:06:27.237140 (+ 155us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:06:27.238689 (+ 1549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:27.240099 (+ 1410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:27.241227 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:27.242057 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:27.242174 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:27.242315 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0811 15:06:27.242939 (+ 624us) server_negotiation.cc:299] Negotiation successful
0811 15:06:27.243036 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":307,"thread_start_us":93,"threads_started":1}
I20260811 15:06:27.244874 5563 tablet_service.cc:1467] Processing CreateTablet for tablet fe4d458820174582b03e6af4f7bd896d (DEFAULT_TABLE table=test-table [id=4c0df3f4d44e4e4dbe9e9658881ae47a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:06:27.244901 5870 tablet_service.cc:1467] Processing CreateTablet for tablet fe4d458820174582b03e6af4f7bd896d (DEFAULT_TABLE table=test-table [id=4c0df3f4d44e4e4dbe9e9658881ae47a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:06:27.245926 5870 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fe4d458820174582b03e6af4f7bd896d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:06:27.245939 5563 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fe4d458820174582b03e6af4f7bd896d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:06:27.247324 5717 tablet_service.cc:1467] Processing CreateTablet for tablet fe4d458820174582b03e6af4f7bd896d (DEFAULT_TABLE table=test-table [id=4c0df3f4d44e4e4dbe9e9658881ae47a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:06:27.248396 5717 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fe4d458820174582b03e6af4f7bd896d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:06:27.252538 5968 tablet_bootstrap.cc:492] T fe4d458820174582b03e6af4f7bd896d P 86273d33275e487f93e29fc595be3a21: Bootstrap starting.
I20260811 15:06:27.255200 5970 tablet_bootstrap.cc:492] T fe4d458820174582b03e6af4f7bd896d P b0fbc76c8a3147ce96b7c4dcdfec596a: Bootstrap starting.
I20260811 15:06:27.255724 5969 tablet_bootstrap.cc:492] T fe4d458820174582b03e6af4f7bd896d P 82a851e21fb94256845678248f310c6b: Bootstrap starting.
I20260811 15:06:27.256045 5968 tablet_bootstrap.cc:654] T fe4d458820174582b03e6af4f7bd896d P 86273d33275e487f93e29fc595be3a21: Neither blocks nor log segments found. Creating new log.
I20260811 15:06:27.256861 5968 log.cc:824] T fe4d458820174582b03e6af4f7bd896d P 86273d33275e487f93e29fc595be3a21: Log is configured to *not* fsync() on all Append() calls
I20260811 15:06:27.257766 5970 tablet_bootstrap.cc:654] T fe4d458820174582b03e6af4f7bd896d P b0fbc76c8a3147ce96b7c4dcdfec596a: Neither blocks nor log segments found. Creating new log.
I20260811 15:06:27.257849 5969 tablet_bootstrap.cc:654] T fe4d458820174582b03e6af4f7bd896d P 82a851e21fb94256845678248f310c6b: Neither blocks nor log segments found. Creating new log.
I20260811 15:06:27.258646 5970 log.cc:824] T fe4d458820174582b03e6af4f7bd896d P b0fbc76c8a3147ce96b7c4dcdfec596a: Log is configured to *not* fsync() on all Append() calls
I20260811 15:06:27.258644 5969 log.cc:824] T fe4d458820174582b03e6af4f7bd896d P 82a851e21fb94256845678248f310c6b: Log is configured to *not* fsync() on all Append() calls
I20260811 15:06:27.258831 5968 tablet_bootstrap.cc:492] T fe4d458820174582b03e6af4f7bd896d P 86273d33275e487f93e29fc595be3a21: No bootstrap required, opened a new log
I20260811 15:06:27.259014 5968 ts_tablet_manager.cc:1397] T fe4d458820174582b03e6af4f7bd896d P 86273d33275e487f93e29fc595be3a21: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260811 15:06:27.260602 5970 tablet_bootstrap.cc:492] T fe4d458820174582b03e6af4f7bd896d P b0fbc76c8a3147ce96b7c4dcdfec596a: No bootstrap required, opened a new log
I20260811 15:06:27.260792 5970 ts_tablet_manager.cc:1397] T fe4d458820174582b03e6af4f7bd896d P b0fbc76c8a3147ce96b7c4dcdfec596a: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260811 15:06:27.261505 5969 tablet_bootstrap.cc:492] T fe4d458820174582b03e6af4f7bd896d P 82a851e21fb94256845678248f310c6b: No bootstrap required, opened a new log
I20260811 15:06:27.261708 5969 ts_tablet_manager.cc:1397] T fe4d458820174582b03e6af4f7bd896d P 82a851e21fb94256845678248f310c6b: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.003s
I20260811 15:06:27.262977 5968 raft_consensus.cc:348] T fe4d458820174582b03e6af4f7bd896d P 86273d33275e487f93e29fc595be3a21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0fbc76c8a3147ce96b7c4dcdfec596a" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 34003 } } peers { permanent_uuid: "82a851e21fb94256845678248f310c6b" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 42465 } } peers { permanent_uuid: "86273d33275e487f93e29fc595be3a21" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37905 } }
I20260811 15:06:27.263343 5968 raft_consensus.cc:374] T fe4d458820174582b03e6af4f7bd896d P 86273d33275e487f93e29fc595be3a21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:06:27.263412 5968 raft_consensus.cc:729] T fe4d458820174582b03e6af4f7bd896d P 86273d33275e487f93e29fc595be3a21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86273d33275e487f93e29fc595be3a21, State: Initialized, Role: FOLLOWER
I20260811 15:06:27.263895 5968 consensus_queue.cc:260] T fe4d458820174582b03e6af4f7bd896d P 86273d33275e487f93e29fc595be3a21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0fbc76c8a3147ce96b7c4dcdfec596a" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 34003 } } peers { permanent_uuid: "82a851e21fb94256845678248f310c6b" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 42465 } } peers { permanent_uuid: "86273d33275e487f93e29fc595be3a21" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37905 } }
I20260811 15:06:27.264490 5970 raft_consensus.cc:348] T fe4d458820174582b03e6af4f7bd896d P b0fbc76c8a3147ce96b7c4dcdfec596a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0fbc76c8a3147ce96b7c4dcdfec596a" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 34003 } } peers { permanent_uuid: "82a851e21fb94256845678248f310c6b" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 42465 } } peers { permanent_uuid: "86273d33275e487f93e29fc595be3a21" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37905 } }
I20260811 15:06:27.264703 5949 heartbeater.cc:503] Master 127.19.236.126:42765 was elected leader, sending a full tablet report...
I20260811 15:06:27.264782 5970 raft_consensus.cc:374] T fe4d458820174582b03e6af4f7bd896d P b0fbc76c8a3147ce96b7c4dcdfec596a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:06:27.264842 5970 raft_consensus.cc:729] T fe4d458820174582b03e6af4f7bd896d P b0fbc76c8a3147ce96b7c4dcdfec596a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0fbc76c8a3147ce96b7c4dcdfec596a, State: Initialized, Role: FOLLOWER
I20260811 15:06:27.264951 5968 ts_tablet_manager.cc:1428] T fe4d458820174582b03e6af4f7bd896d P 86273d33275e487f93e29fc595be3a21: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260811 15:06:27.265228 5970 consensus_queue.cc:260] T fe4d458820174582b03e6af4f7bd896d P b0fbc76c8a3147ce96b7c4dcdfec596a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0fbc76c8a3147ce96b7c4dcdfec596a" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 34003 } } peers { permanent_uuid: "82a851e21fb94256845678248f310c6b" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 42465 } } peers { permanent_uuid: "86273d33275e487f93e29fc595be3a21" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37905 } }
I20260811 15:06:27.265853 5969 raft_consensus.cc:348] T fe4d458820174582b03e6af4f7bd896d P 82a851e21fb94256845678248f310c6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0fbc76c8a3147ce96b7c4dcdfec596a" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 34003 } } peers { permanent_uuid: "82a851e21fb94256845678248f310c6b" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 42465 } } peers { permanent_uuid: "86273d33275e487f93e29fc595be3a21" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37905 } }
I20260811 15:06:27.266093 5969 raft_consensus.cc:374] T fe4d458820174582b03e6af4f7bd896d P 82a851e21fb94256845678248f310c6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:06:27.266124 5793 heartbeater.cc:503] Master 127.19.236.126:42765 was elected leader, sending a full tablet report...
I20260811 15:06:27.266146 5969 raft_consensus.cc:729] T fe4d458820174582b03e6af4f7bd896d P 82a851e21fb94256845678248f310c6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82a851e21fb94256845678248f310c6b, State: Initialized, Role: FOLLOWER
I20260811 15:06:27.266360 5970 ts_tablet_manager.cc:1428] T fe4d458820174582b03e6af4f7bd896d P b0fbc76c8a3147ce96b7c4dcdfec596a: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260811 15:06:27.266572 5969 consensus_queue.cc:260] T fe4d458820174582b03e6af4f7bd896d P 82a851e21fb94256845678248f310c6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0fbc76c8a3147ce96b7c4dcdfec596a" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 34003 } } peers { permanent_uuid: "82a851e21fb94256845678248f310c6b" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 42465 } } peers { permanent_uuid: "86273d33275e487f93e29fc595be3a21" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37905 } }
I20260811 15:06:27.267222 5639 heartbeater.cc:503] Master 127.19.236.126:42765 was elected leader, sending a full tablet report...
I20260811 15:06:27.267437 5969 ts_tablet_manager.cc:1428] T fe4d458820174582b03e6af4f7bd896d P 82a851e21fb94256845678248f310c6b: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260811 15:06:27.354130 5975 raft_consensus.cc:482] T fe4d458820174582b03e6af4f7bd896d P b0fbc76c8a3147ce96b7c4dcdfec596a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 15:06:27.354449 5975 raft_consensus.cc:504] T fe4d458820174582b03e6af4f7bd896d P b0fbc76c8a3147ce96b7c4dcdfec596a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0fbc76c8a3147ce96b7c4dcdfec596a" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 34003 } } peers { permanent_uuid: "82a851e21fb94256845678248f310c6b" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 42465 } } peers { permanent_uuid: "86273d33275e487f93e29fc595be3a21" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37905 } }
I20260811 15:06:27.355705 5975 leader_election.cc:288] T fe4d458820174582b03e6af4f7bd896d P b0fbc76c8a3147ce96b7c4dcdfec596a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82a851e21fb94256845678248f310c6b (127.19.236.65:42465), 86273d33275e487f93e29fc595be3a21 (127.19.236.67:37905)
I20260811 15:06:27.360137 5795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:27.356050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.67:37905 (local address 127.19.236.66:47487)
0811 15:06:27.356323 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:27.356341 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 15:06:27.356453 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:06:27.356848 (+ 395us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:06:27.356851 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:06:27.356871 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:06:27.357000 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:06:27.357005 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:06:27.357806 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:06:27.357811 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:06:27.358937 (+ 1126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:06:27.358952 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:06:27.359797 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:06:27.359800 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:06:27.359883 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:27.359905 (+ 22us) client_negotiation.cc:769] Sending connection context
0811 15:06:27.359966 (+ 61us) client_negotiation.cc:240] Negotiation successful
0811 15:06:27.360025 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":201,"mutex_wait_us":24}
I20260811 15:06:27.360244 5967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:27.356192 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.66:47487 (local address 127.19.236.67:37905)
0811 15:06:27.356344 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0811 15:06:27.356348 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:06:27.356398 (+ 50us) server_negotiation.cc:407] Connection header received
0811 15:06:27.356644 (+ 246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:06:27.356650 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:06:27.356709 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:06:27.356831 (+ 122us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:06:27.357128 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:27.357681 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:27.359055 (+ 1374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:27.359665 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:27.359795 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:27.359849 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 15:06:27.360011 (+ 162us) server_negotiation.cc:299] Negotiation successful
0811 15:06:27.360091 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 15:06:27.360420 5978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:27.356051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.65:42465 (local address 127.19.236.66:33857)
0811 15:06:27.356531 (+ 480us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:27.356569 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 15:06:27.356682 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:06:27.356964 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:06:27.356967 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:06:27.356984 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:06:27.357122 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:06:27.357127 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:06:27.357855 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:06:27.357859 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:06:27.358955 (+ 1096us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:06:27.358967 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:06:27.359973 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:06:27.359978 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:06:27.360089 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:27.360111 (+ 22us) client_negotiation.cc:769] Sending connection context
0811 15:06:27.360188 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 15:06:27.360249 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":408,"mutex_wait_us":128,"thread_start_us":159,"threads_started":1}
I20260811 15:06:27.360469 5963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:27.356184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.66:33857 (local address 127.19.236.65:42465)
0811 15:06:27.356314 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0811 15:06:27.356319 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:06:27.356658 (+ 339us) server_negotiation.cc:407] Connection header received
0811 15:06:27.356817 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:06:27.356820 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:06:27.356864 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:06:27.356949 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:06:27.357231 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:27.357738 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:27.359111 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:27.359731 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:27.359813 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:27.359854 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0811 15:06:27.360244 (+ 390us) server_negotiation.cc:299] Negotiation successful
0811 15:06:27.360337 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 15:06:27.361138 5585 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe4d458820174582b03e6af4f7bd896d" candidate_uuid: "b0fbc76c8a3147ce96b7c4dcdfec596a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82a851e21fb94256845678248f310c6b" is_pre_election: true
I20260811 15:06:27.361131 5893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe4d458820174582b03e6af4f7bd896d" candidate_uuid: "b0fbc76c8a3147ce96b7c4dcdfec596a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86273d33275e487f93e29fc595be3a21" is_pre_election: true
I20260811 15:06:27.361476 5585 raft_consensus.cc:2454] T fe4d458820174582b03e6af4f7bd896d P 82a851e21fb94256845678248f310c6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0fbc76c8a3147ce96b7c4dcdfec596a in term 0.
I20260811 15:06:27.361478 5893 raft_consensus.cc:2454] T fe4d458820174582b03e6af4f7bd896d P 86273d33275e487f93e29fc595be3a21 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0fbc76c8a3147ce96b7c4dcdfec596a in term 0.
I20260811 15:06:27.362005 5665 leader_election.cc:302] T fe4d458820174582b03e6af4f7bd896d P b0fbc76c8a3147ce96b7c4dcdfec596a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 82a851e21fb94256845678248f310c6b, 86273d33275e487f93e29fc595be3a21, b0fbc76c8a3147ce96b7c4dcdfec596a; no voters:
I20260811 15:06:27.362270 5975 raft_consensus.cc:2781] T fe4d458820174582b03e6af4f7bd896d P b0fbc76c8a3147ce96b7c4dcdfec596a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 15:06:27.362368 5975 raft_consensus.cc:482] T fe4d458820174582b03e6af4f7bd896d P b0fbc76c8a3147ce96b7c4dcdfec596a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 15:06:27.362493 5975 raft_consensus.cc:3037] T fe4d458820174582b03e6af4f7bd896d P b0fbc76c8a3147ce96b7c4dcdfec596a [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:06:27.363732 5975 raft_consensus.cc:504] T fe4d458820174582b03e6af4f7bd896d P b0fbc76c8a3147ce96b7c4dcdfec596a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0fbc76c8a3147ce96b7c4dcdfec596a" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 34003 } } peers { permanent_uuid: "82a851e21fb94256845678248f310c6b" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 42465 } } peers { permanent_uuid: "86273d33275e487f93e29fc595be3a21" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37905 } }
I20260811 15:06:27.364120 5975 leader_election.cc:288] T fe4d458820174582b03e6af4f7bd896d P b0fbc76c8a3147ce96b7c4dcdfec596a [CANDIDATE]: Term 1 election: Requested vote from peers 82a851e21fb94256845678248f310c6b (127.19.236.65:42465), 86273d33275e487f93e29fc595be3a21 (127.19.236.67:37905)
I20260811 15:06:27.364547 5893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe4d458820174582b03e6af4f7bd896d" candidate_uuid: "b0fbc76c8a3147ce96b7c4dcdfec596a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86273d33275e487f93e29fc595be3a21"
I20260811 15:06:27.364697 5585 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe4d458820174582b03e6af4f7bd896d" candidate_uuid: "b0fbc76c8a3147ce96b7c4dcdfec596a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82a851e21fb94256845678248f310c6b"
I20260811 15:06:27.364746 5893 raft_consensus.cc:3037] T fe4d458820174582b03e6af4f7bd896d P 86273d33275e487f93e29fc595be3a21 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:06:27.364859 5585 raft_consensus.cc:3037] T fe4d458820174582b03e6af4f7bd896d P 82a851e21fb94256845678248f310c6b [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:06:27.365870 5893 raft_consensus.cc:2454] T fe4d458820174582b03e6af4f7bd896d P 86273d33275e487f93e29fc595be3a21 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0fbc76c8a3147ce96b7c4dcdfec596a in term 1.
I20260811 15:06:27.365896 5585 raft_consensus.cc:2454] T fe4d458820174582b03e6af4f7bd896d P 82a851e21fb94256845678248f310c6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0fbc76c8a3147ce96b7c4dcdfec596a in term 1.
I20260811 15:06:27.366201 5663 leader_election.cc:302] T fe4d458820174582b03e6af4f7bd896d P b0fbc76c8a3147ce96b7c4dcdfec596a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86273d33275e487f93e29fc595be3a21, b0fbc76c8a3147ce96b7c4dcdfec596a; no voters:
I20260811 15:06:27.366400 5975 raft_consensus.cc:2781] T fe4d458820174582b03e6af4f7bd896d P b0fbc76c8a3147ce96b7c4dcdfec596a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:06:27.366621 5975 raft_consensus.cc:686] T fe4d458820174582b03e6af4f7bd896d P b0fbc76c8a3147ce96b7c4dcdfec596a [term 1 LEADER]: Becoming Leader. State: Replica: b0fbc76c8a3147ce96b7c4dcdfec596a, State: Running, Role: LEADER
I20260811 15:06:27.366986 5975 consensus_queue.cc:237] T fe4d458820174582b03e6af4f7bd896d P b0fbc76c8a3147ce96b7c4dcdfec596a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0fbc76c8a3147ce96b7c4dcdfec596a" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 34003 } } peers { permanent_uuid: "82a851e21fb94256845678248f310c6b" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 42465 } } peers { permanent_uuid: "86273d33275e487f93e29fc595be3a21" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37905 } }
I20260811 15:06:27.370661 5407 catalog_manager.cc:5495] T fe4d458820174582b03e6af4f7bd896d P b0fbc76c8a3147ce96b7c4dcdfec596a reported cstate change: term changed from 0 to 1, leader changed from <none> to b0fbc76c8a3147ce96b7c4dcdfec596a (127.19.236.66). New cstate: current_term: 1 leader_uuid: "b0fbc76c8a3147ce96b7c4dcdfec596a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0fbc76c8a3147ce96b7c4dcdfec596a" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 34003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "82a851e21fb94256845678248f310c6b" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 42465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86273d33275e487f93e29fc595be3a21" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37905 } health_report { overall_health: UNKNOWN } } }
I20260811 15:06:27.397233 5964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:27.393537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54924 (local address 127.19.236.66:34003)
0811 15:06:27.393719 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0811 15:06:27.393725 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 15:06:27.393741 (+ 16us) server_negotiation.cc:407] Connection header received
0811 15:06:27.393827 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:06:27.393830 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:06:27.393886 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:06:27.393997 (+ 111us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 15:06:27.394267 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:27.394782 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:27.395638 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:27.395897 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:27.395996 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:27.396351 (+ 355us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 15:06:27.396857 (+ 506us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 15:06:27.396970 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0811 15:06:27.397043 (+ 73us) server_negotiation.cc:299] Negotiation successful
0811 15:06:27.397100 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 15:06:27.403219 5893 raft_consensus.cc:1261] T fe4d458820174582b03e6af4f7bd896d P 86273d33275e487f93e29fc595be3a21 [term 1 FOLLOWER]: Refusing update from remote peer b0fbc76c8a3147ce96b7c4dcdfec596a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:06:27.403250 5585 raft_consensus.cc:1261] T fe4d458820174582b03e6af4f7bd896d P 82a851e21fb94256845678248f310c6b [term 1 FOLLOWER]: Refusing update from remote peer b0fbc76c8a3147ce96b7c4dcdfec596a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:06:27.403986 5979 consensus_queue.cc:1035] T fe4d458820174582b03e6af4f7bd896d P b0fbc76c8a3147ce96b7c4dcdfec596a [LEADER]: Connected to new peer: Peer: permanent_uuid: "86273d33275e487f93e29fc595be3a21" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:06:27.404179 5975 consensus_queue.cc:1035] T fe4d458820174582b03e6af4f7bd896d P b0fbc76c8a3147ce96b7c4dcdfec596a [LEADER]: Connected to new peer: Peer: permanent_uuid: "82a851e21fb94256845678248f310c6b" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 42465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:06:27.412817 5985 mvcc.cc:205] Tried to move back new op lower bound from 7317343385196195840 to 7317343385058050048. Current Snapshot: MvccSnapshot[applied={T|T < 7317343385196195840}]
I20260811 15:06:27.413009 5984 mvcc.cc:205] Tried to move back new op lower bound from 7317343385196195840 to 7317343385058050048. Current Snapshot: MvccSnapshot[applied={T|T < 7317343385196195840}]
I20260811 15:06:27.419806 5409 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55158:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 15:06:27.419991 5409 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55158:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 15:06:27.422513 5409 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bbac445142d44bb88e8007cbf65f9397: Sending DeleteTablet for 3 replicas of tablet fe4d458820174582b03e6af4f7bd896d
I20260811 15:06:27.423300 5717 tablet_service.cc:1514] Processing DeleteTablet for tablet fe4d458820174582b03e6af4f7bd896d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:06:27 UTC) from {username='kudu', principal='kudu/127.19.236.126@KRBTEST.COM'} at 127.0.0.1:54918
I20260811 15:06:27.423346 5563 tablet_service.cc:1514] Processing DeleteTablet for tablet fe4d458820174582b03e6af4f7bd896d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:06:27 UTC) from {username='kudu', principal='kudu/127.19.236.126@KRBTEST.COM'} at 127.0.0.1:36944
I20260811 15:06:27.423460 5870 tablet_service.cc:1514] Processing DeleteTablet for tablet fe4d458820174582b03e6af4f7bd896d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:06:27 UTC) from {username='kudu', principal='kudu/127.19.236.126@KRBTEST.COM'} at 127.0.0.1:42810
I20260811 15:06:27.423885 5994 tablet_replica.cc:330] T fe4d458820174582b03e6af4f7bd896d P 82a851e21fb94256845678248f310c6b: stopping tablet replica
I20260811 15:06:27.424139 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 5489
I20260811 15:06:27.424258 5994 raft_consensus.cc:2229] T fe4d458820174582b03e6af4f7bd896d P 82a851e21fb94256845678248f310c6b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 15:06:27.425559 5995 tablet_replica.cc:330] T fe4d458820174582b03e6af4f7bd896d P 86273d33275e487f93e29fc595be3a21: stopping tablet replica
I20260811 15:06:27.425962 5995 raft_consensus.cc:2229] T fe4d458820174582b03e6af4f7bd896d P 86273d33275e487f93e29fc595be3a21 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 15:06:27.427404 5995 raft_consensus.cc:2258] T fe4d458820174582b03e6af4f7bd896d P 86273d33275e487f93e29fc595be3a21 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:06:27.429397 5995 ts_tablet_manager.cc:1905] T fe4d458820174582b03e6af4f7bd896d P 86273d33275e487f93e29fc595be3a21: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 15:06:27.430451 5993 tablet_replica.cc:330] T fe4d458820174582b03e6af4f7bd896d P b0fbc76c8a3147ce96b7c4dcdfec596a: stopping tablet replica
I20260811 15:06:27.430878 5993 raft_consensus.cc:2229] T fe4d458820174582b03e6af4f7bd896d P b0fbc76c8a3147ce96b7c4dcdfec596a [term 1 LEADER]: Raft consensus shutting down.
I20260811 15:06:27.431370 5993 raft_consensus.cc:2258] T fe4d458820174582b03e6af4f7bd896d P b0fbc76c8a3147ce96b7c4dcdfec596a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:06:27.433084 5995 ts_tablet_manager.cc:1918] T fe4d458820174582b03e6af4f7bd896d P 86273d33275e487f93e29fc595be3a21: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 15:06:27.433248 5995 log.cc:1196] T fe4d458820174582b03e6af4f7bd896d P 86273d33275e487f93e29fc595be3a21: Deleting WAL directory at /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-2/wal/wals/fe4d458820174582b03e6af4f7bd896d
I20260811 15:06:27.433373 5993 ts_tablet_manager.cc:1905] T fe4d458820174582b03e6af4f7bd896d P b0fbc76c8a3147ce96b7c4dcdfec596a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 15:06:27.434149 5995 ts_tablet_manager.cc:1939] T fe4d458820174582b03e6af4f7bd896d P 86273d33275e487f93e29fc595be3a21: Deleting consensus metadata
I20260811 15:06:27.435590 5391 catalog_manager.cc:4841] TS 86273d33275e487f93e29fc595be3a21 (127.19.236.67:37905): tablet fe4d458820174582b03e6af4f7bd896d (table test-table [id=4c0df3f4d44e4e4dbe9e9658881ae47a]) successfully deleted
I20260811 15:06:27.436882 5993 ts_tablet_manager.cc:1918] T fe4d458820174582b03e6af4f7bd896d P b0fbc76c8a3147ce96b7c4dcdfec596a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 15:06:27.436988 5993 log.cc:1196] T fe4d458820174582b03e6af4f7bd896d P b0fbc76c8a3147ce96b7c4dcdfec596a: Deleting WAL directory at /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-1/wal/wals/fe4d458820174582b03e6af4f7bd896d
I20260811 15:06:27.437316 5993 ts_tablet_manager.cc:1939] T fe4d458820174582b03e6af4f7bd896d P b0fbc76c8a3147ce96b7c4dcdfec596a: Deleting consensus metadata
I20260811 15:06:27.438527 5393 catalog_manager.cc:4841] TS b0fbc76c8a3147ce96b7c4dcdfec596a (127.19.236.66:34003): tablet fe4d458820174582b03e6af4f7bd896d (table test-table [id=4c0df3f4d44e4e4dbe9e9658881ae47a]) successfully deleted
I20260811 15:06:27.442050 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 5645
W20260811 15:06:27.444609 5394 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.19.236.65:42465 (error 108)
I20260811 15:06:27.446197 5961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:27.445749 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.65:42465 (local address 127.0.0.1:36954)
0811 15:06:27.445993 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:27.446094 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.65:42465: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
W20260811 15:06:27.446813 5394 catalog_manager.cc:4584] TS 82a851e21fb94256845678248f310c6b (127.19.236.65:42465): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet fe4d458820174582b03e6af4f7bd896d: Network error: Client connection negotiation failed: client connection to 127.19.236.65:42465: connect: Connection refused (error 111)
I20260811 15:06:27.455461 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 5798
I20260811 15:06:27.464701 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 5373
I20260811 15:06:47.478794 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:42765
--webserver_interface=127.19.236.126
--webserver_port=39061
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab
--principal=kudu/127.19.236.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:43709
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.236.126:42765
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:06:47.612746 5997 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:06:47.613030 5997 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:06:47.613107 5997 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:06:47.617163 5997 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 15:06:47.617215 5997 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 15:06:47.617231 5997 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 15:06:47.617245 5997 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:06:47.617264 5997 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:06:47.617321 5997 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:06:47.617349 5997 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:06:47.617388 5997 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:06:47.622918 5997 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:43709
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.19.236.126:42765
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab
--principal=kudu/127.19.236.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:42765
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.236.126
--webserver_port=39061
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5997
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:06:47.624039 5997 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:06:47.625164 5997 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:06:47.639673 6004 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:06:47.639678 6003 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:06:47.639659 6007 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:06:47.639725 5997 server_base.cc:1034] running on GCE node
I20260811 15:06:47.640513 5997 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:06:47.641826 5997 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:06:47.643028 5997 hybrid_clock.cc:648] HybridClock initialized: now 1786460807642994 us; error 59 us; skew 500 ppm
Aug 11 15:06:47 dist-test-slave-8n49 krb5kdc[5356](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460807, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:06:47.646279 5997 init.cc:377] Logged in from keytab as kudu/127.19.236.126@KRBTEST.COM (short username kudu)
I20260811 15:06:47.647285 5997 webserver.cc:460] Webserver started at http://127.19.236.126:39061/ using document root <none> and password file <none>
I20260811 15:06:47.648038 5997 fs_manager.cc:359] Metadata directory not provided
I20260811 15:06:47.648164 5997 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:06:47.652323 5997 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260811 15:06:47.654796 6016 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:06:47.656141 5997 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 15:06:47.656292 5997 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/master-0/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/master-0/wal
uuid: "bbac445142d44bb88e8007cbf65f9397"
format_stamp: "Formatted at 2026-08-11 15:06:26 on dist-test-slave-8n49"
server_key: "5165d26abeb91ab3809442f4a6ed0352"
server_key_iv: "981f56a8b68aa637908fcc5109ab68ce"
server_key_version: "encryptionkey@0"
I20260811 15:06:47.657027 5997 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:06:47.669055 5997 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:06:47.671953 5997 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:06:47.672158 5997 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:06:47.679528 5997 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.126:42765
I20260811 15:06:47.679823 6078 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.126:42765 every 8 connection(s)
I20260811 15:06:47.680727 5997 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
I20260811 15:06:47.685232 6079 sys_catalog.cc:263] Verifying existing consensus state
I20260811 15:06:47.686448 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 5997
I20260811 15:06:47.686906 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.65:42465
--local_ip_for_outbound_sockets=127.19.236.65
--tserver_master_addrs=127.19.236.126:42765
--webserver_port=46039
--webserver_interface=127.19.236.65
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.65.keytab
--principal=kudu/127.19.236.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:43709
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 15:06:47.686923 6079 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bbac445142d44bb88e8007cbf65f9397: Bootstrap starting.
I20260811 15:06:47.705410 6079 log.cc:824] T 00000000000000000000000000000000 P bbac445142d44bb88e8007cbf65f9397: Log is configured to *not* fsync() on all Append() calls
I20260811 15:06:47.714534 6079 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bbac445142d44bb88e8007cbf65f9397: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 15:06:47.714941 6079 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bbac445142d44bb88e8007cbf65f9397: Bootstrap complete.
I20260811 15:06:47.719208 6079 raft_consensus.cc:348] T 00000000000000000000000000000000 P bbac445142d44bb88e8007cbf65f9397 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbac445142d44bb88e8007cbf65f9397" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 42765 } }
I20260811 15:06:47.719645 6079 raft_consensus.cc:729] T 00000000000000000000000000000000 P bbac445142d44bb88e8007cbf65f9397 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbac445142d44bb88e8007cbf65f9397, State: Initialized, Role: FOLLOWER
I20260811 15:06:47.720429 6079 consensus_queue.cc:260] T 00000000000000000000000000000000 P bbac445142d44bb88e8007cbf65f9397 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbac445142d44bb88e8007cbf65f9397" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 42765 } }
I20260811 15:06:47.720644 6079 raft_consensus.cc:388] T 00000000000000000000000000000000 P bbac445142d44bb88e8007cbf65f9397 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 15:06:47.720753 6079 raft_consensus.cc:482] T 00000000000000000000000000000000 P bbac445142d44bb88e8007cbf65f9397 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 15:06:47.721001 6079 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bbac445142d44bb88e8007cbf65f9397 [term 1 FOLLOWER]: Advancing to term 2
I20260811 15:06:47.723250 6079 raft_consensus.cc:504] T 00000000000000000000000000000000 P bbac445142d44bb88e8007cbf65f9397 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbac445142d44bb88e8007cbf65f9397" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 42765 } }
I20260811 15:06:47.723620 6079 leader_election.cc:302] T 00000000000000000000000000000000 P bbac445142d44bb88e8007cbf65f9397 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bbac445142d44bb88e8007cbf65f9397; no voters:
I20260811 15:06:47.724006 6079 leader_election.cc:288] T 00000000000000000000000000000000 P bbac445142d44bb88e8007cbf65f9397 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 15:06:47.724099 6086 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bbac445142d44bb88e8007cbf65f9397 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 15:06:47.724292 6086 raft_consensus.cc:686] T 00000000000000000000000000000000 P bbac445142d44bb88e8007cbf65f9397 [term 2 LEADER]: Becoming Leader. State: Replica: bbac445142d44bb88e8007cbf65f9397, State: Running, Role: LEADER
I20260811 15:06:47.724647 6086 consensus_queue.cc:237] T 00000000000000000000000000000000 P bbac445142d44bb88e8007cbf65f9397 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbac445142d44bb88e8007cbf65f9397" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 42765 } }
I20260811 15:06:47.725566 6079 sys_catalog.cc:564] T 00000000000000000000000000000000 P bbac445142d44bb88e8007cbf65f9397 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:06:47.726140 6088 sys_catalog.cc:455] T 00000000000000000000000000000000 P bbac445142d44bb88e8007cbf65f9397 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "bbac445142d44bb88e8007cbf65f9397" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbac445142d44bb88e8007cbf65f9397" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 42765 } } }
I20260811 15:06:47.726262 6088 sys_catalog.cc:458] T 00000000000000000000000000000000 P bbac445142d44bb88e8007cbf65f9397 [sys.catalog]: This master's current role is: LEADER
I20260811 15:06:47.726954 6089 sys_catalog.cc:455] T 00000000000000000000000000000000 P bbac445142d44bb88e8007cbf65f9397 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bbac445142d44bb88e8007cbf65f9397. Latest consensus state: current_term: 2 leader_uuid: "bbac445142d44bb88e8007cbf65f9397" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbac445142d44bb88e8007cbf65f9397" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 42765 } } }
I20260811 15:06:47.727106 6089 sys_catalog.cc:458] T 00000000000000000000000000000000 P bbac445142d44bb88e8007cbf65f9397 [sys.catalog]: This master's current role is: LEADER
I20260811 15:06:47.727326 6093 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:06:47.732112 6093 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:06:47.733049 6093 catalog_manager.cc:1259] Loaded cluster ID: 0b6d5e69c5a64105a6b35654e2e56b44
I20260811 15:06:47.733140 6093 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:06:47.735899 6093 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:06:47.736573 6093 catalog_manager.cc:5879] T 00000000000000000000000000000000 P bbac445142d44bb88e8007cbf65f9397: Loaded TSK: 0
I20260811 15:06:47.753567 6093 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bbac445142d44bb88e8007cbf65f9397: Generated new TSK 1
I20260811 15:06:47.753845 6093 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 15:06:47.811313 6084 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:06:47.811578 6084 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:06:47.811621 6084 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:06:47.815855 6084 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:06:47.815917 6084 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:06:47.815980 6084 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.65
I20260811 15:06:47.821252 6084 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:43709
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.65.keytab
--principal=kudu/127.19.236.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.65:42465
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.236.65
--webserver_port=46039
--tserver_master_addrs=127.19.236.126:42765
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6084
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.65
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:06:47.822291 6084 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:06:47.823334 6084 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:06:47.834586 6112 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:06:47.834568 6113 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:06:47.834568 6115 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:06:47.835237 6084 server_base.cc:1034] running on GCE node
I20260811 15:06:47.835745 6084 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:06:47.836647 6084 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:06:47.837862 6084 hybrid_clock.cc:648] HybridClock initialized: now 1786460807837836 us; error 35 us; skew 500 ppm
Aug 11 15:06:47 dist-test-slave-8n49 krb5kdc[5356](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460807, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:06:47.841406 6084 init.cc:377] Logged in from keytab as kudu/127.19.236.65@KRBTEST.COM (short username kudu)
I20260811 15:06:47.842444 6084 webserver.cc:460] Webserver started at http://127.19.236.65:46039/ using document root <none> and password file <none>
I20260811 15:06:47.843032 6084 fs_manager.cc:359] Metadata directory not provided
I20260811 15:06:47.843111 6084 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:06:47.847249 6084 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 15:06:47.849916 6125 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:06:47.851261 6084 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 15:06:47.851408 6084 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-0/wal
uuid: "82a851e21fb94256845678248f310c6b"
format_stamp: "Formatted at 2026-08-11 15:06:26 on dist-test-slave-8n49"
server_key: "867a76624834415a3be315452b2416d8"
server_key_iv: "03f5d0e86332fc3c59ae05d14480f6ae"
server_key_version: "encryptionkey@0"
I20260811 15:06:47.851996 6084 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:06:47.866888 6084 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:06:47.870311 6084 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:06:47.870532 6084 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:06:47.871150 6084 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:06:47.872360 6134 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 15:06:47.876523 6084 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 15:06:47.876659 6084 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.000s sys 0.000s
I20260811 15:06:47.876739 6084 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 15:06:47.878504 6084 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 15:06:47.878566 6084 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260811 15:06:47.878820 6134 tablet_bootstrap.cc:492] T fe4d458820174582b03e6af4f7bd896d P 82a851e21fb94256845678248f310c6b: Bootstrap starting.
I20260811 15:06:47.889799 6084 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.65:42465
I20260811 15:06:47.889891 6263 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.65:42465 every 8 connection(s)
I20260811 15:06:47.891057 6084 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
I20260811 15:06:47.894739 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 6084
I20260811 15:06:47.895251 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.66:34003
--local_ip_for_outbound_sockets=127.19.236.66
--tserver_master_addrs=127.19.236.126:42765
--webserver_port=42199
--webserver_interface=127.19.236.66
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.66.keytab
--principal=kudu/127.19.236.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:43709
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 15:06:47.900301 6134 log.cc:824] T fe4d458820174582b03e6af4f7bd896d P 82a851e21fb94256845678248f310c6b: Log is configured to *not* fsync() on all Append() calls
Aug 11 15:06:47 dist-test-slave-8n49 krb5kdc[5356](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460807, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.65@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
I20260811 15:06:47.909996 6134 tablet_bootstrap.cc:492] T fe4d458820174582b03e6af4f7bd896d P 82a851e21fb94256845678248f310c6b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 15:06:47.910499 6134 tablet_bootstrap.cc:492] T fe4d458820174582b03e6af4f7bd896d P 82a851e21fb94256845678248f310c6b: Bootstrap complete.
I20260811 15:06:47.910553 6267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:47.893283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42765 (local address 127.19.236.65:33927)
0811 15:06:47.893873 (+ 590us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:47.893916 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 15:06:47.894950 (+ 1034us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:06:47.896366 (+ 1416us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:06:47.896377 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:06:47.896930 (+ 553us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:06:47.897487 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:06:47.897501 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:06:47.898864 (+ 1363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:06:47.898867 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:06:47.899739 (+ 872us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:06:47.899748 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:06:47.900572 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:06:47.900578 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:06:47.900799 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:47.901465 (+ 666us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:06:47.901492 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:06:47.903562 (+ 2070us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:06:47.906482 (+ 2920us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:06:47.906491 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:06:47.906507 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:06:47.906927 (+ 420us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:06:47.907390 (+ 463us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:06:47.907395 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:06:47.907399 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:06:47.907601 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:06:47.908392 (+ 791us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:06:47.908401 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:06:47.908788 (+ 387us) client_negotiation.cc:769] Sending connection context
0811 15:06:47.909034 (+ 246us) client_negotiation.cc:240] Negotiation successful
0811 15:06:47.909430 (+ 396us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":378,"thread_start_us":193,"threads_started":1}
I20260811 15:06:47.910619 6266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:47.893284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.65:33927 (local address 127.19.236.126:42765)
0811 15:06:47.893687 (+ 403us) server_negotiation.cc:206] Beginning negotiation
0811 15:06:47.893709 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0811 15:06:47.894035 (+ 326us) server_negotiation.cc:407] Connection header received
0811 15:06:47.895489 (+ 1454us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:06:47.895504 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:06:47.895908 (+ 404us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:06:47.896285 (+ 377us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:06:47.897687 (+ 1402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:47.898680 (+ 993us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:47.899875 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:47.900352 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:47.900599 (+ 247us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:47.903837 (+ 3238us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:06:47.903845 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:06:47.903864 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:06:47.903905 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:06:47.906314 (+ 2409us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:06:47.907076 (+ 762us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:06:47.907085 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:06:47.907091 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:06:47.907262 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:06:47.907738 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:06:47.907742 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:06:47.907744 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:06:47.908241 (+ 497us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:06:47.908404 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0811 15:06:47.909182 (+ 778us) server_negotiation.cc:299] Negotiation successful
0811 15:06:47.909528 (+ 346us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":236,"thread_start_us":141,"threads_started":1}
I20260811 15:06:47.911969 6134 ts_tablet_manager.cc:1397] T fe4d458820174582b03e6af4f7bd896d P 82a851e21fb94256845678248f310c6b: Time spent bootstrapping tablet: real 0.033s user 0.026s sys 0.004s
I20260811 15:06:47.913757 6264 heartbeater.cc:347] Connected to a master server at 127.19.236.126:42765
I20260811 15:06:47.914000 6264 heartbeater.cc:464] Registering TS with master...
I20260811 15:06:47.914536 6264 heartbeater.cc:511] Master 127.19.236.126:42765 requested a full tablet report, sending...
I20260811 15:06:47.915084 6134 raft_consensus.cc:348] T fe4d458820174582b03e6af4f7bd896d P 82a851e21fb94256845678248f310c6b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0fbc76c8a3147ce96b7c4dcdfec596a" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 34003 } } peers { permanent_uuid: "82a851e21fb94256845678248f310c6b" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 42465 } } peers { permanent_uuid: "86273d33275e487f93e29fc595be3a21" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37905 } }
I20260811 15:06:47.915552 6134 raft_consensus.cc:729] T fe4d458820174582b03e6af4f7bd896d P 82a851e21fb94256845678248f310c6b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82a851e21fb94256845678248f310c6b, State: Initialized, Role: FOLLOWER
I20260811 15:06:47.916108 6134 consensus_queue.cc:260] T fe4d458820174582b03e6af4f7bd896d P 82a851e21fb94256845678248f310c6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0fbc76c8a3147ce96b7c4dcdfec596a" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 34003 } } peers { permanent_uuid: "82a851e21fb94256845678248f310c6b" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 42465 } } peers { permanent_uuid: "86273d33275e487f93e29fc595be3a21" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37905 } }
I20260811 15:06:47.917181 6134 ts_tablet_manager.cc:1428] T fe4d458820174582b03e6af4f7bd896d P 82a851e21fb94256845678248f310c6b: Time spent starting tablet: real 0.005s user 0.008s sys 0.000s
I20260811 15:06:47.917382 6035 ts_manager.cc:194] Registered new tserver with Master: 82a851e21fb94256845678248f310c6b (127.19.236.65:42465)
I20260811 15:06:47.921446 6035 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.236.65@KRBTEST.COM'} at 127.19.236.65:33927
I20260811 15:06:47.924250 6264 heartbeater.cc:503] Master 127.19.236.126:42765 was elected leader, sending a full tablet report...
Aug 11 15:06:47 dist-test-slave-8n49 krb5kdc[5356](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460807, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.126@KRBTEST.COM for kudu/127.19.236.65@KRBTEST.COM
I20260811 15:06:47.933117 6272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:47.920826 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.65:42465 (local address 127.0.0.1:40818)
0811 15:06:47.921619 (+ 793us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:47.921666 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 15:06:47.921850 (+ 184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:06:47.922411 (+ 561us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:06:47.922417 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:06:47.922896 (+ 479us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:06:47.923010 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:06:47.923017 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:06:47.924249 (+ 1232us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:06:47.924255 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:06:47.925309 (+ 1054us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:06:47.925326 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:06:47.926207 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:06:47.926211 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:06:47.926345 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:47.927011 (+ 666us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:06:47.927025 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:06:47.928945 (+ 1920us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:06:47.931046 (+ 2101us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:06:47.931059 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:06:47.931066 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:06:47.931323 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:06:47.931670 (+ 347us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:06:47.931673 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:06:47.931675 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:06:47.931775 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:06:47.932282 (+ 507us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:06:47.932289 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:06:47.932443 (+ 154us) client_negotiation.cc:769] Sending connection context
0811 15:06:47.932670 (+ 227us) client_negotiation.cc:240] Negotiation successful
0811 15:06:47.932907 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":612,"thread_start_us":133,"threads_started":1}
I20260811 15:06:47.933128 6273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:47.920893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40818 (local address 127.19.236.65:42465)
0811 15:06:47.921339 (+ 446us) server_negotiation.cc:206] Beginning negotiation
0811 15:06:47.921351 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 15:06:47.921779 (+ 428us) server_negotiation.cc:407] Connection header received
0811 15:06:47.922027 (+ 248us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:06:47.922033 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:06:47.922246 (+ 213us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:06:47.922411 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:06:47.923145 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:47.924122 (+ 977us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:47.925480 (+ 1358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:47.926069 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:47.926204 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:47.929107 (+ 2903us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:06:47.929117 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:06:47.929128 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:06:47.929151 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:06:47.930914 (+ 1763us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:06:47.931461 (+ 547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:06:47.931467 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:06:47.931468 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:06:47.931553 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:06:47.931875 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:06:47.931881 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:06:47.931886 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:06:47.932149 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:06:47.932307 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0811 15:06:47.932766 (+ 459us) server_negotiation.cc:299] Negotiation successful
0811 15:06:47.932970 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":12,"server-negotiator.queue_time_us":340,"thread_start_us":107,"threads_started":1}
I20260811 15:06:47.934341 6185 tablet_service.cc:1514] Processing DeleteTablet for tablet fe4d458820174582b03e6af4f7bd896d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:06:27 UTC) from {username='kudu', principal='kudu/127.19.236.126@KRBTEST.COM'} at 127.0.0.1:40818
I20260811 15:06:47.935355 6274 tablet_replica.cc:330] stopping tablet replica
I20260811 15:06:47.935691 6274 raft_consensus.cc:2229] T fe4d458820174582b03e6af4f7bd896d P 82a851e21fb94256845678248f310c6b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 15:06:47.935948 6274 raft_consensus.cc:2258] T fe4d458820174582b03e6af4f7bd896d P 82a851e21fb94256845678248f310c6b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:06:47.936987 6274 ts_tablet_manager.cc:1905] T fe4d458820174582b03e6af4f7bd896d P 82a851e21fb94256845678248f310c6b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 15:06:47.940984 6274 ts_tablet_manager.cc:1918] T fe4d458820174582b03e6af4f7bd896d P 82a851e21fb94256845678248f310c6b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 15:06:47.941113 6274 log.cc:1196] T fe4d458820174582b03e6af4f7bd896d P 82a851e21fb94256845678248f310c6b: Deleting WAL directory at /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-0/wal/wals/fe4d458820174582b03e6af4f7bd896d
I20260811 15:06:47.941397 6274 ts_tablet_manager.cc:1939] T fe4d458820174582b03e6af4f7bd896d P 82a851e21fb94256845678248f310c6b: Deleting consensus metadata
I20260811 15:06:47.943244 6020 catalog_manager.cc:4841] TS 82a851e21fb94256845678248f310c6b (127.19.236.65:42465): tablet fe4d458820174582b03e6af4f7bd896d (table test-table [id=4c0df3f4d44e4e4dbe9e9658881ae47a]) successfully deleted
W20260811 15:06:48.020807 6268 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:06:48.021061 6268 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:06:48.021111 6268 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:06:48.025111 6268 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:06:48.025166 6268 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:06:48.025272 6268 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.66
I20260811 15:06:48.030911 6268 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:43709
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.66.keytab
--principal=kudu/127.19.236.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.66:34003
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.236.66
--webserver_port=42199
--tserver_master_addrs=127.19.236.126:42765
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6268
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.66
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:06:48.031940 6268 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:06:48.033012 6268 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:06:48.042909 6282 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:06:48.042920 6284 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:06:48.042888 6281 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:06:48.043159 6268 server_base.cc:1034] running on GCE node
I20260811 15:06:48.043587 6268 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:06:48.044217 6268 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:06:48.045428 6268 hybrid_clock.cc:648] HybridClock initialized: now 1786460808045393 us; error 44 us; skew 500 ppm
Aug 11 15:06:48 dist-test-slave-8n49 krb5kdc[5356](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460808, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:06:48.048283 6268 init.cc:377] Logged in from keytab as kudu/127.19.236.66@KRBTEST.COM (short username kudu)
I20260811 15:06:48.049278 6268 webserver.cc:460] Webserver started at http://127.19.236.66:42199/ using document root <none> and password file <none>
I20260811 15:06:48.049866 6268 fs_manager.cc:359] Metadata directory not provided
I20260811 15:06:48.049979 6268 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:06:48.053846 6268 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 15:06:48.055969 6291 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:06:48.057348 6268 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 15:06:48.057461 6268 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-1/wal
uuid: "b0fbc76c8a3147ce96b7c4dcdfec596a"
format_stamp: "Formatted at 2026-08-11 15:06:26 on dist-test-slave-8n49"
server_key: "fceb74f8afe31f1f3a2f4de14985ffc3"
server_key_iv: "9541c6c6dc638ff67cf591bc68dc7119"
server_key_version: "encryptionkey@0"
I20260811 15:06:48.057991 6268 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:06:48.082599 6268 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:06:48.086374 6268 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:06:48.086656 6268 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:06:48.087297 6268 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:06:48.088119 6268 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:06:48.088179 6268 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:06:48.088222 6268 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:06:48.088243 6268 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:06:48.097407 6268 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.66:34003
I20260811 15:06:48.097441 6429 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.66:34003 every 8 connection(s)
I20260811 15:06:48.098457 6268 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
I20260811 15:06:48.105722 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 6268
I20260811 15:06:48.106231 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.67:37905
--local_ip_for_outbound_sockets=127.19.236.67
--tserver_master_addrs=127.19.236.126:42765
--webserver_port=46151
--webserver_interface=127.19.236.67
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.67.keytab
--principal=kudu/127.19.236.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:43709
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 15:06:48 dist-test-slave-8n49 krb5kdc[5356](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460808, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.66@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
I20260811 15:06:48.113653 6266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:48.100300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.66:41973 (local address 127.19.236.126:42765)
0811 15:06:48.100452 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0811 15:06:48.100456 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:06:48.101351 (+ 895us) server_negotiation.cc:407] Connection header received
0811 15:06:48.102661 (+ 1310us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:06:48.102664 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:06:48.102718 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:06:48.102800 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:06:48.103961 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:48.104513 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:48.105858 (+ 1345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:48.106146 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:48.106231 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:48.109433 (+ 3202us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:06:48.109439 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:06:48.109444 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:06:48.109479 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:06:48.111157 (+ 1678us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:06:48.111828 (+ 671us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:06:48.111833 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:06:48.111839 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:06:48.111916 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:06:48.112331 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:06:48.112333 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:06:48.112334 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:06:48.112535 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:06:48.112730 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0811 15:06:48.113399 (+ 669us) server_negotiation.cc:299] Negotiation successful
0811 15:06:48.113526 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 15:06:48.114980 6432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:48.100724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42765 (local address 127.19.236.66:41973)
0811 15:06:48.101185 (+ 461us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:48.101227 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 15:06:48.102442 (+ 1215us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:06:48.102967 (+ 525us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:06:48.102974 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:06:48.103338 (+ 364us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:06:48.103796 (+ 458us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:06:48.103809 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:06:48.104706 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:06:48.104709 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:06:48.105710 (+ 1001us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:06:48.105723 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:06:48.106317 (+ 594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:06:48.106324 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:06:48.106571 (+ 247us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:48.107225 (+ 654us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:06:48.107253 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:06:48.109242 (+ 1989us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:06:48.111284 (+ 2042us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:06:48.111294 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:06:48.111313 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:06:48.111713 (+ 400us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:06:48.112014 (+ 301us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:06:48.112020 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:06:48.112025 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:06:48.112221 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:06:48.112744 (+ 523us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:06:48.112755 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:06:48.113112 (+ 357us) client_negotiation.cc:769] Sending connection context
0811 15:06:48.113368 (+ 256us) client_negotiation.cc:240] Negotiation successful
0811 15:06:48.113770 (+ 402us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":277,"thread_start_us":122,"threads_started":1}
I20260811 15:06:48.116307 6430 heartbeater.cc:347] Connected to a master server at 127.19.236.126:42765
I20260811 15:06:48.116606 6430 heartbeater.cc:464] Registering TS with master...
I20260811 15:06:48.117121 6430 heartbeater.cc:511] Master 127.19.236.126:42765 requested a full tablet report, sending...
I20260811 15:06:48.118266 6035 ts_manager.cc:194] Registered new tserver with Master: b0fbc76c8a3147ce96b7c4dcdfec596a (127.19.236.66:34003)
I20260811 15:06:48.118839 6035 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.236.66@KRBTEST.COM'} at 127.19.236.66:41973
W20260811 15:06:48.223018 6433 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:06:48.223305 6433 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:06:48.223380 6433 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:06:48.227558 6433 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:06:48.227646 6433 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:06:48.227748 6433 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.67
I20260811 15:06:48.233155 6433 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:43709
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.67.keytab
--principal=kudu/127.19.236.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.67:37905
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.236.67
--webserver_port=46151
--tserver_master_addrs=127.19.236.126:42765
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6433
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.67
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:06:48.234262 6433 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:06:48.235312 6433 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:06:48.245342 6440 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:06:48.245350 6439 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:06:48.245368 6442 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:06:48.245694 6433 server_base.cc:1034] running on GCE node
I20260811 15:06:48.246093 6433 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:06:48.246711 6433 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:06:48.247881 6433 hybrid_clock.cc:648] HybridClock initialized: now 1786460808247867 us; error 23 us; skew 500 ppm
Aug 11 15:06:48 dist-test-slave-8n49 krb5kdc[5356](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460808, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:06:48.250746 6433 init.cc:377] Logged in from keytab as kudu/127.19.236.67@KRBTEST.COM (short username kudu)
I20260811 15:06:48.251646 6433 webserver.cc:460] Webserver started at http://127.19.236.67:46151/ using document root <none> and password file <none>
I20260811 15:06:48.252316 6433 fs_manager.cc:359] Metadata directory not provided
I20260811 15:06:48.252460 6433 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:06:48.256404 6433 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260811 15:06:48.258517 6454 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:06:48.259754 6433 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 15:06:48.259879 6433 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-2/wal
uuid: "86273d33275e487f93e29fc595be3a21"
format_stamp: "Formatted at 2026-08-11 15:06:27 on dist-test-slave-8n49"
server_key: "ec5747d009020fae3a82bba9247e1413"
server_key_iv: "b4f6c907d3f14458b2245c9f88e5c18b"
server_key_version: "encryptionkey@0"
I20260811 15:06:48.260423 6433 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:06:48.273123 6433 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:06:48.276372 6433 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:06:48.276593 6433 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:06:48.277195 6433 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:06:48.278080 6433 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:06:48.278131 6433 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:06:48.278174 6433 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:06:48.278190 6433 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:06:48.287883 6433 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.67:37905
I20260811 15:06:48.287902 6594 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.67:37905 every 8 connection(s)
I20260811 15:06:48.289074 6433 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
I20260811 15:06:48.294236 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 6433
Aug 11 15:06:48 dist-test-slave-8n49 krb5kdc[5356](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460808, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.67@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
I20260811 15:06:48.303901 6599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:48.295017 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53318 (local address 127.19.236.126:42765)
0811 15:06:48.295343 (+ 326us) server_negotiation.cc:206] Beginning negotiation
0811 15:06:48.295347 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:06:48.295407 (+ 60us) server_negotiation.cc:407] Connection header received
0811 15:06:48.295532 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:06:48.295535 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:06:48.295574 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:06:48.295654 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:06:48.296431 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:48.297189 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:48.298281 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:48.298635 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:48.298745 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:48.300132 (+ 1387us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:06:48.300139 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:06:48.300142 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:06:48.300170 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:06:48.302151 (+ 1981us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:06:48.302559 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:06:48.302563 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:06:48.302565 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:06:48.302683 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:06:48.302976 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:06:48.302982 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:06:48.302987 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:06:48.303191 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:06:48.303430 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0811 15:06:48.303572 (+ 142us) server_negotiation.cc:299] Negotiation successful
0811 15:06:48.303708 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":263,"thread_start_us":85,"threads_started":1}
I20260811 15:06:48.304266 6266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:48.290973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.67:40983 (local address 127.19.236.126:42765)
0811 15:06:48.291133 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0811 15:06:48.291136 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 15:06:48.292399 (+ 1263us) server_negotiation.cc:407] Connection header received
0811 15:06:48.293345 (+ 946us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:06:48.293348 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:06:48.293410 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:06:48.293518 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:06:48.294875 (+ 1357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:48.295627 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:48.297100 (+ 1473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:48.297406 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:48.297541 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:48.300201 (+ 2660us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:06:48.300204 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:06:48.300206 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:06:48.300248 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:06:48.301977 (+ 1729us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:06:48.302559 (+ 582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:06:48.302564 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:06:48.302565 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:06:48.302658 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:06:48.303046 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:06:48.303049 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:06:48.303050 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:06:48.303235 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:06:48.303357 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0811 15:06:48.303975 (+ 618us) server_negotiation.cc:299] Negotiation successful
0811 15:06:48.304106 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 15:06:48.305334 6597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:48.291273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42765 (local address 127.19.236.67:40983)
0811 15:06:48.292217 (+ 944us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:48.292261 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 15:06:48.293129 (+ 868us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:06:48.293706 (+ 577us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:06:48.293714 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:06:48.294085 (+ 371us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:06:48.294630 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:06:48.294672 (+ 42us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:06:48.295798 (+ 1126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:06:48.295802 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:06:48.296959 (+ 1157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:06:48.296972 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:06:48.297580 (+ 608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:06:48.297583 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:06:48.297729 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:48.298381 (+ 652us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:06:48.298401 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:06:48.299994 (+ 1593us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:06:48.302109 (+ 2115us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:06:48.302117 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:06:48.302134 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:06:48.302453 (+ 319us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:06:48.302753 (+ 300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:06:48.302758 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:06:48.302763 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:06:48.302942 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:06:48.303381 (+ 439us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:06:48.303388 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:06:48.303708 (+ 320us) client_negotiation.cc:769] Sending connection context
0811 15:06:48.303927 (+ 219us) client_negotiation.cc:240] Negotiation successful
0811 15:06:48.304439 (+ 512us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":730,"thread_start_us":546,"threads_started":1}
I20260811 15:06:48.306543 6595 heartbeater.cc:347] Connected to a master server at 127.19.236.126:42765
I20260811 15:06:48.306799 6595 heartbeater.cc:464] Registering TS with master...
I20260811 15:06:48.307302 6595 heartbeater.cc:511] Master 127.19.236.126:42765 requested a full tablet report, sending...
I20260811 15:06:48.308293 6035 ts_manager.cc:194] Registered new tserver with Master: 86273d33275e487f93e29fc595be3a21 (127.19.236.67:37905)
I20260811 15:06:48.308878 6035 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.236.67@KRBTEST.COM'} at 127.19.236.67:40983
I20260811 15:06:48.317802 20401 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 15:06:48.322026 6266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:48.318463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53328 (local address 127.19.236.126:42765)
0811 15:06:48.318634 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0811 15:06:48.318639 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:06:48.318806 (+ 167us) server_negotiation.cc:407] Connection header received
0811 15:06:48.318949 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:06:48.318951 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:06:48.319056 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:06:48.319148 (+ 92us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 15:06:48.319353 (+ 205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:48.319863 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:48.320871 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:48.321089 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:48.321178 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:48.321512 (+ 334us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 15:06:48.321656 (+ 144us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0811 15:06:48.321879 (+ 223us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:53328: token expired
Metrics: {"server-negotiator.queue_time_us":75}
W20260811 15:06:48.322108 6266 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:53328: token expired
W20260811 15:06:48.322443 5954 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.19.236.126:42765)
I20260811 15:06:48.330070 6266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:48.322802 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53342 (local address 127.19.236.126:42765)
0811 15:06:48.322910 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0811 15:06:48.322914 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:06:48.322926 (+ 12us) server_negotiation.cc:407] Connection header received
0811 15:06:48.323000 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:06:48.323001 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:06:48.323036 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:06:48.323095 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:06:48.323698 (+ 603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:48.324191 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:48.325089 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:48.325309 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:48.325395 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:48.326839 (+ 1444us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:06:48.326843 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:06:48.326846 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:06:48.326878 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:06:48.328266 (+ 1388us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:06:48.328833 (+ 567us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:06:48.328836 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:06:48.328837 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:06:48.328927 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:06:48.329207 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:06:48.329210 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:06:48.329211 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:06:48.329378 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:06:48.329484 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0811 15:06:48.329820 (+ 336us) server_negotiation.cc:299] Negotiation successful
0811 15:06:48.329929 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260811 15:06:48.332813 6035 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53342:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 15:06:48.337016 6035 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 15:06:48.346014 6185 tablet_service.cc:1467] Processing CreateTablet for tablet d77302d5645b4f37b1f9810c8ad333b2 (DEFAULT_TABLE table=test-table [id=04c84d7317e743febda87a485068f1df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:06:48.346760 6185 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d77302d5645b4f37b1f9810c8ad333b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:06:48.349830 6134 tablet_bootstrap.cc:492] T d77302d5645b4f37b1f9810c8ad333b2 P 82a851e21fb94256845678248f310c6b: Bootstrap starting.
I20260811 15:06:48.350790 6134 tablet_bootstrap.cc:654] T d77302d5645b4f37b1f9810c8ad333b2 P 82a851e21fb94256845678248f310c6b: Neither blocks nor log segments found. Creating new log.
I20260811 15:06:48.350935 6272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:48.344893 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.66:34003 (local address 127.0.0.1:37724)
0811 15:06:48.345031 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:48.345047 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 15:06:48.345132 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:06:48.346078 (+ 946us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:06:48.346081 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:06:48.346101 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:06:48.346218 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:06:48.346225 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:06:48.347744 (+ 1519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:06:48.347747 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:06:48.349449 (+ 1702us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:06:48.349458 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:06:48.350474 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:06:48.350478 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:06:48.350581 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:48.350626 (+ 45us) client_negotiation.cc:769] Sending connection context
0811 15:06:48.350712 (+ 86us) client_negotiation.cc:240] Negotiation successful
0811 15:06:48.350795 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49,"mutex_wait_us":249}
I20260811 15:06:48.350980 6605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:48.345103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37724 (local address 127.19.236.66:34003)
0811 15:06:48.345508 (+ 405us) server_negotiation.cc:206] Beginning negotiation
0811 15:06:48.345522 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 15:06:48.345547 (+ 25us) server_negotiation.cc:407] Connection header received
0811 15:06:48.345633 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:06:48.345639 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:06:48.345882 (+ 243us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:06:48.346380 (+ 498us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:06:48.346557 (+ 177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:48.347607 (+ 1050us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:48.349554 (+ 1947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:48.350345 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:48.350473 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:48.350629 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0811 15:06:48.350749 (+ 120us) server_negotiation.cc:299] Negotiation successful
0811 15:06:48.350838 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":292,"thread_start_us":174,"threads_started":1}
I20260811 15:06:48.351398 6606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:48.345374 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.67:37905 (local address 127.0.0.1:59244)
0811 15:06:48.345600 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:48.345615 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 15:06:48.345716 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:06:48.346598 (+ 882us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:06:48.346601 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:06:48.346620 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:06:48.346722 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:06:48.346729 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:06:48.347725 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:06:48.347729 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:06:48.349312 (+ 1583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:06:48.349324 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:06:48.350956 (+ 1632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:06:48.350961 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:06:48.351074 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:48.351108 (+ 34us) client_negotiation.cc:769] Sending connection context
0811 15:06:48.351172 (+ 64us) client_negotiation.cc:240] Negotiation successful
0811 15:06:48.351264 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"mutex_wait_us":115,"thread_start_us":101,"threads_started":1}
I20260811 15:06:48.352056 6607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:48.345801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59244 (local address 127.19.236.67:37905)
0811 15:06:48.346148 (+ 347us) server_negotiation.cc:206] Beginning negotiation
0811 15:06:48.346166 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 15:06:48.346185 (+ 19us) server_negotiation.cc:407] Connection header received
0811 15:06:48.346283 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:06:48.346288 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:06:48.346461 (+ 173us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:06:48.346618 (+ 157us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:06:48.346840 (+ 222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:48.347601 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:48.350009 (+ 2408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:48.350804 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:48.351582 (+ 778us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:48.351751 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0811 15:06:48.351814 (+ 63us) server_negotiation.cc:299] Negotiation successful
0811 15:06:48.351903 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":251,"thread_start_us":132,"threads_started":1}
I20260811 15:06:48.352576 6134 tablet_bootstrap.cc:492] T d77302d5645b4f37b1f9810c8ad333b2 P 82a851e21fb94256845678248f310c6b: No bootstrap required, opened a new log
I20260811 15:06:48.352669 6134 ts_tablet_manager.cc:1397] T d77302d5645b4f37b1f9810c8ad333b2 P 82a851e21fb94256845678248f310c6b: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 15:06:48.353122 6134 raft_consensus.cc:348] T d77302d5645b4f37b1f9810c8ad333b2 P 82a851e21fb94256845678248f310c6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0fbc76c8a3147ce96b7c4dcdfec596a" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 34003 } } peers { permanent_uuid: "86273d33275e487f93e29fc595be3a21" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37905 } } peers { permanent_uuid: "82a851e21fb94256845678248f310c6b" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 42465 } }
I20260811 15:06:48.353220 6134 raft_consensus.cc:374] T d77302d5645b4f37b1f9810c8ad333b2 P 82a851e21fb94256845678248f310c6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:06:48.353247 6134 raft_consensus.cc:729] T d77302d5645b4f37b1f9810c8ad333b2 P 82a851e21fb94256845678248f310c6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82a851e21fb94256845678248f310c6b, State: Initialized, Role: FOLLOWER
I20260811 15:06:48.353384 6134 consensus_queue.cc:260] T d77302d5645b4f37b1f9810c8ad333b2 P 82a851e21fb94256845678248f310c6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0fbc76c8a3147ce96b7c4dcdfec596a" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 34003 } } peers { permanent_uuid: "86273d33275e487f93e29fc595be3a21" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37905 } } peers { permanent_uuid: "82a851e21fb94256845678248f310c6b" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 42465 } }
I20260811 15:06:48.353665 6134 ts_tablet_manager.cc:1428] T d77302d5645b4f37b1f9810c8ad333b2 P 82a851e21fb94256845678248f310c6b: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260811 15:06:48.354314 6346 tablet_service.cc:1467] Processing CreateTablet for tablet d77302d5645b4f37b1f9810c8ad333b2 (DEFAULT_TABLE table=test-table [id=04c84d7317e743febda87a485068f1df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:06:48.354729 6514 tablet_service.cc:1467] Processing CreateTablet for tablet d77302d5645b4f37b1f9810c8ad333b2 (DEFAULT_TABLE table=test-table [id=04c84d7317e743febda87a485068f1df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:06:48.355548 6346 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d77302d5645b4f37b1f9810c8ad333b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:06:48.355666 6514 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d77302d5645b4f37b1f9810c8ad333b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:06:48.364346 6610 tablet_bootstrap.cc:492] T d77302d5645b4f37b1f9810c8ad333b2 P b0fbc76c8a3147ce96b7c4dcdfec596a: Bootstrap starting.
I20260811 15:06:48.364638 6609 tablet_bootstrap.cc:492] T d77302d5645b4f37b1f9810c8ad333b2 P 86273d33275e487f93e29fc595be3a21: Bootstrap starting.
I20260811 15:06:48.366953 6609 tablet_bootstrap.cc:654] T d77302d5645b4f37b1f9810c8ad333b2 P 86273d33275e487f93e29fc595be3a21: Neither blocks nor log segments found. Creating new log.
I20260811 15:06:48.367514 6610 tablet_bootstrap.cc:654] T d77302d5645b4f37b1f9810c8ad333b2 P b0fbc76c8a3147ce96b7c4dcdfec596a: Neither blocks nor log segments found. Creating new log.
I20260811 15:06:48.368503 6609 log.cc:824] T d77302d5645b4f37b1f9810c8ad333b2 P 86273d33275e487f93e29fc595be3a21: Log is configured to *not* fsync() on all Append() calls
I20260811 15:06:48.368503 6610 log.cc:824] T d77302d5645b4f37b1f9810c8ad333b2 P b0fbc76c8a3147ce96b7c4dcdfec596a: Log is configured to *not* fsync() on all Append() calls
I20260811 15:06:48.370833 6609 tablet_bootstrap.cc:492] T d77302d5645b4f37b1f9810c8ad333b2 P 86273d33275e487f93e29fc595be3a21: No bootstrap required, opened a new log
I20260811 15:06:48.371145 6609 ts_tablet_manager.cc:1397] T d77302d5645b4f37b1f9810c8ad333b2 P 86273d33275e487f93e29fc595be3a21: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260811 15:06:48.371213 6610 tablet_bootstrap.cc:492] T d77302d5645b4f37b1f9810c8ad333b2 P b0fbc76c8a3147ce96b7c4dcdfec596a: No bootstrap required, opened a new log
I20260811 15:06:48.371385 6610 ts_tablet_manager.cc:1397] T d77302d5645b4f37b1f9810c8ad333b2 P b0fbc76c8a3147ce96b7c4dcdfec596a: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260811 15:06:48.376112 6609 raft_consensus.cc:348] T d77302d5645b4f37b1f9810c8ad333b2 P 86273d33275e487f93e29fc595be3a21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0fbc76c8a3147ce96b7c4dcdfec596a" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 34003 } } peers { permanent_uuid: "86273d33275e487f93e29fc595be3a21" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37905 } } peers { permanent_uuid: "82a851e21fb94256845678248f310c6b" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 42465 } }
I20260811 15:06:48.376456 6609 raft_consensus.cc:374] T d77302d5645b4f37b1f9810c8ad333b2 P 86273d33275e487f93e29fc595be3a21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:06:48.376514 6609 raft_consensus.cc:729] T d77302d5645b4f37b1f9810c8ad333b2 P 86273d33275e487f93e29fc595be3a21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86273d33275e487f93e29fc595be3a21, State: Initialized, Role: FOLLOWER
I20260811 15:06:48.376443 6610 raft_consensus.cc:348] T d77302d5645b4f37b1f9810c8ad333b2 P b0fbc76c8a3147ce96b7c4dcdfec596a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0fbc76c8a3147ce96b7c4dcdfec596a" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 34003 } } peers { permanent_uuid: "86273d33275e487f93e29fc595be3a21" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37905 } } peers { permanent_uuid: "82a851e21fb94256845678248f310c6b" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 42465 } }
I20260811 15:06:48.376781 6610 raft_consensus.cc:374] T d77302d5645b4f37b1f9810c8ad333b2 P b0fbc76c8a3147ce96b7c4dcdfec596a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:06:48.376838 6610 raft_consensus.cc:729] T d77302d5645b4f37b1f9810c8ad333b2 P b0fbc76c8a3147ce96b7c4dcdfec596a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0fbc76c8a3147ce96b7c4dcdfec596a, State: Initialized, Role: FOLLOWER
I20260811 15:06:48.377075 6609 consensus_queue.cc:260] T d77302d5645b4f37b1f9810c8ad333b2 P 86273d33275e487f93e29fc595be3a21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0fbc76c8a3147ce96b7c4dcdfec596a" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 34003 } } peers { permanent_uuid: "86273d33275e487f93e29fc595be3a21" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37905 } } peers { permanent_uuid: "82a851e21fb94256845678248f310c6b" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 42465 } }
I20260811 15:06:48.377233 6610 consensus_queue.cc:260] T d77302d5645b4f37b1f9810c8ad333b2 P b0fbc76c8a3147ce96b7c4dcdfec596a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0fbc76c8a3147ce96b7c4dcdfec596a" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 34003 } } peers { permanent_uuid: "86273d33275e487f93e29fc595be3a21" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37905 } } peers { permanent_uuid: "82a851e21fb94256845678248f310c6b" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 42465 } }
I20260811 15:06:48.378437 6610 ts_tablet_manager.cc:1428] T d77302d5645b4f37b1f9810c8ad333b2 P b0fbc76c8a3147ce96b7c4dcdfec596a: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260811 15:06:48.378469 6609 ts_tablet_manager.cc:1428] T d77302d5645b4f37b1f9810c8ad333b2 P 86273d33275e487f93e29fc595be3a21: Time spent starting tablet: real 0.007s user 0.002s sys 0.004s
I20260811 15:06:48.378897 6430 heartbeater.cc:503] Master 127.19.236.126:42765 was elected leader, sending a full tablet report...
I20260811 15:06:48.379856 6595 heartbeater.cc:503] Master 127.19.236.126:42765 was elected leader, sending a full tablet report...
W20260811 15:06:48.392289 6265 tablet.cc:2369] T d77302d5645b4f37b1f9810c8ad333b2 P 82a851e21fb94256845678248f310c6b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 15:06:48.439149 6271 raft_consensus.cc:482] T d77302d5645b4f37b1f9810c8ad333b2 P 82a851e21fb94256845678248f310c6b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 15:06:48.439421 6271 raft_consensus.cc:504] T d77302d5645b4f37b1f9810c8ad333b2 P 82a851e21fb94256845678248f310c6b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0fbc76c8a3147ce96b7c4dcdfec596a" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 34003 } } peers { permanent_uuid: "86273d33275e487f93e29fc595be3a21" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37905 } } peers { permanent_uuid: "82a851e21fb94256845678248f310c6b" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 42465 } }
I20260811 15:06:48.440658 6271 leader_election.cc:288] T d77302d5645b4f37b1f9810c8ad333b2 P 82a851e21fb94256845678248f310c6b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0fbc76c8a3147ce96b7c4dcdfec596a (127.19.236.66:34003), 86273d33275e487f93e29fc595be3a21 (127.19.236.67:37905)
I20260811 15:06:48.445040 6605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:48.441107 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.65:53039 (local address 127.19.236.66:34003)
0811 15:06:48.441263 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0811 15:06:48.441268 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:06:48.441561 (+ 293us) server_negotiation.cc:407] Connection header received
0811 15:06:48.441779 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:06:48.441783 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:06:48.441841 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:06:48.441937 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:06:48.442213 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:48.442722 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:48.443938 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:48.444337 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:48.444472 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:48.444531 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 15:06:48.444829 (+ 298us) server_negotiation.cc:299] Negotiation successful
0811 15:06:48.444906 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 15:06:48.445040 6607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:48.441066 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.65:33173 (local address 127.19.236.67:37905)
0811 15:06:48.441295 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0811 15:06:48.441301 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 15:06:48.441685 (+ 384us) server_negotiation.cc:407] Connection header received
0811 15:06:48.441842 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:06:48.441845 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:06:48.441896 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:06:48.441978 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:06:48.442260 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:48.442760 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:48.443936 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:48.444339 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:48.444469 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:48.444537 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 15:06:48.444829 (+ 292us) server_negotiation.cc:299] Negotiation successful
0811 15:06:48.444902 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132}
I20260811 15:06:48.445058 6617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:48.440933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.67:37905 (local address 127.19.236.65:33173)
0811 15:06:48.441581 (+ 648us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:48.441602 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 15:06:48.441728 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:06:48.442008 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:06:48.442011 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:06:48.442029 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:06:48.442152 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:06:48.442157 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:06:48.442877 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:06:48.442881 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:06:48.443808 (+ 927us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:06:48.443818 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:06:48.444469 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:06:48.444473 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:06:48.444678 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:48.444715 (+ 37us) client_negotiation.cc:769] Sending connection context
0811 15:06:48.444810 (+ 95us) client_negotiation.cc:240] Negotiation successful
0811 15:06:48.444915 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":558,"mutex_wait_us":282,"thread_start_us":65,"threads_started":1}
I20260811 15:06:48.445062 6615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:48.440933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.66:34003 (local address 127.19.236.65:53039)
0811 15:06:48.441447 (+ 514us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:48.441463 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 15:06:48.441603 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:06:48.441942 (+ 339us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:06:48.441945 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:06:48.441963 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:06:48.442096 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:06:48.442102 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:06:48.442835 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:06:48.442840 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:06:48.443804 (+ 964us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:06:48.443814 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:06:48.444472 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:06:48.444476 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:06:48.444669 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:48.444710 (+ 41us) client_negotiation.cc:769] Sending connection context
0811 15:06:48.444801 (+ 91us) client_negotiation.cc:240] Negotiation successful
0811 15:06:48.444904 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":429,"mutex_wait_us":68,"thread_start_us":109,"threads_started":1}
I20260811 15:06:48.445752 6537 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d77302d5645b4f37b1f9810c8ad333b2" candidate_uuid: "82a851e21fb94256845678248f310c6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86273d33275e487f93e29fc595be3a21" is_pre_election: true
I20260811 15:06:48.446134 6537 raft_consensus.cc:2454] T d77302d5645b4f37b1f9810c8ad333b2 P 86273d33275e487f93e29fc595be3a21 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82a851e21fb94256845678248f310c6b in term 0.
I20260811 15:06:48.446267 6370 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d77302d5645b4f37b1f9810c8ad333b2" candidate_uuid: "82a851e21fb94256845678248f310c6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0fbc76c8a3147ce96b7c4dcdfec596a" is_pre_election: true
I20260811 15:06:48.446550 6370 raft_consensus.cc:2454] T d77302d5645b4f37b1f9810c8ad333b2 P b0fbc76c8a3147ce96b7c4dcdfec596a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82a851e21fb94256845678248f310c6b in term 0.
I20260811 15:06:48.447017 6128 leader_election.cc:302] T d77302d5645b4f37b1f9810c8ad333b2 P 82a851e21fb94256845678248f310c6b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 82a851e21fb94256845678248f310c6b, 86273d33275e487f93e29fc595be3a21, b0fbc76c8a3147ce96b7c4dcdfec596a; no voters:
I20260811 15:06:48.447291 6271 raft_consensus.cc:2781] T d77302d5645b4f37b1f9810c8ad333b2 P 82a851e21fb94256845678248f310c6b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 15:06:48.447397 6271 raft_consensus.cc:482] T d77302d5645b4f37b1f9810c8ad333b2 P 82a851e21fb94256845678248f310c6b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 15:06:48.447460 6271 raft_consensus.cc:3037] T d77302d5645b4f37b1f9810c8ad333b2 P 82a851e21fb94256845678248f310c6b [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:06:48.448493 6271 raft_consensus.cc:504] T d77302d5645b4f37b1f9810c8ad333b2 P 82a851e21fb94256845678248f310c6b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0fbc76c8a3147ce96b7c4dcdfec596a" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 34003 } } peers { permanent_uuid: "86273d33275e487f93e29fc595be3a21" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37905 } } peers { permanent_uuid: "82a851e21fb94256845678248f310c6b" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 42465 } }
I20260811 15:06:48.448930 6271 leader_election.cc:288] T d77302d5645b4f37b1f9810c8ad333b2 P 82a851e21fb94256845678248f310c6b [CANDIDATE]: Term 1 election: Requested vote from peers b0fbc76c8a3147ce96b7c4dcdfec596a (127.19.236.66:34003), 86273d33275e487f93e29fc595be3a21 (127.19.236.67:37905)
I20260811 15:06:48.449326 6537 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d77302d5645b4f37b1f9810c8ad333b2" candidate_uuid: "82a851e21fb94256845678248f310c6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86273d33275e487f93e29fc595be3a21"
I20260811 15:06:48.449381 6370 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d77302d5645b4f37b1f9810c8ad333b2" candidate_uuid: "82a851e21fb94256845678248f310c6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0fbc76c8a3147ce96b7c4dcdfec596a"
I20260811 15:06:48.449466 6537 raft_consensus.cc:3037] T d77302d5645b4f37b1f9810c8ad333b2 P 86273d33275e487f93e29fc595be3a21 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:06:48.449532 6370 raft_consensus.cc:3037] T d77302d5645b4f37b1f9810c8ad333b2 P b0fbc76c8a3147ce96b7c4dcdfec596a [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:06:48.450564 6537 raft_consensus.cc:2454] T d77302d5645b4f37b1f9810c8ad333b2 P 86273d33275e487f93e29fc595be3a21 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82a851e21fb94256845678248f310c6b in term 1.
I20260811 15:06:48.450580 6370 raft_consensus.cc:2454] T d77302d5645b4f37b1f9810c8ad333b2 P b0fbc76c8a3147ce96b7c4dcdfec596a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82a851e21fb94256845678248f310c6b in term 1.
I20260811 15:06:48.450888 6128 leader_election.cc:302] T d77302d5645b4f37b1f9810c8ad333b2 P 82a851e21fb94256845678248f310c6b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82a851e21fb94256845678248f310c6b, 86273d33275e487f93e29fc595be3a21; no voters:
I20260811 15:06:48.451086 6271 raft_consensus.cc:2781] T d77302d5645b4f37b1f9810c8ad333b2 P 82a851e21fb94256845678248f310c6b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:06:48.451246 6271 raft_consensus.cc:686] T d77302d5645b4f37b1f9810c8ad333b2 P 82a851e21fb94256845678248f310c6b [term 1 LEADER]: Becoming Leader. State: Replica: 82a851e21fb94256845678248f310c6b, State: Running, Role: LEADER
I20260811 15:06:48.451756 6271 consensus_queue.cc:237] T d77302d5645b4f37b1f9810c8ad333b2 P 82a851e21fb94256845678248f310c6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0fbc76c8a3147ce96b7c4dcdfec596a" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 34003 } } peers { permanent_uuid: "86273d33275e487f93e29fc595be3a21" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37905 } } peers { permanent_uuid: "82a851e21fb94256845678248f310c6b" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 42465 } }
I20260811 15:06:48.454818 6034 catalog_manager.cc:5495] T d77302d5645b4f37b1f9810c8ad333b2 P 82a851e21fb94256845678248f310c6b reported cstate change: term changed from 0 to 1, leader changed from <none> to 82a851e21fb94256845678248f310c6b (127.19.236.65). New cstate: current_term: 1 leader_uuid: "82a851e21fb94256845678248f310c6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0fbc76c8a3147ce96b7c4dcdfec596a" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 34003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86273d33275e487f93e29fc595be3a21" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82a851e21fb94256845678248f310c6b" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 42465 } health_report { overall_health: HEALTHY } } }
I20260811 15:06:48.485765 6625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:48.481533 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40820 (local address 127.19.236.65:42465)
0811 15:06:48.481941 (+ 408us) server_negotiation.cc:206] Beginning negotiation
0811 15:06:48.481951 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 15:06:48.481973 (+ 22us) server_negotiation.cc:407] Connection header received
0811 15:06:48.482078 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:06:48.482084 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:06:48.482172 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:06:48.482328 (+ 156us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 15:06:48.482660 (+ 332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:48.483370 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:48.484225 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:06:48.484472 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:06:48.484607 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:06:48.484908 (+ 301us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 15:06:48.485346 (+ 438us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 15:06:48.485489 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0811 15:06:48.485531 (+ 42us) server_negotiation.cc:299] Negotiation successful
0811 15:06:48.485589 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":305,"thread_start_us":124,"threads_started":1}
I20260811 15:06:48.489737 6370 raft_consensus.cc:1261] T d77302d5645b4f37b1f9810c8ad333b2 P b0fbc76c8a3147ce96b7c4dcdfec596a [term 1 FOLLOWER]: Refusing update from remote peer 82a851e21fb94256845678248f310c6b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:06:48.489737 6537 raft_consensus.cc:1261] T d77302d5645b4f37b1f9810c8ad333b2 P 86273d33275e487f93e29fc595be3a21 [term 1 FOLLOWER]: Refusing update from remote peer 82a851e21fb94256845678248f310c6b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:06:48.490470 6271 consensus_queue.cc:1035] T d77302d5645b4f37b1f9810c8ad333b2 P 82a851e21fb94256845678248f310c6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "86273d33275e487f93e29fc595be3a21" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:06:48.490712 6618 consensus_queue.cc:1035] T d77302d5645b4f37b1f9810c8ad333b2 P 82a851e21fb94256845678248f310c6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0fbc76c8a3147ce96b7c4dcdfec596a" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 34003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:06:48.498451 6626 mvcc.cc:205] Tried to move back new op lower bound from 7317343471566536704 to 7317343471420309504. Current Snapshot: MvccSnapshot[applied={T|T < 7317343471566536704}]
I20260811 15:06:48.498733 6628 mvcc.cc:205] Tried to move back new op lower bound from 7317343471566536704 to 7317343471420309504. Current Snapshot: MvccSnapshot[applied={T|T < 7317343471566536704}]
I20260811 15:06:48.499413 6627 mvcc.cc:205] Tried to move back new op lower bound from 7317343471566536704 to 7317343471420309504. Current Snapshot: MvccSnapshot[applied={T|T < 7317343471566536704}]
I20260811 15:06:48.509219 6034 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53342:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 15:06:48.509420 6034 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53342:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 15:06:48.512006 6034 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bbac445142d44bb88e8007cbf65f9397: Sending DeleteTablet for 3 replicas of tablet d77302d5645b4f37b1f9810c8ad333b2
I20260811 15:06:48.512805 6185 tablet_service.cc:1514] Processing DeleteTablet for tablet d77302d5645b4f37b1f9810c8ad333b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:06:48 UTC) from {username='kudu', principal='kudu/127.19.236.126@KRBTEST.COM'} at 127.0.0.1:40818
I20260811 15:06:48.512826 6514 tablet_service.cc:1514] Processing DeleteTablet for tablet d77302d5645b4f37b1f9810c8ad333b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:06:48 UTC) from {username='kudu', principal='kudu/127.19.236.126@KRBTEST.COM'} at 127.0.0.1:59244
I20260811 15:06:48.512830 6346 tablet_service.cc:1514] Processing DeleteTablet for tablet d77302d5645b4f37b1f9810c8ad333b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:06:48 UTC) from {username='kudu', principal='kudu/127.19.236.126@KRBTEST.COM'} at 127.0.0.1:37724
I20260811 15:06:48.513338 6640 tablet_replica.cc:330] T d77302d5645b4f37b1f9810c8ad333b2 P b0fbc76c8a3147ce96b7c4dcdfec596a: stopping tablet replica
I20260811 15:06:48.513564 6639 tablet_replica.cc:330] T d77302d5645b4f37b1f9810c8ad333b2 P 86273d33275e487f93e29fc595be3a21: stopping tablet replica
I20260811 15:06:48.513592 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 6084
I20260811 15:06:48.513715 6640 raft_consensus.cc:2229] T d77302d5645b4f37b1f9810c8ad333b2 P b0fbc76c8a3147ce96b7c4dcdfec596a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 15:06:48.514016 6640 raft_consensus.cc:2258] T d77302d5645b4f37b1f9810c8ad333b2 P b0fbc76c8a3147ce96b7c4dcdfec596a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:06:48.518011 6639 raft_consensus.cc:2229] T d77302d5645b4f37b1f9810c8ad333b2 P 86273d33275e487f93e29fc595be3a21 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 15:06:48.518376 6639 raft_consensus.cc:2258] T d77302d5645b4f37b1f9810c8ad333b2 P 86273d33275e487f93e29fc595be3a21 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:06:48.519786 6640 ts_tablet_manager.cc:1905] T d77302d5645b4f37b1f9810c8ad333b2 P b0fbc76c8a3147ce96b7c4dcdfec596a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 15:06:48.519874 6639 ts_tablet_manager.cc:1905] T d77302d5645b4f37b1f9810c8ad333b2 P 86273d33275e487f93e29fc595be3a21: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 15:06:48.522245 6640 ts_tablet_manager.cc:1918] T d77302d5645b4f37b1f9810c8ad333b2 P b0fbc76c8a3147ce96b7c4dcdfec596a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 15:06:48.522372 6640 log.cc:1196] T d77302d5645b4f37b1f9810c8ad333b2 P b0fbc76c8a3147ce96b7c4dcdfec596a: Deleting WAL directory at /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-1/wal/wals/d77302d5645b4f37b1f9810c8ad333b2
I20260811 15:06:48.522693 6640 ts_tablet_manager.cc:1939] T d77302d5645b4f37b1f9810c8ad333b2 P b0fbc76c8a3147ce96b7c4dcdfec596a: Deleting consensus metadata
I20260811 15:06:48.523401 6639 ts_tablet_manager.cc:1918] T d77302d5645b4f37b1f9810c8ad333b2 P 86273d33275e487f93e29fc595be3a21: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 15:06:48.523507 6639 log.cc:1196] T d77302d5645b4f37b1f9810c8ad333b2 P 86273d33275e487f93e29fc595be3a21: Deleting WAL directory at /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-2/wal/wals/d77302d5645b4f37b1f9810c8ad333b2
I20260811 15:06:48.523859 6639 ts_tablet_manager.cc:1939] T d77302d5645b4f37b1f9810c8ad333b2 P 86273d33275e487f93e29fc595be3a21: Deleting consensus metadata
I20260811 15:06:48.523974 6019 catalog_manager.cc:4841] TS b0fbc76c8a3147ce96b7c4dcdfec596a (127.19.236.66:34003): tablet d77302d5645b4f37b1f9810c8ad333b2 (table test-table [id=04c84d7317e743febda87a485068f1df]) successfully deleted
I20260811 15:06:48.525197 6018 catalog_manager.cc:4841] TS 86273d33275e487f93e29fc595be3a21 (127.19.236.67:37905): tablet d77302d5645b4f37b1f9810c8ad333b2 (table test-table [id=04c84d7317e743febda87a485068f1df]) successfully deleted
W20260811 15:06:48.525724 6020 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.19.236.65:42465 (error 108)
I20260811 15:06:48.526716 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 6268
I20260811 15:06:48.526966 6606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:06:48.526613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.65:42465 (local address 127.0.0.1:40830)
0811 15:06:48.526773 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0811 15:06:48.526858 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.65:42465: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260811 15:06:48.529713 6020 catalog_manager.cc:4584] TS 82a851e21fb94256845678248f310c6b (127.19.236.65:42465): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d77302d5645b4f37b1f9810c8ad333b2: Network error: Client connection negotiation failed: client connection to 127.19.236.65:42465: connect: Connection refused (error 111)
I20260811 15:06:48.535804 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 6433
I20260811 15:06:48.545182 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 5997
I20260811 15:07:08.554518 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:42765
--webserver_interface=127.19.236.126
--webserver_port=39061
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab
--principal=kudu/127.19.236.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:43709
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.236.126:42765
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:07:08.669624 6642 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:07:08.669943 6642 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:07:08.670028 6642 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:07:08.674080 6642 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 15:07:08.674158 6642 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 15:07:08.674185 6642 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 15:07:08.674216 6642 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:07:08.674260 6642 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:07:08.674304 6642 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:07:08.674340 6642 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:07:08.674376 6642 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:07:08.679644 6642 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:43709
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.19.236.126:42765
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab
--principal=kudu/127.19.236.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:42765
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.236.126
--webserver_port=39061
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6642
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:07:08.680840 6642 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:07:08.681891 6642 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 15:07:08.690853 6642 server_base.cc:1034] running on GCE node
W20260811 15:07:08.690860 6647 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:07:08.690805 6650 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:07:08.690814 6648 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:07:08.691586 6642 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:07:08.692792 6642 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:07:08.693960 6642 hybrid_clock.cc:648] HybridClock initialized: now 1786460828693948 us; error 28 us; skew 500 ppm
Aug 11 15:07:08 dist-test-slave-8n49 krb5kdc[5356](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460828, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:07:08.696826 6642 init.cc:377] Logged in from keytab as kudu/127.19.236.126@KRBTEST.COM (short username kudu)
I20260811 15:07:08.697753 6642 webserver.cc:460] Webserver started at http://127.19.236.126:39061/ using document root <none> and password file <none>
I20260811 15:07:08.698278 6642 fs_manager.cc:359] Metadata directory not provided
I20260811 15:07:08.698338 6642 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:07:08.702194 6642 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260811 15:07:08.704322 6657 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:07:08.705579 6642 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 15:07:08.705719 6642 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/master-0/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/master-0/wal
uuid: "bbac445142d44bb88e8007cbf65f9397"
format_stamp: "Formatted at 2026-08-11 15:06:26 on dist-test-slave-8n49"
server_key: "5165d26abeb91ab3809442f4a6ed0352"
server_key_iv: "981f56a8b68aa637908fcc5109ab68ce"
server_key_version: "encryptionkey@0"
I20260811 15:07:08.706279 6642 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:07:08.721026 6642 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:07:08.724270 6642 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:07:08.724478 6642 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:07:08.731765 6642 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.126:42765
I20260811 15:07:08.732100 6716 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.126:42765 every 8 connection(s)
I20260811 15:07:08.732920 6642 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
I20260811 15:07:08.737558 6717 sys_catalog.cc:263] Verifying existing consensus state
I20260811 15:07:08.739257 6717 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bbac445142d44bb88e8007cbf65f9397: Bootstrap starting.
I20260811 15:07:08.742156 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 6642
I20260811 15:07:08.742619 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.65:42465
--local_ip_for_outbound_sockets=127.19.236.65
--tserver_master_addrs=127.19.236.126:42765
--webserver_port=46039
--webserver_interface=127.19.236.65
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.65.keytab
--principal=kudu/127.19.236.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:43709
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 15:07:08.758577 6717 log.cc:824] T 00000000000000000000000000000000 P bbac445142d44bb88e8007cbf65f9397: Log is configured to *not* fsync() on all Append() calls
I20260811 15:07:08.770968 6717 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bbac445142d44bb88e8007cbf65f9397: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 15:07:08.771411 6717 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bbac445142d44bb88e8007cbf65f9397: Bootstrap complete.
I20260811 15:07:08.775954 6717 raft_consensus.cc:348] T 00000000000000000000000000000000 P bbac445142d44bb88e8007cbf65f9397 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbac445142d44bb88e8007cbf65f9397" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 42765 } }
I20260811 15:07:08.776410 6717 raft_consensus.cc:729] T 00000000000000000000000000000000 P bbac445142d44bb88e8007cbf65f9397 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbac445142d44bb88e8007cbf65f9397, State: Initialized, Role: FOLLOWER
I20260811 15:07:08.776988 6717 consensus_queue.cc:260] T 00000000000000000000000000000000 P bbac445142d44bb88e8007cbf65f9397 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbac445142d44bb88e8007cbf65f9397" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 42765 } }
I20260811 15:07:08.777148 6717 raft_consensus.cc:388] T 00000000000000000000000000000000 P bbac445142d44bb88e8007cbf65f9397 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 15:07:08.777251 6717 raft_consensus.cc:482] T 00000000000000000000000000000000 P bbac445142d44bb88e8007cbf65f9397 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 15:07:08.777400 6717 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bbac445142d44bb88e8007cbf65f9397 [term 2 FOLLOWER]: Advancing to term 3
I20260811 15:07:08.779455 6717 raft_consensus.cc:504] T 00000000000000000000000000000000 P bbac445142d44bb88e8007cbf65f9397 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbac445142d44bb88e8007cbf65f9397" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 42765 } }
I20260811 15:07:08.779816 6717 leader_election.cc:302] T 00000000000000000000000000000000 P bbac445142d44bb88e8007cbf65f9397 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bbac445142d44bb88e8007cbf65f9397; no voters:
I20260811 15:07:08.780205 6717 leader_election.cc:288] T 00000000000000000000000000000000 P bbac445142d44bb88e8007cbf65f9397 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260811 15:07:08.780301 6722 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bbac445142d44bb88e8007cbf65f9397 [term 3 FOLLOWER]: Leader election won for term 3
I20260811 15:07:08.780543 6722 raft_consensus.cc:686] T 00000000000000000000000000000000 P bbac445142d44bb88e8007cbf65f9397 [term 3 LEADER]: Becoming Leader. State: Replica: bbac445142d44bb88e8007cbf65f9397, State: Running, Role: LEADER
I20260811 15:07:08.780973 6722 consensus_queue.cc:237] T 00000000000000000000000000000000 P bbac445142d44bb88e8007cbf65f9397 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbac445142d44bb88e8007cbf65f9397" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 42765 } }
I20260811 15:07:08.781622 6717 sys_catalog.cc:564] T 00000000000000000000000000000000 P bbac445142d44bb88e8007cbf65f9397 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:07:08.782424 6723 sys_catalog.cc:455] T 00000000000000000000000000000000 P bbac445142d44bb88e8007cbf65f9397 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "bbac445142d44bb88e8007cbf65f9397" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbac445142d44bb88e8007cbf65f9397" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 42765 } } }
I20260811 15:07:08.782574 6723 sys_catalog.cc:458] T 00000000000000000000000000000000 P bbac445142d44bb88e8007cbf65f9397 [sys.catalog]: This master's current role is: LEADER
I20260811 15:07:08.783448 6724 sys_catalog.cc:455] T 00000000000000000000000000000000 P bbac445142d44bb88e8007cbf65f9397 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bbac445142d44bb88e8007cbf65f9397. Latest consensus state: current_term: 3 leader_uuid: "bbac445142d44bb88e8007cbf65f9397" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbac445142d44bb88e8007cbf65f9397" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 42765 } } }
I20260811 15:07:08.783545 6724 sys_catalog.cc:458] T 00000000000000000000000000000000 P bbac445142d44bb88e8007cbf65f9397 [sys.catalog]: This master's current role is: LEADER
I20260811 15:07:08.784178 6731 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:07:08.790088 6731 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:07:08.790717 6731 catalog_manager.cc:1259] Loaded cluster ID: 0b6d5e69c5a64105a6b35654e2e56b44
I20260811 15:07:08.790777 6731 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:07:08.793640 6731 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:07:08.794379 6731 catalog_manager.cc:5879] T 00000000000000000000000000000000 P bbac445142d44bb88e8007cbf65f9397: Loaded TSK: 0
I20260811 15:07:08.794502 6731 catalog_manager.cc:5879] T 00000000000000000000000000000000 P bbac445142d44bb88e8007cbf65f9397: Loaded TSK: 1
F20260811 15:07:08.795239 6731 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f1aa03c49ad google::LogMessage::Fail() at ??:0
@ 0x7f1aa03c788a google::LogMessage::SendToLog() at ??:0
@ 0x7f1aa03c44de google::LogMessage::Flush() at ??:0
@ 0x7f1aa03c5a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f1aa308818d kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f1aa3080f0d kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f1aaad297bb kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f1aaad0399c kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f1aaad04178 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlvE3_clEv at ??:0
@ 0x7f1aaad45df8 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f1aaad6482b std::function<>::operator()() at ??:0
@ 0x7f1aaad03b4f _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_ at ??:0
@ 0x7f1aaad04f3e kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f1aaad01579 _ZZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvENKUlvE_clEv at ??:0
@ 0x7f1aaad45640 _ZNSt17_Function_handlerIFvvEZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f1aa26163d7 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f1aa2616c83 _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7f1aa26183f2 _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f1aa2607512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f1aa3c4b6db start_thread at ??:0
@ 0x7f1a9eec261f clone at ??:0
W20260811 15:07:08.885298 6720 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:07:08.885615 6720 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:07:08.885682 6720 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:07:08.890235 6720 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:07:08.890287 6720 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:07:08.890352 6720 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.65
I20260811 15:07:08.896404 6720 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:43709
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.65.keytab
--principal=kudu/127.19.236.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.65:42465
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.236.65
--webserver_port=46039
--tserver_master_addrs=127.19.236.126:42765
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6720
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.65
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:07:08.897998 6720 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:07:08.899114 6720 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:07:08.909204 6775 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:07:08.909528 6720 server_base.cc:1034] running on GCE node
W20260811 15:07:08.909740 6780 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:07:08.909780 6776 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:07:08.910292 6720 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:07:08.911087 6720 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:07:08.912257 6720 hybrid_clock.cc:648] HybridClock initialized: now 1786460828912221 us; error 46 us; skew 500 ppm
Aug 11 15:07:08 dist-test-slave-8n49 krb5kdc[5356](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460828, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:07:08.915086 6720 init.cc:377] Logged in from keytab as kudu/127.19.236.65@KRBTEST.COM (short username kudu)
I20260811 15:07:08.915949 6720 webserver.cc:460] Webserver started at http://127.19.236.65:46039/ using document root <none> and password file <none>
I20260811 15:07:08.916538 6720 fs_manager.cc:359] Metadata directory not provided
I20260811 15:07:08.916689 6720 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:07:08.920734 6720 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.002s
I20260811 15:07:08.923030 6787 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:07:08.924371 6720 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 15:07:08.924511 6720 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-0/wal
uuid: "82a851e21fb94256845678248f310c6b"
format_stamp: "Formatted at 2026-08-11 15:06:26 on dist-test-slave-8n49"
server_key: "867a76624834415a3be315452b2416d8"
server_key_iv: "03f5d0e86332fc3c59ae05d14480f6ae"
server_key_version: "encryptionkey@0"
I20260811 15:07:08.925158 6720 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:07:08.943207 6720 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:07:08.946712 6720 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:07:08.946936 6720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:07:08.947706 6720 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:07:08.948917 6794 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 15:07:08.953229 6720 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 15:07:08.953299 6720 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.000s sys 0.000s
I20260811 15:07:08.953351 6720 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 15:07:08.955164 6720 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 15:07:08.955227 6720 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260811 15:07:08.955502 6794 tablet_bootstrap.cc:492] T d77302d5645b4f37b1f9810c8ad333b2 P 82a851e21fb94256845678248f310c6b: Bootstrap starting.
I20260811 15:07:08.966614 6720 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.65:42465
I20260811 15:07:08.966849 6925 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.65:42465 every 8 connection(s)
I20260811 15:07:08.968119 6720 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
I20260811 15:07:08.971624 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 6720
I20260811 15:07:08.972143 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.66:34003
--local_ip_for_outbound_sockets=127.19.236.66
--tserver_master_addrs=127.19.236.126:42765
--webserver_port=42199
--webserver_interface=127.19.236.66
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.66.keytab
--principal=kudu/127.19.236.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:43709
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 15:07:08.981937 6794 log.cc:824] T d77302d5645b4f37b1f9810c8ad333b2 P 82a851e21fb94256845678248f310c6b: Log is configured to *not* fsync() on all Append() calls
I20260811 15:07:08.993165 6794 tablet_bootstrap.cc:492] T d77302d5645b4f37b1f9810c8ad333b2 P 82a851e21fb94256845678248f310c6b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 15:07:08.993654 6794 tablet_bootstrap.cc:492] T d77302d5645b4f37b1f9810c8ad333b2 P 82a851e21fb94256845678248f310c6b: Bootstrap complete.
I20260811 15:07:08.995301 6794 ts_tablet_manager.cc:1397] T d77302d5645b4f37b1f9810c8ad333b2 P 82a851e21fb94256845678248f310c6b: Time spent bootstrapping tablet: real 0.040s user 0.025s sys 0.008s
I20260811 15:07:08.999022 6794 raft_consensus.cc:348] T d77302d5645b4f37b1f9810c8ad333b2 P 82a851e21fb94256845678248f310c6b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0fbc76c8a3147ce96b7c4dcdfec596a" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 34003 } } peers { permanent_uuid: "86273d33275e487f93e29fc595be3a21" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37905 } } peers { permanent_uuid: "82a851e21fb94256845678248f310c6b" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 42465 } }
I20260811 15:07:08.999652 6794 raft_consensus.cc:729] T d77302d5645b4f37b1f9810c8ad333b2 P 82a851e21fb94256845678248f310c6b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82a851e21fb94256845678248f310c6b, State: Initialized, Role: FOLLOWER
I20260811 15:07:09.000228 6794 consensus_queue.cc:260] T d77302d5645b4f37b1f9810c8ad333b2 P 82a851e21fb94256845678248f310c6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0fbc76c8a3147ce96b7c4dcdfec596a" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 34003 } } peers { permanent_uuid: "86273d33275e487f93e29fc595be3a21" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37905 } } peers { permanent_uuid: "82a851e21fb94256845678248f310c6b" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 42465 } }
I20260811 15:07:09.001436 6794 ts_tablet_manager.cc:1428] T d77302d5645b4f37b1f9810c8ad333b2 P 82a851e21fb94256845678248f310c6b: Time spent starting tablet: real 0.006s user 0.005s sys 0.003s
W20260811 15:07:09.045081 6929 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:07:08.970603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42765 (local address 127.19.236.65:41739)
0811 15:07:08.971249 (+ 646us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:08.971309 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0811 15:07:08.974199 (+ 2890us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:07:09.044046 (+ 69847us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:42765: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":394,"thread_start_us":181,"threads_started":1}
W20260811 15:07:09.045718 6927 heartbeater.cc:644] Failed to heartbeat to 127.19.236.126:42765 (0 consecutive failures): Network error: Failed to ping master at 127.19.236.126:42765: Client connection negotiation failed: client connection to 127.19.236.126:42765: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 15:07:09.046509 6929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:09.046216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42765 (local address 127.19.236.65:40993)
0811 15:07:09.046362 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:09.046442 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:42765: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260811 15:07:09.047189 6929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:09.046961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42765 (local address 127.19.236.65:60853)
0811 15:07:09.047079 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:09.047132 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:42765: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260811 15:07:09.047387 6927 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 15:07:09.101773 6931 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:07:09.102077 6931 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:07:09.102151 6931 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:07:09.106581 6931 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:07:09.106670 6931 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:07:09.106760 6931 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.66
I20260811 15:07:09.112322 6931 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:43709
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.66.keytab
--principal=kudu/127.19.236.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.66:34003
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.236.66
--webserver_port=42199
--tserver_master_addrs=127.19.236.126:42765
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6931
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.66
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:07:09.113543 6931 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:07:09.114620 6931 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 15:07:09.124799 6931 server_base.cc:1034] running on GCE node
W20260811 15:07:09.124749 6939 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:07:09.124763 6940 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:07:09.124749 6942 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:07:09.125495 6931 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:07:09.126083 6931 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:07:09.127251 6931 hybrid_clock.cc:648] HybridClock initialized: now 1786460829127236 us; error 26 us; skew 500 ppm
Aug 11 15:07:09 dist-test-slave-8n49 krb5kdc[5356](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460829, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:07:09.130162 6931 init.cc:377] Logged in from keytab as kudu/127.19.236.66@KRBTEST.COM (short username kudu)
I20260811 15:07:09.131105 6931 webserver.cc:460] Webserver started at http://127.19.236.66:42199/ using document root <none> and password file <none>
I20260811 15:07:09.131699 6931 fs_manager.cc:359] Metadata directory not provided
I20260811 15:07:09.131793 6931 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:07:09.135996 6931 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260811 15:07:09.138247 6950 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:07:09.139528 6931 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 15:07:09.139673 6931 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-1/wal
uuid: "b0fbc76c8a3147ce96b7c4dcdfec596a"
format_stamp: "Formatted at 2026-08-11 15:06:26 on dist-test-slave-8n49"
server_key: "fceb74f8afe31f1f3a2f4de14985ffc3"
server_key_iv: "9541c6c6dc638ff67cf591bc68dc7119"
server_key_version: "encryptionkey@0"
I20260811 15:07:09.140260 6931 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:07:09.160961 6931 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:07:09.164031 6931 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:07:09.164244 6931 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:07:09.164898 6931 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:07:09.165761 6931 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:07:09.165832 6931 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:07:09.165908 6931 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:07:09.165951 6931 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:07:09.175372 6931 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.66:34003
I20260811 15:07:09.175403 7087 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.66:34003 every 8 connection(s)
I20260811 15:07:09.176379 6931 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
I20260811 15:07:09.180351 7090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:09.178636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42765 (local address 127.19.236.66:44651)
0811 15:07:09.179541 (+ 905us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:09.179656 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:42765: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":706,"thread_start_us":536,"threads_started":1}
W20260811 15:07:09.180876 7088 heartbeater.cc:644] Failed to heartbeat to 127.19.236.126:42765 (0 consecutive failures): Network error: Failed to ping master at 127.19.236.126:42765: Client connection negotiation failed: client connection to 127.19.236.126:42765: connect: Connection refused (error 111)
I20260811 15:07:09.181445 7090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:09.181238 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42765 (local address 127.19.236.66:41139)
0811 15:07:09.181343 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:09.181387 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:42765: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260811 15:07:09.182148 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 6931
I20260811 15:07:09.182199 7090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:09.181949 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42765 (local address 127.19.236.66:59077)
0811 15:07:09.182077 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:09.182130 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:42765: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260811 15:07:09.182355 7088 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 15:07:09.182639 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.67:37905
--local_ip_for_outbound_sockets=127.19.236.67
--tserver_master_addrs=127.19.236.126:42765
--webserver_port=46151
--webserver_interface=127.19.236.67
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.67.keytab
--principal=kudu/127.19.236.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:43709
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:07:09.296957 7091 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:07:09.297226 7091 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:07:09.297269 7091 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:07:09.301257 7091 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:07:09.301318 7091 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:07:09.301409 7091 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.67
I20260811 15:07:09.306806 7091 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:43709
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.67.keytab
--principal=kudu/127.19.236.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.67:37905
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.236.67
--webserver_port=46151
--tserver_master_addrs=127.19.236.126:42765
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7091
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.67
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:07:09.307881 7091 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:07:09.308977 7091 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:07:09.318717 7098 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:07:09.318717 7097 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:07:09.318713 7100 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:07:09.318779 7091 server_base.cc:1034] running on GCE node
I20260811 15:07:09.319346 7091 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:07:09.320130 7091 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:07:09.321339 7091 hybrid_clock.cc:648] HybridClock initialized: now 1786460829321318 us; error 37 us; skew 500 ppm
Aug 11 15:07:09 dist-test-slave-8n49 krb5kdc[5356](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460829, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:07:09.324242 7091 init.cc:377] Logged in from keytab as kudu/127.19.236.67@KRBTEST.COM (short username kudu)
I20260811 15:07:09.325176 7091 webserver.cc:460] Webserver started at http://127.19.236.67:46151/ using document root <none> and password file <none>
I20260811 15:07:09.325714 7091 fs_manager.cc:359] Metadata directory not provided
I20260811 15:07:09.325776 7091 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:07:09.329898 7091 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.003s
I20260811 15:07:09.332334 7109 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:07:09.333766 7091 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 15:07:09.333902 7091 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-2/wal
uuid: "86273d33275e487f93e29fc595be3a21"
format_stamp: "Formatted at 2026-08-11 15:06:27 on dist-test-slave-8n49"
server_key: "ec5747d009020fae3a82bba9247e1413"
server_key_iv: "b4f6c907d3f14458b2245c9f88e5c18b"
server_key_version: "encryptionkey@0"
I20260811 15:07:09.334491 7091 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:07:09.359875 7091 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:07:09.363507 7091 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:07:09.363742 7091 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:07:09.364408 7091 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:07:09.365332 7091 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:07:09.365382 7091 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:07:09.365460 7091 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:07:09.365502 7091 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:07:09.376852 7091 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.67:37905
I20260811 15:07:09.376940 7239 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.67:37905 every 8 connection(s)
I20260811 15:07:09.378321 7091 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
I20260811 15:07:09.381342 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 7091
I20260811 15:07:09.382961 7242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:09.380764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42765 (local address 127.19.236.67:50975)
0811 15:07:09.381339 (+ 575us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:09.381500 (+ 161us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:42765: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":330,"thread_start_us":118,"threads_started":1}
W20260811 15:07:09.383424 7240 heartbeater.cc:644] Failed to heartbeat to 127.19.236.126:42765 (0 consecutive failures): Network error: Failed to ping master at 127.19.236.126:42765: Client connection negotiation failed: client connection to 127.19.236.126:42765: connect: Connection refused (error 111)
I20260811 15:07:09.384140 7242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:09.383885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42765 (local address 127.19.236.67:49183)
0811 15:07:09.384028 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:09.384083 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:42765: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260811 15:07:09.384827 7242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:09.384616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42765 (local address 127.19.236.67:43299)
0811 15:07:09.384723 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:09.384769 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:42765: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260811 15:07:09.385018 7240 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 15:07:10.048454 7244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:10.048006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42765 (local address 127.19.236.65:53181)
0811 15:07:10.048278 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:10.048338 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:42765: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":90,"threads_started":1}
I20260811 15:07:10.183377 7245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:10.182904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42765 (local address 127.19.236.66:41081)
0811 15:07:10.183202 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:10.183265 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:42765: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":97,"threads_started":1}
I20260811 15:07:10.290268 7246 raft_consensus.cc:482] T d77302d5645b4f37b1f9810c8ad333b2 P 82a851e21fb94256845678248f310c6b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 15:07:10.290530 7246 raft_consensus.cc:504] T d77302d5645b4f37b1f9810c8ad333b2 P 82a851e21fb94256845678248f310c6b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0fbc76c8a3147ce96b7c4dcdfec596a" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 34003 } } peers { permanent_uuid: "86273d33275e487f93e29fc595be3a21" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37905 } } peers { permanent_uuid: "82a851e21fb94256845678248f310c6b" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 42465 } }
I20260811 15:07:10.291764 7246 leader_election.cc:288] T d77302d5645b4f37b1f9810c8ad333b2 P 82a851e21fb94256845678248f310c6b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0fbc76c8a3147ce96b7c4dcdfec596a (127.19.236.66:34003), 86273d33275e487f93e29fc595be3a21 (127.19.236.67:37905)
Aug 11 15:07:10 dist-test-slave-8n49 krb5kdc[5356](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460828, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.65@KRBTEST.COM for kudu/127.19.236.67@KRBTEST.COM
Aug 11 15:07:10 dist-test-slave-8n49 krb5kdc[5356](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460828, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.65@KRBTEST.COM for kudu/127.19.236.66@KRBTEST.COM
I20260811 15:07:10.306490 7244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:10.291977 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.66:34003 (local address 127.19.236.65:59293)
0811 15:07:10.292167 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:10.292184 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 15:07:10.292298 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:07:10.294444 (+ 2146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:07:10.294451 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:07:10.295061 (+ 610us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:07:10.295554 (+ 493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:10.295568 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:10.296909 (+ 1341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:10.296913 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:10.297956 (+ 1043us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:10.297966 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:10.298698 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:10.298702 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:10.298928 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:10.299649 (+ 721us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:07:10.299667 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:07:10.301619 (+ 1952us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:07:10.303751 (+ 2132us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:07:10.303756 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:07:10.303771 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:07:10.304097 (+ 326us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:07:10.304514 (+ 417us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:07:10.304517 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:07:10.304518 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:07:10.304732 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:07:10.305574 (+ 842us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:07:10.305581 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:07:10.305842 (+ 261us) client_negotiation.cc:769] Sending connection context
0811 15:07:10.306008 (+ 166us) client_negotiation.cc:240] Negotiation successful
0811 15:07:10.306334 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"mutex_wait_us":292,"spinlock_wait_cycles":29312}
I20260811 15:07:10.306492 7247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:10.292058 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.67:37905 (local address 127.19.236.65:53205)
0811 15:07:10.292424 (+ 366us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:10.292448 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 15:07:10.292581 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:07:10.294444 (+ 1863us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:07:10.294451 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:07:10.295059 (+ 608us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:07:10.295553 (+ 494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:10.295569 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:10.296917 (+ 1348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:10.296921 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:10.297957 (+ 1036us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:10.297967 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:10.298697 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:10.298701 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:10.298925 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:10.299707 (+ 782us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:07:10.299719 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:07:10.301373 (+ 1654us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:07:10.304007 (+ 2634us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:07:10.304011 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:07:10.304013 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:07:10.304245 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:07:10.304618 (+ 373us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:07:10.304620 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:07:10.304622 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:07:10.304732 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:07:10.305578 (+ 846us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:07:10.305582 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:07:10.305843 (+ 261us) client_negotiation.cc:769] Sending connection context
0811 15:07:10.306005 (+ 162us) client_negotiation.cc:240] Negotiation successful
0811 15:07:10.306270 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":282,"mutex_wait_us":167,"spinlock_wait_cycles":28416,"thread_start_us":65,"threads_started":1}
I20260811 15:07:10.306895 7249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:10.292257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.65:53205 (local address 127.19.236.67:37905)
0811 15:07:10.292683 (+ 426us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:10.292693 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:10.292725 (+ 32us) server_negotiation.cc:407] Connection header received
0811 15:07:10.293570 (+ 845us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:10.293580 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:10.294035 (+ 455us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:10.294366 (+ 331us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:07:10.295734 (+ 1368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:10.296790 (+ 1056us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:10.298101 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:10.298561 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:10.298732 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:10.301932 (+ 3200us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:07:10.301937 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:07:10.301950 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:07:10.301978 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:07:10.303894 (+ 1916us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:07:10.304355 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:07:10.304360 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:07:10.304365 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:07:10.304511 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:07:10.304837 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:07:10.304840 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:07:10.304842 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:07:10.305359 (+ 517us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:07:10.305597 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:10.306153 (+ 556us) server_negotiation.cc:299] Negotiation successful
0811 15:07:10.306439 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":321,"thread_start_us":94,"threads_started":1}
I20260811 15:07:10.307120 7248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:10.292189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.65:59293 (local address 127.19.236.66:34003)
0811 15:07:10.292610 (+ 421us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:10.292640 (+ 30us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:10.292687 (+ 47us) server_negotiation.cc:407] Connection header received
0811 15:07:10.293590 (+ 903us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:10.293597 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:10.294036 (+ 439us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:10.294366 (+ 330us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:07:10.295748 (+ 1382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:10.296762 (+ 1014us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:10.298089 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:10.298558 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:10.298733 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:10.301863 (+ 3130us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:07:10.301870 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:07:10.301898 (+ 28us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:07:10.301927 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:07:10.303613 (+ 1686us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:07:10.304219 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:07:10.304224 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:07:10.304228 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:07:10.304396 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:07:10.304837 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:07:10.304841 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:07:10.304842 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:07:10.305359 (+ 517us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:07:10.306259 (+ 900us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:10.306394 (+ 135us) server_negotiation.cc:299] Negotiation successful
0811 15:07:10.306940 (+ 546us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":275,"thread_start_us":98,"threads_started":1}
W20260811 15:07:10.309352 6789 leader_election.cc:341] T d77302d5645b4f37b1f9810c8ad333b2 P 82a851e21fb94256845678248f310c6b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 86273d33275e487f93e29fc595be3a21 (127.19.236.67:37905): Not found: Tablet not found: d77302d5645b4f37b1f9810c8ad333b2
W20260811 15:07:10.309512 6790 leader_election.cc:341] T d77302d5645b4f37b1f9810c8ad333b2 P 82a851e21fb94256845678248f310c6b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b0fbc76c8a3147ce96b7c4dcdfec596a (127.19.236.66:34003): Not found: Tablet not found: d77302d5645b4f37b1f9810c8ad333b2
I20260811 15:07:10.309623 6790 leader_election.cc:302] T d77302d5645b4f37b1f9810c8ad333b2 P 82a851e21fb94256845678248f310c6b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82a851e21fb94256845678248f310c6b; no voters: 86273d33275e487f93e29fc595be3a21, b0fbc76c8a3147ce96b7c4dcdfec596a
I20260811 15:07:10.309897 7246 raft_consensus.cc:2726] T d77302d5645b4f37b1f9810c8ad333b2 P 82a851e21fb94256845678248f310c6b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 15:07:10.385975 7250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:10.385556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42765 (local address 127.19.236.67:46311)
0811 15:07:10.385824 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:10.385876 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:42765: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":94,"threads_started":1}
I20260811 15:07:11.049693 7251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:11.049243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42765 (local address 127.19.236.65:45213)
0811 15:07:11.049536 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:11.049590 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:42765: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":220,"thread_start_us":101,"threads_started":1}
I20260811 15:07:11.184522 7252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:11.184121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42765 (local address 127.19.236.66:58755)
0811 15:07:11.184373 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:11.184430 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:42765: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":74,"threads_started":1}
I20260811 15:07:11.387432 7253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:11.386841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42765 (local address 127.19.236.67:53805)
0811 15:07:11.387198 (+ 357us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:11.387281 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:42765: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":97,"threads_started":1}
I20260811 15:07:11.946029 7254 raft_consensus.cc:482] T d77302d5645b4f37b1f9810c8ad333b2 P 82a851e21fb94256845678248f310c6b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 15:07:11.946162 7254 raft_consensus.cc:504] T d77302d5645b4f37b1f9810c8ad333b2 P 82a851e21fb94256845678248f310c6b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0fbc76c8a3147ce96b7c4dcdfec596a" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 34003 } } peers { permanent_uuid: "86273d33275e487f93e29fc595be3a21" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37905 } } peers { permanent_uuid: "82a851e21fb94256845678248f310c6b" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 42465 } }
I20260811 15:07:11.946637 7254 leader_election.cc:288] T d77302d5645b4f37b1f9810c8ad333b2 P 82a851e21fb94256845678248f310c6b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0fbc76c8a3147ce96b7c4dcdfec596a (127.19.236.66:34003), 86273d33275e487f93e29fc595be3a21 (127.19.236.67:37905)
W20260811 15:07:11.947546 6789 leader_election.cc:341] T d77302d5645b4f37b1f9810c8ad333b2 P 82a851e21fb94256845678248f310c6b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 86273d33275e487f93e29fc595be3a21 (127.19.236.67:37905): Not found: Tablet not found: d77302d5645b4f37b1f9810c8ad333b2
W20260811 15:07:11.947693 6790 leader_election.cc:341] T d77302d5645b4f37b1f9810c8ad333b2 P 82a851e21fb94256845678248f310c6b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b0fbc76c8a3147ce96b7c4dcdfec596a (127.19.236.66:34003): Not found: Tablet not found: d77302d5645b4f37b1f9810c8ad333b2
I20260811 15:07:11.947793 6790 leader_election.cc:302] T d77302d5645b4f37b1f9810c8ad333b2 P 82a851e21fb94256845678248f310c6b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82a851e21fb94256845678248f310c6b; no voters: 86273d33275e487f93e29fc595be3a21, b0fbc76c8a3147ce96b7c4dcdfec596a
I20260811 15:07:11.947980 7254 raft_consensus.cc:2726] T d77302d5645b4f37b1f9810c8ad333b2 P 82a851e21fb94256845678248f310c6b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 15:07:12.051110 7255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:12.050634 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42765 (local address 127.19.236.65:46957)
0811 15:07:12.050933 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:12.051010 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:42765: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":110,"threads_started":1}
I20260811 15:07:12.185801 7256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:12.185329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42765 (local address 127.19.236.66:53869)
0811 15:07:12.185625 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:12.185686 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:42765: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":82,"threads_started":1}
I20260811 15:07:12.388844 7257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:12.388339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42765 (local address 127.19.236.67:41765)
0811 15:07:12.388690 (+ 351us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:12.388748 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:42765: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":74,"threads_started":1}
I20260811 15:07:13.052444 7258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:13.051940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42765 (local address 127.19.236.65:42979)
0811 15:07:13.052257 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:13.052322 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:42765: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":231,"thread_start_us":109,"threads_started":1}
I20260811 15:07:13.187143 7259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:13.186647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42765 (local address 127.19.236.66:55211)
0811 15:07:13.186980 (+ 333us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:13.187043 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:42765: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":135,"threads_started":1}
I20260811 15:07:13.390208 7260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:13.389750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42765 (local address 127.19.236.67:46623)
0811 15:07:13.390053 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:13.390110 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:42765: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":101,"threads_started":1}
I20260811 15:07:14.053974 7261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:14.053478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42765 (local address 127.19.236.65:43489)
0811 15:07:14.053805 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:14.053863 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:42765: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":251,"thread_start_us":91,"threads_started":1}
I20260811 15:07:14.188499 7263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:14.188009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42765 (local address 127.19.236.66:46587)
0811 15:07:14.188337 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:14.188399 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:42765: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":99,"threads_started":1}
I20260811 15:07:14.391476 7264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:14.391043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42765 (local address 127.19.236.67:55939)
0811 15:07:14.391318 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:14.391373 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:42765: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":98,"threads_started":1}
I20260811 15:07:14.994135 7265 raft_consensus.cc:482] T d77302d5645b4f37b1f9810c8ad333b2 P 82a851e21fb94256845678248f310c6b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 15:07:14.994277 7265 raft_consensus.cc:504] T d77302d5645b4f37b1f9810c8ad333b2 P 82a851e21fb94256845678248f310c6b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0fbc76c8a3147ce96b7c4dcdfec596a" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 34003 } } peers { permanent_uuid: "86273d33275e487f93e29fc595be3a21" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37905 } } peers { permanent_uuid: "82a851e21fb94256845678248f310c6b" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 42465 } }
I20260811 15:07:14.994751 7265 leader_election.cc:288] T d77302d5645b4f37b1f9810c8ad333b2 P 82a851e21fb94256845678248f310c6b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0fbc76c8a3147ce96b7c4dcdfec596a (127.19.236.66:34003), 86273d33275e487f93e29fc595be3a21 (127.19.236.67:37905)
W20260811 15:07:14.995551 6789 leader_election.cc:341] T d77302d5645b4f37b1f9810c8ad333b2 P 82a851e21fb94256845678248f310c6b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 86273d33275e487f93e29fc595be3a21 (127.19.236.67:37905): Not found: Tablet not found: d77302d5645b4f37b1f9810c8ad333b2
W20260811 15:07:14.995659 6790 leader_election.cc:341] T d77302d5645b4f37b1f9810c8ad333b2 P 82a851e21fb94256845678248f310c6b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b0fbc76c8a3147ce96b7c4dcdfec596a (127.19.236.66:34003): Not found: Tablet not found: d77302d5645b4f37b1f9810c8ad333b2
I20260811 15:07:14.995724 6790 leader_election.cc:302] T d77302d5645b4f37b1f9810c8ad333b2 P 82a851e21fb94256845678248f310c6b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82a851e21fb94256845678248f310c6b; no voters: 86273d33275e487f93e29fc595be3a21, b0fbc76c8a3147ce96b7c4dcdfec596a
I20260811 15:07:14.995872 7265 raft_consensus.cc:2726] T d77302d5645b4f37b1f9810c8ad333b2 P 82a851e21fb94256845678248f310c6b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 15:07:15.055203 7266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:15.054741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42765 (local address 127.19.236.65:58255)
0811 15:07:15.055037 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:15.055099 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:42765: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":90,"threads_started":1}
I20260811 15:07:15.189769 7268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:15.189333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42765 (local address 127.19.236.66:51361)
0811 15:07:15.189606 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:15.189668 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:42765: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":77,"threads_started":1}
I20260811 15:07:15.392701 7270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:15.392213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42765 (local address 127.19.236.67:46691)
0811 15:07:15.392498 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:15.392602 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:42765: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":98,"threads_started":1}
I20260811 15:07:16.056486 7271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:16.056048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42765 (local address 127.19.236.65:47403)
0811 15:07:16.056326 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:16.056388 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:42765: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":82,"threads_started":1}
I20260811 15:07:16.191169 7272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:16.190602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42765 (local address 127.19.236.66:34581)
0811 15:07:16.190985 (+ 383us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:16.191069 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:42765: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":294,"thread_start_us":104,"threads_started":1}
I20260811 15:07:16.394042 7273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:16.393548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42765 (local address 127.19.236.67:57625)
0811 15:07:16.393882 (+ 334us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:16.393941 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:42765: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":94,"threads_started":1}
I20260811 15:07:17.057927 7274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:17.057428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42765 (local address 127.19.236.65:37649)
0811 15:07:17.057762 (+ 334us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:17.057825 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:42765: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":94,"threads_started":1}
I20260811 15:07:17.192543 7275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:17.192049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42765 (local address 127.19.236.66:37865)
0811 15:07:17.192358 (+ 309us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:17.192443 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:42765: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":89,"threads_started":1}
I20260811 15:07:17.395246 7276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:17.394799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42765 (local address 127.19.236.67:60461)
0811 15:07:17.395076 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:17.395141 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:42765: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":95,"threads_started":1}
I20260811 15:07:17.471983 7277 raft_consensus.cc:482] T d77302d5645b4f37b1f9810c8ad333b2 P 82a851e21fb94256845678248f310c6b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 15:07:17.472122 7277 raft_consensus.cc:504] T d77302d5645b4f37b1f9810c8ad333b2 P 82a851e21fb94256845678248f310c6b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0fbc76c8a3147ce96b7c4dcdfec596a" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 34003 } } peers { permanent_uuid: "86273d33275e487f93e29fc595be3a21" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37905 } } peers { permanent_uuid: "82a851e21fb94256845678248f310c6b" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 42465 } }
I20260811 15:07:17.472668 7277 leader_election.cc:288] T d77302d5645b4f37b1f9810c8ad333b2 P 82a851e21fb94256845678248f310c6b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0fbc76c8a3147ce96b7c4dcdfec596a (127.19.236.66:34003), 86273d33275e487f93e29fc595be3a21 (127.19.236.67:37905)
W20260811 15:07:17.473630 6789 leader_election.cc:341] T d77302d5645b4f37b1f9810c8ad333b2 P 82a851e21fb94256845678248f310c6b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 86273d33275e487f93e29fc595be3a21 (127.19.236.67:37905): Not found: Tablet not found: d77302d5645b4f37b1f9810c8ad333b2
W20260811 15:07:17.473729 6790 leader_election.cc:341] T d77302d5645b4f37b1f9810c8ad333b2 P 82a851e21fb94256845678248f310c6b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b0fbc76c8a3147ce96b7c4dcdfec596a (127.19.236.66:34003): Not found: Tablet not found: d77302d5645b4f37b1f9810c8ad333b2
I20260811 15:07:17.473842 6790 leader_election.cc:302] T d77302d5645b4f37b1f9810c8ad333b2 P 82a851e21fb94256845678248f310c6b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82a851e21fb94256845678248f310c6b; no voters: 86273d33275e487f93e29fc595be3a21, b0fbc76c8a3147ce96b7c4dcdfec596a
I20260811 15:07:17.474009 7277 raft_consensus.cc:2726] T d77302d5645b4f37b1f9810c8ad333b2 P 82a851e21fb94256845678248f310c6b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 15:07:18.059461 7278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:18.058914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42765 (local address 127.19.236.65:44807)
0811 15:07:18.059315 (+ 401us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:18.059365 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:42765: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":338,"thread_start_us":90,"threads_started":1}
I20260811 15:07:18.193851 7280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:18.193390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42765 (local address 127.19.236.66:36329)
0811 15:07:18.193694 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:18.193755 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:42765: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":96,"threads_started":1}
I20260811 15:07:18.396799 7282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:18.396185 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42765 (local address 127.19.236.67:48623)
0811 15:07:18.396511 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:18.396627 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:42765: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":80,"threads_started":1}
I20260811 15:07:19.060837 7283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:19.060354 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42765 (local address 127.19.236.65:33661)
0811 15:07:19.060649 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:19.060704 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:42765: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":83,"threads_started":1}
I20260811 15:07:19.195266 7284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:19.194797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42765 (local address 127.19.236.66:41517)
0811 15:07:19.195097 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:19.195162 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:42765: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":87,"threads_started":1}
I20260811 15:07:19.398030 7285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:19.397584 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42765 (local address 127.19.236.67:44025)
0811 15:07:19.397861 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:19.397925 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:42765: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":77,"threads_started":1}
I20260811 15:07:20.062114 7286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:20.061692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42765 (local address 127.19.236.65:58413)
0811 15:07:20.061952 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:20.062015 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:42765: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":79,"threads_started":1}
I20260811 15:07:20.196703 7287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:20.196188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42765 (local address 127.19.236.66:52155)
0811 15:07:20.196463 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:20.196522 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:42765: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":79,"threads_started":1}
I20260811 15:07:20.399169 7290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:20.398753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42765 (local address 127.19.236.67:48407)
0811 15:07:20.399020 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:20.399073 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:42765: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":99,"threads_started":1}
I20260811 15:07:21.063347 7291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:21.062933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42765 (local address 127.19.236.65:50367)
0811 15:07:21.063194 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:21.063248 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:42765: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":79,"threads_started":1}
I20260811 15:07:21.102142 7292 raft_consensus.cc:482] T d77302d5645b4f37b1f9810c8ad333b2 P 82a851e21fb94256845678248f310c6b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 15:07:21.102299 7292 raft_consensus.cc:504] T d77302d5645b4f37b1f9810c8ad333b2 P 82a851e21fb94256845678248f310c6b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0fbc76c8a3147ce96b7c4dcdfec596a" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 34003 } } peers { permanent_uuid: "86273d33275e487f93e29fc595be3a21" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 37905 } } peers { permanent_uuid: "82a851e21fb94256845678248f310c6b" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 42465 } }
I20260811 15:07:21.102736 7292 leader_election.cc:288] T d77302d5645b4f37b1f9810c8ad333b2 P 82a851e21fb94256845678248f310c6b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b0fbc76c8a3147ce96b7c4dcdfec596a (127.19.236.66:34003), 86273d33275e487f93e29fc595be3a21 (127.19.236.67:37905)
W20260811 15:07:21.103591 6790 leader_election.cc:341] T d77302d5645b4f37b1f9810c8ad333b2 P 82a851e21fb94256845678248f310c6b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b0fbc76c8a3147ce96b7c4dcdfec596a (127.19.236.66:34003): Not found: Tablet not found: d77302d5645b4f37b1f9810c8ad333b2
W20260811 15:07:21.103742 6789 leader_election.cc:341] T d77302d5645b4f37b1f9810c8ad333b2 P 82a851e21fb94256845678248f310c6b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 86273d33275e487f93e29fc595be3a21 (127.19.236.67:37905): Not found: Tablet not found: d77302d5645b4f37b1f9810c8ad333b2
I20260811 15:07:21.103928 6789 leader_election.cc:302] T d77302d5645b4f37b1f9810c8ad333b2 P 82a851e21fb94256845678248f310c6b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82a851e21fb94256845678248f310c6b; no voters: 86273d33275e487f93e29fc595be3a21, b0fbc76c8a3147ce96b7c4dcdfec596a
I20260811 15:07:21.104101 7292 raft_consensus.cc:2726] T d77302d5645b4f37b1f9810c8ad333b2 P 82a851e21fb94256845678248f310c6b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 15:07:21.197847 7293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:21.197409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42765 (local address 127.19.236.66:58207)
0811 15:07:21.197688 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:21.197747 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:42765: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":84,"threads_started":1}
I20260811 15:07:21.400450 7294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:21.399986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42765 (local address 127.19.236.67:51093)
0811 15:07:21.400286 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:21.400345 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:42765: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":220,"thread_start_us":107,"threads_started":1}
I20260811 15:07:22.064879 7295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:22.064246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42765 (local address 127.19.236.65:57229)
0811 15:07:22.064708 (+ 462us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:22.064775 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:42765: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":236,"thread_start_us":103,"threads_started":1}
I20260811 15:07:22.199185 7298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:22.198738 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42765 (local address 127.19.236.66:50403)
0811 15:07:22.199020 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:22.199084 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:42765: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":83,"threads_started":1}
I20260811 15:07:22.401741 7299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:22.401295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42765 (local address 127.19.236.67:46629)
0811 15:07:22.401583 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:22.401640 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:42765: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":101,"threads_started":1}
I20260811 15:07:23.066303 7300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:23.065809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42765 (local address 127.19.236.65:40577)
0811 15:07:23.066124 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:23.066184 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:42765: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":120,"threads_started":1}
I20260811 15:07:23.200510 7301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:23.200037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42765 (local address 127.19.236.66:34667)
0811 15:07:23.200339 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:23.200404 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:42765: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":86,"threads_started":1}
I20260811 15:07:23.402966 7302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:23.402499 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42765 (local address 127.19.236.67:33765)
0811 15:07:23.402806 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:23.402864 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:42765: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":85,"threads_started":1}
I20260811 15:07:24.067941 7303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:24.067492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42765 (local address 127.19.236.65:54601)
0811 15:07:24.067772 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:24.067836 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:42765: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":82,"threads_started":1}
I20260811 15:07:24.202041 7304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:24.201577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42765 (local address 127.19.236.66:48985)
0811 15:07:24.201865 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:24.201930 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:42765: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":87,"threads_started":1}
I20260811 15:07:24.387674 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 6720
I20260811 15:07:24.397634 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 6931
I20260811 15:07:24.404680 7306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:24.404146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42765 (local address 127.19.236.67:59887)
0811 15:07:24.404452 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:24.404515 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.126:42765: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":90,"threads_started":1}
I20260811 15:07:24.405643 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 7091
2026-08-11T15:07:24Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (59396 ms)
[----------] 30 tests from SecurityITest (247770 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 15:07:24 dist-test-slave-8n49 krb5kdc[7309](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 15:07:24 dist-test-slave-8n49 krb5kdc[7309](info): set up 2 sockets
Aug 11 15:07:24 dist-test-slave-8n49 krb5kdc[7309](info): commencing operation
krb5kdc: starting...
W20260811 15:07:25.527601 20401 mini_kdc.cc:121] Time spent starting KDC: real 1.097s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/krb5kdc/test-user.keytab.
Aug 11 15:07:25 dist-test-slave-8n49 krb5kdc[7309](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460845, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T15:07:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T15:07:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.236.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.236.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.236.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab.
Entry for principal kudu/127.19.236.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab.
I20260811 15:07:25.659258 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:45101
--webserver_interface=127.19.236.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab
--principal=kudu/127.19.236.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:36579
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.236.126:45101
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:07:25.776070 7323 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:07:25.776398 7323 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:07:25.776492 7323 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:07:25.780517 7323 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:07:25.780634 7323 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:07:25.780676 7323 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:07:25.780715 7323 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:07:25.780756 7323 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:07:25.786013 7323 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:36579
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.236.126:45101
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab
--principal=kudu/127.19.236.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:45101
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.236.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7323
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:07:25.787151 7323 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:07:25.788244 7323 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:07:25.797016 7331 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:07:25.797010 7330 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:07:25.797133 7334 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:07:25.797169 7323 server_base.cc:1034] running on GCE node
I20260811 15:07:25.797816 7323 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:07:25.798929 7323 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:07:25.800134 7323 hybrid_clock.cc:648] HybridClock initialized: now 1786460845800115 us; error 30 us; skew 500 ppm
Aug 11 15:07:25 dist-test-slave-8n49 krb5kdc[7309](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460845, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:07:25.803061 7323 init.cc:377] Logged in from keytab as kudu/127.19.236.126@KRBTEST.COM (short username kudu)
I20260811 15:07:25.803968 7323 webserver.cc:460] Webserver started at http://127.19.236.126:38445/ using document root <none> and password file <none>
I20260811 15:07:25.804628 7323 fs_manager.cc:359] Metadata directory not provided
I20260811 15:07:25.804728 7323 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:07:25.804976 7323 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:07:25.807060 7323 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/minicluster-data/master-0/data/instance:
uuid: "9e8352b41722429e80bf429247675c99"
format_stamp: "Formatted at 2026-08-11 15:07:25 on dist-test-slave-8n49"
server_key: "4377d3ca2bf5914de95e4993dbd80dfd"
server_key_iv: "1eacff525ce19a27d254b613eff7c00d"
server_key_version: "encryptionkey@0"
I20260811 15:07:25.807651 7323 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/minicluster-data/master-0/wal/instance:
uuid: "9e8352b41722429e80bf429247675c99"
format_stamp: "Formatted at 2026-08-11 15:07:25 on dist-test-slave-8n49"
server_key: "4377d3ca2bf5914de95e4993dbd80dfd"
server_key_iv: "1eacff525ce19a27d254b613eff7c00d"
server_key_version: "encryptionkey@0"
I20260811 15:07:25.811486 7323 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260811 15:07:25.814039 7341 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:07:25.815281 7323 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 15:07:25.815442 7323 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/minicluster-data/master-0/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/minicluster-data/master-0/wal
uuid: "9e8352b41722429e80bf429247675c99"
format_stamp: "Formatted at 2026-08-11 15:07:25 on dist-test-slave-8n49"
server_key: "4377d3ca2bf5914de95e4993dbd80dfd"
server_key_iv: "1eacff525ce19a27d254b613eff7c00d"
server_key_version: "encryptionkey@0"
I20260811 15:07:25.815570 7323 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:07:25.835587 7323 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:07:25.839160 7323 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:07:25.839393 7323 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:07:25.847395 7323 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.126:45101
I20260811 15:07:25.847424 7402 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.126:45101 every 8 connection(s)
I20260811 15:07:25.848377 7323 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
I20260811 15:07:25.851231 7403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:07:25.856735 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 7323
I20260811 15:07:25.856870 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/minicluster-data/master-0/wal/instance
I20260811 15:07:25.856931 7403 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9e8352b41722429e80bf429247675c99: Bootstrap starting.
I20260811 15:07:25.857189 20401 external_mini_cluster.cc:1428] Setting key 695df9e001dfbb67c37463b9f1f227d7
I20260811 15:07:25.859625 7403 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9e8352b41722429e80bf429247675c99: Neither blocks nor log segments found. Creating new log.
I20260811 15:07:25.860453 7403 log.cc:824] T 00000000000000000000000000000000 P 9e8352b41722429e80bf429247675c99: Log is configured to *not* fsync() on all Append() calls
I20260811 15:07:25.862367 7403 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9e8352b41722429e80bf429247675c99: No bootstrap required, opened a new log
I20260811 15:07:25.865928 7403 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9e8352b41722429e80bf429247675c99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e8352b41722429e80bf429247675c99" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 45101 } }
Aug 11 15:07:25 dist-test-slave-8n49 krb5kdc[7309](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460845, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
I20260811 15:07:25.866247 7403 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9e8352b41722429e80bf429247675c99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:07:25.866307 7403 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9e8352b41722429e80bf429247675c99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e8352b41722429e80bf429247675c99, State: Initialized, Role: FOLLOWER
I20260811 15:07:25.866806 7403 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9e8352b41722429e80bf429247675c99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e8352b41722429e80bf429247675c99" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 45101 } }
I20260811 15:07:25.866932 7403 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9e8352b41722429e80bf429247675c99 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 15:07:25.867013 7403 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9e8352b41722429e80bf429247675c99 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 15:07:25.867123 7403 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9e8352b41722429e80bf429247675c99 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:07:25.867983 7403 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9e8352b41722429e80bf429247675c99 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e8352b41722429e80bf429247675c99" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 45101 } }
I20260811 15:07:25.868325 7403 leader_election.cc:302] T 00000000000000000000000000000000 P 9e8352b41722429e80bf429247675c99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9e8352b41722429e80bf429247675c99; no voters:
I20260811 15:07:25.868698 7403 leader_election.cc:288] T 00000000000000000000000000000000 P 9e8352b41722429e80bf429247675c99 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 15:07:25.868798 7410 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9e8352b41722429e80bf429247675c99 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:07:25.869029 7410 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9e8352b41722429e80bf429247675c99 [term 1 LEADER]: Becoming Leader. State: Replica: 9e8352b41722429e80bf429247675c99, State: Running, Role: LEADER
I20260811 15:07:25.869414 7410 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9e8352b41722429e80bf429247675c99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e8352b41722429e80bf429247675c99" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 45101 } }
I20260811 15:07:25.870052 7403 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9e8352b41722429e80bf429247675c99 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:07:25.871301 7411 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9e8352b41722429e80bf429247675c99 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9e8352b41722429e80bf429247675c99" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e8352b41722429e80bf429247675c99" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 45101 } } }
I20260811 15:07:25.871454 7411 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9e8352b41722429e80bf429247675c99 [sys.catalog]: This master's current role is: LEADER
I20260811 15:07:25.871889 7413 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9e8352b41722429e80bf429247675c99 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9e8352b41722429e80bf429247675c99. Latest consensus state: current_term: 1 leader_uuid: "9e8352b41722429e80bf429247675c99" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e8352b41722429e80bf429247675c99" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 45101 } } }
I20260811 15:07:25.872611 7413 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9e8352b41722429e80bf429247675c99 [sys.catalog]: This master's current role is: LEADER
I20260811 15:07:25.873575 7407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:25.858633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49912 (local address 127.19.236.126:45101)
0811 15:07:25.859093 (+ 460us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:25.859109 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:25.859143 (+ 34us) server_negotiation.cc:407] Connection header received
0811 15:07:25.860028 (+ 885us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:25.860048 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:25.860378 (+ 330us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:25.860762 (+ 384us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:07:25.861590 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:25.862637 (+ 1047us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:25.863505 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:25.863963 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:25.864133 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:25.866861 (+ 2728us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:07:25.866872 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:07:25.866885 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:07:25.866933 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:07:25.869100 (+ 2167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:07:25.869670 (+ 570us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:07:25.869684 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:07:25.869690 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:07:25.869830 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:07:25.870182 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:07:25.870185 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:07:25.870187 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:07:25.870718 (+ 531us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:07:25.871750 (+ 1032us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:25.871930 (+ 180us) server_negotiation.cc:299] Negotiation successful
0811 15:07:25.872255 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":314,"thread_start_us":141,"threads_started":1}
W20260811 15:07:25.876258 7427 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9e8352b41722429e80bf429247675c99: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 15:07:25.876343 7427 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 15:07:25.876471 7420 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:07:25.877259 7420 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:07:25.882805 7420 catalog_manager.cc:1347] Generated new cluster ID: 0bc248d3602f479eb593694c679d6325
I20260811 15:07:25.882884 7420 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:07:25.909046 7420 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 15:07:25.910427 7420 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:07:25.919541 7420 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9e8352b41722429e80bf429247675c99: Generated new TSK 0
I20260811 15:07:25.920411 7420 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.236.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.236.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.236.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.65.keytab.
Entry for principal kudu/127.19.236.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.65.keytab.
I20260811 15:07:25.966168 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.65:0
--local_ip_for_outbound_sockets=127.19.236.65
--webserver_interface=127.19.236.65
--webserver_port=0
--tserver_master_addrs=127.19.236.126:45101
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.65.keytab
--principal=kudu/127.19.236.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:36579
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:07:26.083490 7435 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:07:26.083786 7435 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:07:26.083839 7435 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:07:26.088018 7435 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:07:26.088095 7435 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:07:26.088158 7435 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.65
I20260811 15:07:26.093694 7435 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:36579
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.65.keytab
--principal=kudu/127.19.236.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.236.65
--webserver_port=0
--tserver_master_addrs=127.19.236.126:45101
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7435
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.65
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:07:26.094790 7435 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:07:26.095808 7435 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:07:26.105718 7444 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:07:26.105728 7446 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:07:26.105741 7443 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:07:26.105926 7435 server_base.cc:1034] running on GCE node
I20260811 15:07:26.106449 7435 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:07:26.107160 7435 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:07:26.108350 7435 hybrid_clock.cc:648] HybridClock initialized: now 1786460846108318 us; error 45 us; skew 500 ppm
Aug 11 15:07:26 dist-test-slave-8n49 krb5kdc[7309](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460846, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:07:26.111124 7435 init.cc:377] Logged in from keytab as kudu/127.19.236.65@KRBTEST.COM (short username kudu)
I20260811 15:07:26.112012 7435 webserver.cc:460] Webserver started at http://127.19.236.65:36251/ using document root <none> and password file <none>
I20260811 15:07:26.112680 7435 fs_manager.cc:359] Metadata directory not provided
I20260811 15:07:26.112774 7435 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:07:26.113032 7435 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:07:26.115118 7435 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/minicluster-data/ts-0/data/instance:
uuid: "f97454635ce64d0696be53c1f0e3bf67"
format_stamp: "Formatted at 2026-08-11 15:07:26 on dist-test-slave-8n49"
server_key: "a96d642a649f3d280b392493f3573d66"
server_key_iv: "56a9e4f5c2cfc7695b270b40a219ba91"
server_key_version: "encryptionkey@0"
I20260811 15:07:26.115700 7435 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/minicluster-data/ts-0/wal/instance:
uuid: "f97454635ce64d0696be53c1f0e3bf67"
format_stamp: "Formatted at 2026-08-11 15:07:26 on dist-test-slave-8n49"
server_key: "a96d642a649f3d280b392493f3573d66"
server_key_iv: "56a9e4f5c2cfc7695b270b40a219ba91"
server_key_version: "encryptionkey@0"
I20260811 15:07:26.119594 7435 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260811 15:07:26.122153 7454 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:07:26.123463 7435 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 15:07:26.123600 7435 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/minicluster-data/ts-0/wal
uuid: "f97454635ce64d0696be53c1f0e3bf67"
format_stamp: "Formatted at 2026-08-11 15:07:26 on dist-test-slave-8n49"
server_key: "a96d642a649f3d280b392493f3573d66"
server_key_iv: "56a9e4f5c2cfc7695b270b40a219ba91"
server_key_version: "encryptionkey@0"
I20260811 15:07:26.123706 7435 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:07:26.134784 7435 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:07:26.137950 7435 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:07:26.138162 7435 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:07:26.138778 7435 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:07:26.139647 7435 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:07:26.139695 7435 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:07:26.139766 7435 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:07:26.139796 7435 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:07:26.149005 7435 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.65:36487
I20260811 15:07:26.149039 7579 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.65:36487 every 8 connection(s)
I20260811 15:07:26.149926 7435 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
I20260811 15:07:26.153749 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 7435
I20260811 15:07:26.153913 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/minicluster-data/ts-0/wal/instance
I20260811 15:07:26.154237 20401 external_mini_cluster.cc:1428] Setting key 83474e004eb5170221130eb9d97d174c
Aug 11 15:07:26 dist-test-slave-8n49 krb5kdc[7309](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460846, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.65@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
I20260811 15:07:26.165390 7407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:26.151844 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.65:56727 (local address 127.19.236.126:45101)
0811 15:07:26.152001 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:26.152005 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:26.152944 (+ 939us) server_negotiation.cc:407] Connection header received
0811 15:07:26.154456 (+ 1512us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:26.154460 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:26.154523 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:26.154630 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:07:26.155923 (+ 1293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:26.156456 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:26.157801 (+ 1345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:26.158059 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:26.158149 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:26.161143 (+ 2994us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:07:26.161151 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:07:26.161155 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:07:26.161191 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:07:26.163008 (+ 1817us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:07:26.163545 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:07:26.163548 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:07:26.163550 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:07:26.163647 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:07:26.163985 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:07:26.163991 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:07:26.163995 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:07:26.164263 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:07:26.164376 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:26.164963 (+ 587us) server_negotiation.cc:299] Negotiation successful
0811 15:07:26.165149 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
WARNING: no policy specified for kudu/127.19.236.66@KRBTEST.COM; defaulting to no policy
I20260811 15:07:26.166155 7582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:26.152222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:45101 (local address 127.19.236.65:56727)
0811 15:07:26.152784 (+ 562us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:26.152837 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 15:07:26.154217 (+ 1380us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:07:26.154820 (+ 603us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:07:26.154830 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:07:26.155214 (+ 384us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:07:26.155781 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:26.155795 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:26.156617 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:26.156619 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:26.157661 (+ 1042us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:26.157677 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:26.158224 (+ 547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:26.158230 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:26.158461 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:26.159165 (+ 704us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:07:26.159192 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:07:26.160963 (+ 1771us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:07:26.163144 (+ 2181us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:07:26.163149 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:07:26.163162 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:07:26.163423 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:07:26.163741 (+ 318us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:07:26.163743 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:07:26.163745 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:07:26.163876 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:07:26.164371 (+ 495us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:07:26.164376 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:07:26.164690 (+ 314us) client_negotiation.cc:769] Sending connection context
0811 15:07:26.164848 (+ 158us) client_negotiation.cc:240] Negotiation successful
0811 15:07:26.165114 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":300,"thread_start_us":131,"threads_started":1}
I20260811 15:07:26.167397 7580 heartbeater.cc:347] Connected to a master server at 127.19.236.126:45101
I20260811 15:07:26.167654 7580 heartbeater.cc:464] Registering TS with master...
I20260811 15:07:26.168195 7580 heartbeater.cc:511] Master 127.19.236.126:45101 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.236.66@KRBTEST.COM" created.
I20260811 15:07:26.169852 7362 ts_manager.cc:194] Registered new tserver with Master: f97454635ce64d0696be53c1f0e3bf67 (127.19.236.65:36487)
I20260811 15:07:26.171561 7362 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.236.65@KRBTEST.COM'} at 127.19.236.65:56727
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.236.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.66.keytab.
Entry for principal kudu/127.19.236.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.66.keytab.
I20260811 15:07:26.185497 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.66:0
--local_ip_for_outbound_sockets=127.19.236.66
--webserver_interface=127.19.236.66
--webserver_port=0
--tserver_master_addrs=127.19.236.126:45101
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.66.keytab
--principal=kudu/127.19.236.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:36579
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:07:26.300545 7587 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:07:26.300854 7587 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:07:26.300897 7587 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:07:26.304845 7587 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:07:26.304905 7587 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:07:26.304965 7587 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.66
I20260811 15:07:26.310181 7587 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:36579
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.66.keytab
--principal=kudu/127.19.236.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.236.66
--webserver_port=0
--tserver_master_addrs=127.19.236.126:45101
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7587
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.66
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:07:26.311239 7587 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:07:26.312327 7587 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:07:26.322142 7599 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:07:26.322269 7587 server_base.cc:1034] running on GCE node
W20260811 15:07:26.322156 7594 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:07:26.322173 7595 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:07:26.322917 7587 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:07:26.323589 7587 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:07:26.324772 7587 hybrid_clock.cc:648] HybridClock initialized: now 1786460846324741 us; error 44 us; skew 500 ppm
Aug 11 15:07:26 dist-test-slave-8n49 krb5kdc[7309](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460846, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:07:26.327752 7587 init.cc:377] Logged in from keytab as kudu/127.19.236.66@KRBTEST.COM (short username kudu)
I20260811 15:07:26.328788 7587 webserver.cc:460] Webserver started at http://127.19.236.66:41443/ using document root <none> and password file <none>
I20260811 15:07:26.329401 7587 fs_manager.cc:359] Metadata directory not provided
I20260811 15:07:26.329494 7587 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:07:26.329749 7587 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:07:26.331916 7587 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/minicluster-data/ts-1/data/instance:
uuid: "b1c53db3ddc2415d804b11fcadc625f1"
format_stamp: "Formatted at 2026-08-11 15:07:26 on dist-test-slave-8n49"
server_key: "f2fc1cbfa9d24472261aded812a1adb6"
server_key_iv: "0427104e15032d5cb808996d957d1cdc"
server_key_version: "encryptionkey@0"
I20260811 15:07:26.332528 7587 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/minicluster-data/ts-1/wal/instance:
uuid: "b1c53db3ddc2415d804b11fcadc625f1"
format_stamp: "Formatted at 2026-08-11 15:07:26 on dist-test-slave-8n49"
server_key: "f2fc1cbfa9d24472261aded812a1adb6"
server_key_iv: "0427104e15032d5cb808996d957d1cdc"
server_key_version: "encryptionkey@0"
I20260811 15:07:26.336433 7587 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260811 15:07:26.338954 7607 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:07:26.340216 7587 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 15:07:26.340361 7587 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/minicluster-data/ts-1/wal
uuid: "b1c53db3ddc2415d804b11fcadc625f1"
format_stamp: "Formatted at 2026-08-11 15:07:26 on dist-test-slave-8n49"
server_key: "f2fc1cbfa9d24472261aded812a1adb6"
server_key_iv: "0427104e15032d5cb808996d957d1cdc"
server_key_version: "encryptionkey@0"
I20260811 15:07:26.340482 7587 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:07:26.355130 7587 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:07:26.358716 7587 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:07:26.358946 7587 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:07:26.359611 7587 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:07:26.360502 7587 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:07:26.360615 7587 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:07:26.360709 7587 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:07:26.360764 7587 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:07:26.370142 7587 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.66:45195
I20260811 15:07:26.370164 7733 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.66:45195 every 8 connection(s)
I20260811 15:07:26.371380 7587 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
I20260811 15:07:26.372536 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 7587
I20260811 15:07:26.372690 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/minicluster-data/ts-1/wal/instance
I20260811 15:07:26.373001 20401 external_mini_cluster.cc:1428] Setting key d8d6369583f86e580c30f4f2388b879c
Aug 11 15:07:26 dist-test-slave-8n49 krb5kdc[7309](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460846, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.66@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.19.236.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.236.67@KRBTEST.COM" created.
I20260811 15:07:26.387867 7407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:26.375211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.66:34815 (local address 127.19.236.126:45101)
0811 15:07:26.375382 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:26.375389 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:26.375409 (+ 20us) server_negotiation.cc:407] Connection header received
0811 15:07:26.376254 (+ 845us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:26.376260 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:26.376324 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:26.376420 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:07:26.378139 (+ 1719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:26.378665 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:26.380631 (+ 1966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:26.381092 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:26.381232 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:26.383994 (+ 2762us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:07:26.384000 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:07:26.384004 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:07:26.384035 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:07:26.385712 (+ 1677us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:07:26.386192 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:07:26.386194 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:07:26.386196 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:07:26.386272 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:07:26.386570 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:07:26.386572 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:07:26.386573 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:07:26.386829 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:07:26.386911 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:26.387577 (+ 666us) server_negotiation.cc:299] Negotiation successful
0811 15:07:26.387688 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 15:07:26.388886 7737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:26.374064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:45101 (local address 127.19.236.66:34815)
0811 15:07:26.374642 (+ 578us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:26.374688 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 15:07:26.376039 (+ 1351us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:07:26.376701 (+ 662us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:07:26.376714 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:07:26.377234 (+ 520us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:07:26.377973 (+ 739us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:26.377997 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:26.378803 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:26.378809 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:26.380409 (+ 1600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:26.380420 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:26.381252 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:26.381255 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:26.381402 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:26.382063 (+ 661us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:07:26.382080 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:07:26.383798 (+ 1718us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:07:26.385820 (+ 2022us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:07:26.385826 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:07:26.385839 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:07:26.386101 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:07:26.386354 (+ 253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:07:26.386356 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:07:26.386357 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:07:26.386489 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:07:26.386930 (+ 441us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:07:26.386936 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:07:26.387252 (+ 316us) client_negotiation.cc:769] Sending connection context
0811 15:07:26.387502 (+ 250us) client_negotiation.cc:240] Negotiation successful
0811 15:07:26.387883 (+ 381us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":343,"thread_start_us":144,"threads_started":1}
I20260811 15:07:26.390194 7734 heartbeater.cc:347] Connected to a master server at 127.19.236.126:45101
I20260811 15:07:26.390494 7734 heartbeater.cc:464] Registering TS with master...
I20260811 15:07:26.391073 7734 heartbeater.cc:511] Master 127.19.236.126:45101 requested a full tablet report, sending...
I20260811 15:07:26.392221 7362 ts_manager.cc:194] Registered new tserver with Master: b1c53db3ddc2415d804b11fcadc625f1 (127.19.236.66:45195)
I20260811 15:07:26.392915 7362 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.236.66@KRBTEST.COM'} at 127.19.236.66:34815
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.236.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.67.keytab.
Entry for principal kudu/127.19.236.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.67.keytab.
I20260811 15:07:26.406000 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.67:0
--local_ip_for_outbound_sockets=127.19.236.67
--webserver_interface=127.19.236.67
--webserver_port=0
--tserver_master_addrs=127.19.236.126:45101
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.67.keytab
--principal=kudu/127.19.236.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:36579
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:07:26.524989 7742 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:07:26.525255 7742 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:07:26.525301 7742 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:07:26.529510 7742 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:07:26.529573 7742 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:07:26.529678 7742 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.67
I20260811 15:07:26.535135 7742 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:36579
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.67.keytab
--principal=kudu/127.19.236.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.236.67
--webserver_port=0
--tserver_master_addrs=127.19.236.126:45101
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7742
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.67
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:07:26.536234 7742 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:07:26.537315 7742 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:07:26.547967 7752 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:07:26.548089 7742 server_base.cc:1034] running on GCE node
W20260811 15:07:26.548008 7753 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:07:26.547967 7755 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:07:26.548728 7742 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:07:26.549476 7742 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:07:26.550702 7742 hybrid_clock.cc:648] HybridClock initialized: now 1786460846550680 us; error 34 us; skew 500 ppm
Aug 11 15:07:26 dist-test-slave-8n49 krb5kdc[7309](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460846, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:07:26.553598 7742 init.cc:377] Logged in from keytab as kudu/127.19.236.67@KRBTEST.COM (short username kudu)
I20260811 15:07:26.554524 7742 webserver.cc:460] Webserver started at http://127.19.236.67:37423/ using document root <none> and password file <none>
I20260811 15:07:26.555059 7742 fs_manager.cc:359] Metadata directory not provided
I20260811 15:07:26.555126 7742 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:07:26.555297 7742 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:07:26.557816 7742 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/minicluster-data/ts-2/data/instance:
uuid: "8e63f584b9804ec1afc03bf1397e25c1"
format_stamp: "Formatted at 2026-08-11 15:07:26 on dist-test-slave-8n49"
server_key: "7bd53c400c28925201b412ca0fdb70af"
server_key_iv: "8ea5493b9ce88ec0577e6ec7b7238d6a"
server_key_version: "encryptionkey@0"
I20260811 15:07:26.558337 7742 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/minicluster-data/ts-2/wal/instance:
uuid: "8e63f584b9804ec1afc03bf1397e25c1"
format_stamp: "Formatted at 2026-08-11 15:07:26 on dist-test-slave-8n49"
server_key: "7bd53c400c28925201b412ca0fdb70af"
server_key_iv: "8ea5493b9ce88ec0577e6ec7b7238d6a"
server_key_version: "encryptionkey@0"
I20260811 15:07:26.562136 7742 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 15:07:26.564698 7762 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:07:26.565994 7742 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 15:07:26.566138 7742 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/minicluster-data/ts-2/wal
uuid: "8e63f584b9804ec1afc03bf1397e25c1"
format_stamp: "Formatted at 2026-08-11 15:07:26 on dist-test-slave-8n49"
server_key: "7bd53c400c28925201b412ca0fdb70af"
server_key_iv: "8ea5493b9ce88ec0577e6ec7b7238d6a"
server_key_version: "encryptionkey@0"
I20260811 15:07:26.566254 7742 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:07:26.581167 7742 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:07:26.584352 7742 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:07:26.584589 7742 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:07:26.585243 7742 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:07:26.586114 7742 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:07:26.586163 7742 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:07:26.586205 7742 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:07:26.586220 7742 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:07:26.596441 7742 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.67:36811
I20260811 15:07:26.596469 7889 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.67:36811 every 8 connection(s)
I20260811 15:07:26.597422 7742 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
I20260811 15:07:26.604094 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 7742
I20260811 15:07:26.604277 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/minicluster-data/ts-2/wal/instance
I20260811 15:07:26.604686 20401 external_mini_cluster.cc:1428] Setting key 51ff166a2602b8782b9e38e025f15a85
Aug 11 15:07:26 dist-test-slave-8n49 krb5kdc[7309](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460846, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.67@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
I20260811 15:07:26.612987 7407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:26.599383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.67:46171 (local address 127.19.236.126:45101)
0811 15:07:26.599534 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:26.599538 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:26.600420 (+ 882us) server_negotiation.cc:407] Connection header received
0811 15:07:26.601975 (+ 1555us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:26.601978 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:26.602031 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:26.602113 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:07:26.603411 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:26.603986 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:26.605723 (+ 1737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:26.605981 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:26.606066 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:26.609025 (+ 2959us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:07:26.609038 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:07:26.609040 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:07:26.609074 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:07:26.610600 (+ 1526us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:07:26.611152 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:07:26.611156 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:07:26.611157 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:07:26.611264 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:07:26.611721 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:07:26.611724 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:07:26.611725 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:07:26.611958 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:07:26.612049 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:26.612738 (+ 689us) server_negotiation.cc:299] Negotiation successful
0811 15:07:26.612858 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 15:07:26.613961 7892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:26.599702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:45101 (local address 127.19.236.67:46171)
0811 15:07:26.600242 (+ 540us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:26.600288 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 15:07:26.601737 (+ 1449us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:07:26.602304 (+ 567us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:07:26.602311 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:07:26.602723 (+ 412us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:07:26.603249 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:26.603264 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:26.604137 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:26.604142 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:26.605573 (+ 1431us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:26.605588 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:26.606134 (+ 546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:26.606142 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:26.606361 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:26.607028 (+ 667us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:07:26.607053 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:07:26.608832 (+ 1779us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:07:26.610714 (+ 1882us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:07:26.610720 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:07:26.610734 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:07:26.611014 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:07:26.611399 (+ 385us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:07:26.611402 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:07:26.611404 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:07:26.611561 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:07:26.612098 (+ 537us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:07:26.612104 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:07:26.612416 (+ 312us) client_negotiation.cc:769] Sending connection context
0811 15:07:26.612682 (+ 266us) client_negotiation.cc:240] Negotiation successful
0811 15:07:26.612997 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":334,"thread_start_us":136,"threads_started":1}
I20260811 15:07:26.615309 7890 heartbeater.cc:347] Connected to a master server at 127.19.236.126:45101
I20260811 15:07:26.615650 7890 heartbeater.cc:464] Registering TS with master...
I20260811 15:07:26.616204 7890 heartbeater.cc:511] Master 127.19.236.126:45101 requested a full tablet report, sending...
I20260811 15:07:26.617422 7362 ts_manager.cc:194] Registered new tserver with Master: 8e63f584b9804ec1afc03bf1397e25c1 (127.19.236.67:36811)
I20260811 15:07:26.618101 7362 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.236.67@KRBTEST.COM'} at 127.19.236.67:46171
I20260811 15:07:26.619199 20401 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 15:07:26.629345 7407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:26.621445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55768 (local address 127.19.236.126:45101)
0811 15:07:26.621610 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:26.621614 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:26.621726 (+ 112us) server_negotiation.cc:407] Connection header received
0811 15:07:26.621859 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:26.621861 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:26.621901 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:26.621970 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:07:26.622754 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:26.623284 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:26.624203 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:26.624422 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:26.624512 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:26.626231 (+ 1719us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:07:26.626234 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:07:26.626236 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:07:26.626260 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:07:26.627534 (+ 1274us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:07:26.628039 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:07:26.628041 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:07:26.628043 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:07:26.628132 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:07:26.628380 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:07:26.628382 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:07:26.628383 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:07:26.628698 (+ 315us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:07:26.628802 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:26.629000 (+ 198us) server_negotiation.cc:299] Negotiation successful
0811 15:07:26.629117 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260811 15:07:26.632316 7362 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55768:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 15:07:26.635450 7362 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 15:07:26.651927 7910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:26.645320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53274 (local address 127.19.236.67:36811)
0811 15:07:26.646005 (+ 685us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:26.646016 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:26.646040 (+ 24us) server_negotiation.cc:407] Connection header received
0811 15:07:26.646121 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:26.646126 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:26.646314 (+ 188us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:26.646485 (+ 171us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:07:26.646825 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:26.648079 (+ 1254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:26.649972 (+ 1893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:26.651091 (+ 1119us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:26.651208 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:26.651362 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:26.651619 (+ 257us) server_negotiation.cc:299] Negotiation successful
0811 15:07:26.651748 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":587,"thread_start_us":122,"threads_started":1}
I20260811 15:07:26.652086 7906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:26.644750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.67:36811 (local address 127.0.0.1:53274)
0811 15:07:26.645480 (+ 730us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:26.645495 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 15:07:26.645613 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:07:26.646474 (+ 861us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:07:26.646477 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:07:26.646511 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:07:26.646698 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:26.646706 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:26.648284 (+ 1578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:26.648288 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:26.649824 (+ 1536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:26.649835 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:26.651247 (+ 1412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:26.651251 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:26.651367 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:26.651417 (+ 50us) client_negotiation.cc:769] Sending connection context
0811 15:07:26.651551 (+ 134us) client_negotiation.cc:240] Negotiation successful
0811 15:07:26.651890 (+ 339us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":670,"mutex_wait_us":116,"spinlock_wait_cycles":21120,"thread_start_us":108,"threads_started":1}
I20260811 15:07:26.652302 7905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:26.644453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.65:36487 (local address 127.0.0.1:52356)
0811 15:07:26.645647 (+ 1194us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:26.645662 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 15:07:26.645751 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:07:26.646475 (+ 724us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:07:26.646477 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:07:26.646529 (+ 52us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:07:26.646877 (+ 348us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:26.646883 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:26.649584 (+ 2701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:26.649588 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:26.650584 (+ 996us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:26.650603 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:26.651888 (+ 1285us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:26.651892 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:26.651986 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:26.652009 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 15:07:26.652080 (+ 71us) client_negotiation.cc:240] Negotiation successful
0811 15:07:26.652162 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":730,"mutex_wait_us":141,"spinlock_wait_cycles":7168,"thread_start_us":121,"threads_started":1}
I20260811 15:07:26.652323 7907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:26.644541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58180 (local address 127.19.236.66:45195)
0811 15:07:26.644993 (+ 452us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:26.645006 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:26.645469 (+ 463us) server_negotiation.cc:407] Connection header received
0811 15:07:26.645804 (+ 335us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:26.645809 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:26.646099 (+ 290us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:26.646231 (+ 132us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:07:26.647011 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:26.648113 (+ 1102us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:26.650081 (+ 1968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:26.651114 (+ 1033us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:26.651200 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:26.651362 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:26.651752 (+ 390us) server_negotiation.cc:299] Negotiation successful
0811 15:07:26.652182 (+ 430us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":318,"thread_start_us":93,"threads_started":1}
I20260811 15:07:26.652762 7908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:26.644442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.66:45195 (local address 127.0.0.1:58180)
0811 15:07:26.645320 (+ 878us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:26.645376 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0811 15:07:26.645613 (+ 237us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:07:26.646464 (+ 851us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:07:26.646470 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:07:26.646537 (+ 67us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:07:26.646872 (+ 335us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:26.646883 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:26.648284 (+ 1401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:26.648288 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:26.649925 (+ 1637us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:26.649939 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:26.651472 (+ 1533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:26.651475 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:26.651589 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:26.651613 (+ 24us) client_negotiation.cc:769] Sending connection context
0811 15:07:26.652494 (+ 881us) client_negotiation.cc:240] Negotiation successful
0811 15:07:26.652609 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":631,"mutex_wait_us":386,"spinlock_wait_cycles":93696,"thread_start_us":157,"threads_started":1}
I20260811 15:07:26.653030 7909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:26.645331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52356 (local address 127.19.236.65:36487)
0811 15:07:26.645910 (+ 579us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:26.645927 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:26.645951 (+ 24us) server_negotiation.cc:407] Connection header received
0811 15:07:26.646022 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:26.646026 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:26.646198 (+ 172us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:26.646332 (+ 134us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:07:26.648285 (+ 1953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:26.649433 (+ 1148us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:26.650754 (+ 1321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:26.651588 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:26.651688 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:26.651823 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:26.652742 (+ 919us) server_negotiation.cc:299] Negotiation successful
0811 15:07:26.652859 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":481,"thread_start_us":97,"threads_started":1}
I20260811 15:07:26.655506 7509 tablet_service.cc:1467] Processing CreateTablet for tablet b4294e34f99b447fb435c42a5b6e6fce (DEFAULT_TABLE table=test-table [id=6eab90c987c8424396001d47b3a6bc17]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:07:26.655558 7660 tablet_service.cc:1467] Processing CreateTablet for tablet b4294e34f99b447fb435c42a5b6e6fce (DEFAULT_TABLE table=test-table [id=6eab90c987c8424396001d47b3a6bc17]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:07:26.655557 7818 tablet_service.cc:1467] Processing CreateTablet for tablet b4294e34f99b447fb435c42a5b6e6fce (DEFAULT_TABLE table=test-table [id=6eab90c987c8424396001d47b3a6bc17]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:07:26.656628 7509 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b4294e34f99b447fb435c42a5b6e6fce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:07:26.656641 7660 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b4294e34f99b447fb435c42a5b6e6fce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:07:26.656641 7818 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b4294e34f99b447fb435c42a5b6e6fce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:07:26.663316 7911 tablet_bootstrap.cc:492] T b4294e34f99b447fb435c42a5b6e6fce P f97454635ce64d0696be53c1f0e3bf67: Bootstrap starting.
I20260811 15:07:26.664820 7913 tablet_bootstrap.cc:492] T b4294e34f99b447fb435c42a5b6e6fce P 8e63f584b9804ec1afc03bf1397e25c1: Bootstrap starting.
I20260811 15:07:26.664805 7914 tablet_bootstrap.cc:492] T b4294e34f99b447fb435c42a5b6e6fce P b1c53db3ddc2415d804b11fcadc625f1: Bootstrap starting.
I20260811 15:07:26.665642 7911 tablet_bootstrap.cc:654] T b4294e34f99b447fb435c42a5b6e6fce P f97454635ce64d0696be53c1f0e3bf67: Neither blocks nor log segments found. Creating new log.
I20260811 15:07:26.667026 7914 tablet_bootstrap.cc:654] T b4294e34f99b447fb435c42a5b6e6fce P b1c53db3ddc2415d804b11fcadc625f1: Neither blocks nor log segments found. Creating new log.
I20260811 15:07:26.667164 7913 tablet_bootstrap.cc:654] T b4294e34f99b447fb435c42a5b6e6fce P 8e63f584b9804ec1afc03bf1397e25c1: Neither blocks nor log segments found. Creating new log.
I20260811 15:07:26.667143 7911 log.cc:824] T b4294e34f99b447fb435c42a5b6e6fce P f97454635ce64d0696be53c1f0e3bf67: Log is configured to *not* fsync() on all Append() calls
I20260811 15:07:26.668483 7914 log.cc:824] T b4294e34f99b447fb435c42a5b6e6fce P b1c53db3ddc2415d804b11fcadc625f1: Log is configured to *not* fsync() on all Append() calls
I20260811 15:07:26.668483 7913 log.cc:824] T b4294e34f99b447fb435c42a5b6e6fce P 8e63f584b9804ec1afc03bf1397e25c1: Log is configured to *not* fsync() on all Append() calls
I20260811 15:07:26.669828 7911 tablet_bootstrap.cc:492] T b4294e34f99b447fb435c42a5b6e6fce P f97454635ce64d0696be53c1f0e3bf67: No bootstrap required, opened a new log
I20260811 15:07:26.670049 7911 ts_tablet_manager.cc:1397] T b4294e34f99b447fb435c42a5b6e6fce P f97454635ce64d0696be53c1f0e3bf67: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260811 15:07:26.670496 7914 tablet_bootstrap.cc:492] T b4294e34f99b447fb435c42a5b6e6fce P b1c53db3ddc2415d804b11fcadc625f1: No bootstrap required, opened a new log
I20260811 15:07:26.670593 7913 tablet_bootstrap.cc:492] T b4294e34f99b447fb435c42a5b6e6fce P 8e63f584b9804ec1afc03bf1397e25c1: No bootstrap required, opened a new log
I20260811 15:07:26.670653 7914 ts_tablet_manager.cc:1397] T b4294e34f99b447fb435c42a5b6e6fce P b1c53db3ddc2415d804b11fcadc625f1: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260811 15:07:26.670765 7913 ts_tablet_manager.cc:1397] T b4294e34f99b447fb435c42a5b6e6fce P 8e63f584b9804ec1afc03bf1397e25c1: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260811 15:07:26.673789 7914 raft_consensus.cc:348] T b4294e34f99b447fb435c42a5b6e6fce P b1c53db3ddc2415d804b11fcadc625f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1c53db3ddc2415d804b11fcadc625f1" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 45195 } } peers { permanent_uuid: "f97454635ce64d0696be53c1f0e3bf67" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 36487 } } peers { permanent_uuid: "8e63f584b9804ec1afc03bf1397e25c1" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 36811 } }
I20260811 15:07:26.674070 7914 raft_consensus.cc:374] T b4294e34f99b447fb435c42a5b6e6fce P b1c53db3ddc2415d804b11fcadc625f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:07:26.674158 7914 raft_consensus.cc:729] T b4294e34f99b447fb435c42a5b6e6fce P b1c53db3ddc2415d804b11fcadc625f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1c53db3ddc2415d804b11fcadc625f1, State: Initialized, Role: FOLLOWER
I20260811 15:07:26.674296 7911 raft_consensus.cc:348] T b4294e34f99b447fb435c42a5b6e6fce P f97454635ce64d0696be53c1f0e3bf67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1c53db3ddc2415d804b11fcadc625f1" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 45195 } } peers { permanent_uuid: "f97454635ce64d0696be53c1f0e3bf67" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 36487 } } peers { permanent_uuid: "8e63f584b9804ec1afc03bf1397e25c1" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 36811 } }
I20260811 15:07:26.674592 7911 raft_consensus.cc:374] T b4294e34f99b447fb435c42a5b6e6fce P f97454635ce64d0696be53c1f0e3bf67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:07:26.674683 7911 raft_consensus.cc:729] T b4294e34f99b447fb435c42a5b6e6fce P f97454635ce64d0696be53c1f0e3bf67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f97454635ce64d0696be53c1f0e3bf67, State: Initialized, Role: FOLLOWER
I20260811 15:07:26.674672 7914 consensus_queue.cc:260] T b4294e34f99b447fb435c42a5b6e6fce P b1c53db3ddc2415d804b11fcadc625f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1c53db3ddc2415d804b11fcadc625f1" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 45195 } } peers { permanent_uuid: "f97454635ce64d0696be53c1f0e3bf67" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 36487 } } peers { permanent_uuid: "8e63f584b9804ec1afc03bf1397e25c1" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 36811 } }
I20260811 15:07:26.674662 7913 raft_consensus.cc:348] T b4294e34f99b447fb435c42a5b6e6fce P 8e63f584b9804ec1afc03bf1397e25c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1c53db3ddc2415d804b11fcadc625f1" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 45195 } } peers { permanent_uuid: "f97454635ce64d0696be53c1f0e3bf67" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 36487 } } peers { permanent_uuid: "8e63f584b9804ec1afc03bf1397e25c1" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 36811 } }
I20260811 15:07:26.674924 7913 raft_consensus.cc:374] T b4294e34f99b447fb435c42a5b6e6fce P 8e63f584b9804ec1afc03bf1397e25c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:07:26.675005 7913 raft_consensus.cc:729] T b4294e34f99b447fb435c42a5b6e6fce P 8e63f584b9804ec1afc03bf1397e25c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e63f584b9804ec1afc03bf1397e25c1, State: Initialized, Role: FOLLOWER
I20260811 15:07:26.675424 7913 consensus_queue.cc:260] T b4294e34f99b447fb435c42a5b6e6fce P 8e63f584b9804ec1afc03bf1397e25c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1c53db3ddc2415d804b11fcadc625f1" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 45195 } } peers { permanent_uuid: "f97454635ce64d0696be53c1f0e3bf67" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 36487 } } peers { permanent_uuid: "8e63f584b9804ec1afc03bf1397e25c1" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 36811 } }
I20260811 15:07:26.675609 7734 heartbeater.cc:503] Master 127.19.236.126:45101 was elected leader, sending a full tablet report...
I20260811 15:07:26.675706 7911 consensus_queue.cc:260] T b4294e34f99b447fb435c42a5b6e6fce P f97454635ce64d0696be53c1f0e3bf67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1c53db3ddc2415d804b11fcadc625f1" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 45195 } } peers { permanent_uuid: "f97454635ce64d0696be53c1f0e3bf67" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 36487 } } peers { permanent_uuid: "8e63f584b9804ec1afc03bf1397e25c1" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 36811 } }
I20260811 15:07:26.676146 7890 heartbeater.cc:503] Master 127.19.236.126:45101 was elected leader, sending a full tablet report...
I20260811 15:07:26.676466 7913 ts_tablet_manager.cc:1428] T b4294e34f99b447fb435c42a5b6e6fce P 8e63f584b9804ec1afc03bf1397e25c1: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260811 15:07:26.676977 7914 ts_tablet_manager.cc:1428] T b4294e34f99b447fb435c42a5b6e6fce P b1c53db3ddc2415d804b11fcadc625f1: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260811 15:07:26.677728 7580 heartbeater.cc:503] Master 127.19.236.126:45101 was elected leader, sending a full tablet report...
I20260811 15:07:26.677724 7911 ts_tablet_manager.cc:1428] T b4294e34f99b447fb435c42a5b6e6fce P f97454635ce64d0696be53c1f0e3bf67: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20260811 15:07:26.747196 7918 raft_consensus.cc:482] T b4294e34f99b447fb435c42a5b6e6fce P b1c53db3ddc2415d804b11fcadc625f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 15:07:26.747486 7918 raft_consensus.cc:504] T b4294e34f99b447fb435c42a5b6e6fce P b1c53db3ddc2415d804b11fcadc625f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1c53db3ddc2415d804b11fcadc625f1" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 45195 } } peers { permanent_uuid: "f97454635ce64d0696be53c1f0e3bf67" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 36487 } } peers { permanent_uuid: "8e63f584b9804ec1afc03bf1397e25c1" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 36811 } }
I20260811 15:07:26.748809 7918 leader_election.cc:288] T b4294e34f99b447fb435c42a5b6e6fce P b1c53db3ddc2415d804b11fcadc625f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f97454635ce64d0696be53c1f0e3bf67 (127.19.236.65:36487), 8e63f584b9804ec1afc03bf1397e25c1 (127.19.236.67:36811)
I20260811 15:07:26.754093 7909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:26.749192 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.66:58143 (local address 127.19.236.65:36487)
0811 15:07:26.749336 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:26.749340 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:26.749647 (+ 307us) server_negotiation.cc:407] Connection header received
0811 15:07:26.749793 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:26.749800 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:26.749857 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:26.749947 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:07:26.750210 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:26.750928 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:26.752613 (+ 1685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:26.753209 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:26.753339 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:26.753394 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:26.753881 (+ 487us) server_negotiation.cc:299] Negotiation successful
0811 15:07:26.753953 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 15:07:26.754093 7910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:26.749187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.66:38713 (local address 127.19.236.67:36811)
0811 15:07:26.749332 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:26.749340 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:26.749360 (+ 20us) server_negotiation.cc:407] Connection header received
0811 15:07:26.749501 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:26.749506 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:26.749559 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:26.749665 (+ 106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:07:26.749970 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:26.750741 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:26.752613 (+ 1872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:26.753223 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:26.753339 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:26.753394 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:26.753881 (+ 487us) server_negotiation.cc:299] Negotiation successful
0811 15:07:26.753953 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 15:07:26.754171 7737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:26.749066 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.67:36811 (local address 127.19.236.66:38713)
0811 15:07:26.749226 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:26.749246 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 15:07:26.749360 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:07:26.749679 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:07:26.749682 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:07:26.749699 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:07:26.749849 (+ 150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:26.749855 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:26.750857 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:26.750860 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:26.752448 (+ 1588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:26.752461 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:26.753345 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:26.753349 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:26.753681 (+ 332us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:26.753761 (+ 80us) client_negotiation.cc:769] Sending connection context
0811 15:07:26.753851 (+ 90us) client_negotiation.cc:240] Negotiation successful
0811 15:07:26.753963 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55,"mutex_wait_us":232}
I20260811 15:07:26.754181 7921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:26.749066 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.65:36487 (local address 127.19.236.66:58143)
0811 15:07:26.749550 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:26.749562 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 15:07:26.749680 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:07:26.749963 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:07:26.749970 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:07:26.749994 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:07:26.750100 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:26.750105 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:26.751030 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:26.751033 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:26.752462 (+ 1429us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:26.752470 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:26.753345 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:26.753349 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:26.753686 (+ 337us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:26.753761 (+ 75us) client_negotiation.cc:769] Sending connection context
0811 15:07:26.753851 (+ 90us) client_negotiation.cc:240] Negotiation successful
0811 15:07:26.753960 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":400,"mutex_wait_us":352,"thread_start_us":149,"threads_started":1}
I20260811 15:07:26.754973 7840 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4294e34f99b447fb435c42a5b6e6fce" candidate_uuid: "b1c53db3ddc2415d804b11fcadc625f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e63f584b9804ec1afc03bf1397e25c1" is_pre_election: true
I20260811 15:07:26.755106 7530 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4294e34f99b447fb435c42a5b6e6fce" candidate_uuid: "b1c53db3ddc2415d804b11fcadc625f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97454635ce64d0696be53c1f0e3bf67" is_pre_election: true
I20260811 15:07:26.755340 7840 raft_consensus.cc:2454] T b4294e34f99b447fb435c42a5b6e6fce P 8e63f584b9804ec1afc03bf1397e25c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1c53db3ddc2415d804b11fcadc625f1 in term 0.
I20260811 15:07:26.755487 7530 raft_consensus.cc:2454] T b4294e34f99b447fb435c42a5b6e6fce P f97454635ce64d0696be53c1f0e3bf67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1c53db3ddc2415d804b11fcadc625f1 in term 0.
I20260811 15:07:26.755955 7608 leader_election.cc:302] T b4294e34f99b447fb435c42a5b6e6fce P b1c53db3ddc2415d804b11fcadc625f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 8e63f584b9804ec1afc03bf1397e25c1, b1c53db3ddc2415d804b11fcadc625f1, f97454635ce64d0696be53c1f0e3bf67; no voters:
I20260811 15:07:26.756297 7918 raft_consensus.cc:2781] T b4294e34f99b447fb435c42a5b6e6fce P b1c53db3ddc2415d804b11fcadc625f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 15:07:26.756385 7918 raft_consensus.cc:482] T b4294e34f99b447fb435c42a5b6e6fce P b1c53db3ddc2415d804b11fcadc625f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 15:07:26.756448 7918 raft_consensus.cc:3037] T b4294e34f99b447fb435c42a5b6e6fce P b1c53db3ddc2415d804b11fcadc625f1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:07:26.757652 7918 raft_consensus.cc:504] T b4294e34f99b447fb435c42a5b6e6fce P b1c53db3ddc2415d804b11fcadc625f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1c53db3ddc2415d804b11fcadc625f1" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 45195 } } peers { permanent_uuid: "f97454635ce64d0696be53c1f0e3bf67" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 36487 } } peers { permanent_uuid: "8e63f584b9804ec1afc03bf1397e25c1" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 36811 } }
I20260811 15:07:26.758049 7918 leader_election.cc:288] T b4294e34f99b447fb435c42a5b6e6fce P b1c53db3ddc2415d804b11fcadc625f1 [CANDIDATE]: Term 1 election: Requested vote from peers f97454635ce64d0696be53c1f0e3bf67 (127.19.236.65:36487), 8e63f584b9804ec1afc03bf1397e25c1 (127.19.236.67:36811)
I20260811 15:07:26.758495 7530 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4294e34f99b447fb435c42a5b6e6fce" candidate_uuid: "b1c53db3ddc2415d804b11fcadc625f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97454635ce64d0696be53c1f0e3bf67"
I20260811 15:07:26.758527 7840 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4294e34f99b447fb435c42a5b6e6fce" candidate_uuid: "b1c53db3ddc2415d804b11fcadc625f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e63f584b9804ec1afc03bf1397e25c1"
I20260811 15:07:26.758649 7840 raft_consensus.cc:3037] T b4294e34f99b447fb435c42a5b6e6fce P 8e63f584b9804ec1afc03bf1397e25c1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:07:26.758644 7530 raft_consensus.cc:3037] T b4294e34f99b447fb435c42a5b6e6fce P f97454635ce64d0696be53c1f0e3bf67 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:07:26.760115 7530 raft_consensus.cc:2454] T b4294e34f99b447fb435c42a5b6e6fce P f97454635ce64d0696be53c1f0e3bf67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1c53db3ddc2415d804b11fcadc625f1 in term 1.
I20260811 15:07:26.760115 7840 raft_consensus.cc:2454] T b4294e34f99b447fb435c42a5b6e6fce P 8e63f584b9804ec1afc03bf1397e25c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1c53db3ddc2415d804b11fcadc625f1 in term 1.
I20260811 15:07:26.760670 7609 leader_election.cc:302] T b4294e34f99b447fb435c42a5b6e6fce P b1c53db3ddc2415d804b11fcadc625f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 8e63f584b9804ec1afc03bf1397e25c1, b1c53db3ddc2415d804b11fcadc625f1, f97454635ce64d0696be53c1f0e3bf67; no voters:
I20260811 15:07:26.760994 7918 raft_consensus.cc:2781] T b4294e34f99b447fb435c42a5b6e6fce P b1c53db3ddc2415d804b11fcadc625f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:07:26.761432 7918 raft_consensus.cc:686] T b4294e34f99b447fb435c42a5b6e6fce P b1c53db3ddc2415d804b11fcadc625f1 [term 1 LEADER]: Becoming Leader. State: Replica: b1c53db3ddc2415d804b11fcadc625f1, State: Running, Role: LEADER
I20260811 15:07:26.761896 7918 consensus_queue.cc:237] T b4294e34f99b447fb435c42a5b6e6fce P b1c53db3ddc2415d804b11fcadc625f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1c53db3ddc2415d804b11fcadc625f1" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 45195 } } peers { permanent_uuid: "f97454635ce64d0696be53c1f0e3bf67" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 36487 } } peers { permanent_uuid: "8e63f584b9804ec1afc03bf1397e25c1" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 36811 } }
I20260811 15:07:26.765285 7361 catalog_manager.cc:5495] T b4294e34f99b447fb435c42a5b6e6fce P b1c53db3ddc2415d804b11fcadc625f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to b1c53db3ddc2415d804b11fcadc625f1 (127.19.236.66). New cstate: current_term: 1 leader_uuid: "b1c53db3ddc2415d804b11fcadc625f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1c53db3ddc2415d804b11fcadc625f1" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 45195 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f97454635ce64d0696be53c1f0e3bf67" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 36487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e63f584b9804ec1afc03bf1397e25c1" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 36811 } health_report { overall_health: UNKNOWN } } }
I20260811 15:07:26.776424 7907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:26.772931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58194 (local address 127.19.236.66:45195)
0811 15:07:26.773056 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:26.773060 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:26.773075 (+ 15us) server_negotiation.cc:407] Connection header received
0811 15:07:26.773201 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:26.773204 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:26.773259 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:26.773346 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 15:07:26.773742 (+ 396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:26.774279 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:26.775096 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:26.775299 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:26.775375 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:26.775658 (+ 283us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 15:07:26.776084 (+ 426us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 15:07:26.776175 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:26.776232 (+ 57us) server_negotiation.cc:299] Negotiation successful
0811 15:07:26.776283 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 15:07:26.782473 7840 raft_consensus.cc:1261] T b4294e34f99b447fb435c42a5b6e6fce P 8e63f584b9804ec1afc03bf1397e25c1 [term 1 FOLLOWER]: Refusing update from remote peer b1c53db3ddc2415d804b11fcadc625f1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:07:26.782473 7530 raft_consensus.cc:1261] T b4294e34f99b447fb435c42a5b6e6fce P f97454635ce64d0696be53c1f0e3bf67 [term 1 FOLLOWER]: Refusing update from remote peer b1c53db3ddc2415d804b11fcadc625f1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:07:26.783282 7918 consensus_queue.cc:1035] T b4294e34f99b447fb435c42a5b6e6fce P b1c53db3ddc2415d804b11fcadc625f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97454635ce64d0696be53c1f0e3bf67" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 36487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:07:26.783493 7922 consensus_queue.cc:1035] T b4294e34f99b447fb435c42a5b6e6fce P b1c53db3ddc2415d804b11fcadc625f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e63f584b9804ec1afc03bf1397e25c1" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 36811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:07:26.791843 7927 mvcc.cc:205] Tried to move back new op lower bound from 7317343628413161472 to 7317343628339720192. Current Snapshot: MvccSnapshot[applied={T|T < 7317343628413161472}]
I20260811 15:07:26.793064 7926 mvcc.cc:205] Tried to move back new op lower bound from 7317343628413161472 to 7317343628339720192. Current Snapshot: MvccSnapshot[applied={T|T < 7317343628413161472}]
I20260811 15:07:26.800695 7360 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55768:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 15:07:26.800863 7360 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55768:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 15:07:26.803480 7360 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9e8352b41722429e80bf429247675c99: Sending DeleteTablet for 3 replicas of tablet b4294e34f99b447fb435c42a5b6e6fce
I20260811 15:07:26.804382 7509 tablet_service.cc:1514] Processing DeleteTablet for tablet b4294e34f99b447fb435c42a5b6e6fce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:07:26 UTC) from {username='kudu', principal='kudu/127.19.236.126@KRBTEST.COM'} at 127.0.0.1:52356
I20260811 15:07:26.804454 7818 tablet_service.cc:1514] Processing DeleteTablet for tablet b4294e34f99b447fb435c42a5b6e6fce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:07:26 UTC) from {username='kudu', principal='kudu/127.19.236.126@KRBTEST.COM'} at 127.0.0.1:53274
I20260811 15:07:26.804489 7660 tablet_service.cc:1514] Processing DeleteTablet for tablet b4294e34f99b447fb435c42a5b6e6fce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:07:26 UTC) from {username='kudu', principal='kudu/127.19.236.126@KRBTEST.COM'} at 127.0.0.1:58180
I20260811 15:07:26.805126 7938 tablet_replica.cc:330] T b4294e34f99b447fb435c42a5b6e6fce P b1c53db3ddc2415d804b11fcadc625f1: stopping tablet replica
I20260811 15:07:26.805126 7940 tablet_replica.cc:330] T b4294e34f99b447fb435c42a5b6e6fce P f97454635ce64d0696be53c1f0e3bf67: stopping tablet replica
I20260811 15:07:26.805382 7937 tablet_replica.cc:330] T b4294e34f99b447fb435c42a5b6e6fce P 8e63f584b9804ec1afc03bf1397e25c1: stopping tablet replica
I20260811 15:07:26.805492 7940 raft_consensus.cc:2229] T b4294e34f99b447fb435c42a5b6e6fce P f97454635ce64d0696be53c1f0e3bf67 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 15:07:26.805778 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 7435
I20260811 15:07:26.809104 7937 raft_consensus.cc:2229] T b4294e34f99b447fb435c42a5b6e6fce P 8e63f584b9804ec1afc03bf1397e25c1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 15:07:26.809266 7938 raft_consensus.cc:2229] T b4294e34f99b447fb435c42a5b6e6fce P b1c53db3ddc2415d804b11fcadc625f1 [term 1 LEADER]: Raft consensus shutting down.
I20260811 15:07:26.809702 7938 raft_consensus.cc:2258] T b4294e34f99b447fb435c42a5b6e6fce P b1c53db3ddc2415d804b11fcadc625f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:07:26.810050 7937 raft_consensus.cc:2258] T b4294e34f99b447fb435c42a5b6e6fce P 8e63f584b9804ec1afc03bf1397e25c1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:07:26.812105 7938 ts_tablet_manager.cc:1905] T b4294e34f99b447fb435c42a5b6e6fce P b1c53db3ddc2415d804b11fcadc625f1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 15:07:26.815044 7938 ts_tablet_manager.cc:1918] T b4294e34f99b447fb435c42a5b6e6fce P b1c53db3ddc2415d804b11fcadc625f1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 15:07:26.815196 7938 log.cc:1196] T b4294e34f99b447fb435c42a5b6e6fce P b1c53db3ddc2415d804b11fcadc625f1: Deleting WAL directory at /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/minicluster-data/ts-1/wal/wals/b4294e34f99b447fb435c42a5b6e6fce
I20260811 15:07:26.815578 7938 ts_tablet_manager.cc:1939] T b4294e34f99b447fb435c42a5b6e6fce P b1c53db3ddc2415d804b11fcadc625f1: Deleting consensus metadata
I20260811 15:07:26.816093 7937 ts_tablet_manager.cc:1905] T b4294e34f99b447fb435c42a5b6e6fce P 8e63f584b9804ec1afc03bf1397e25c1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 15:07:26.816954 7345 catalog_manager.cc:4841] TS b1c53db3ddc2415d804b11fcadc625f1 (127.19.236.66:45195): tablet b4294e34f99b447fb435c42a5b6e6fce (table test-table [id=6eab90c987c8424396001d47b3a6bc17]) successfully deleted
I20260811 15:07:26.818653 7937 ts_tablet_manager.cc:1918] T b4294e34f99b447fb435c42a5b6e6fce P 8e63f584b9804ec1afc03bf1397e25c1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 15:07:26.818773 7937 log.cc:1196] T b4294e34f99b447fb435c42a5b6e6fce P 8e63f584b9804ec1afc03bf1397e25c1: Deleting WAL directory at /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786460596631409-20401-0/minicluster-data/ts-2/wal/wals/b4294e34f99b447fb435c42a5b6e6fce
I20260811 15:07:26.819185 7937 ts_tablet_manager.cc:1939] T b4294e34f99b447fb435c42a5b6e6fce P 8e63f584b9804ec1afc03bf1397e25c1: Deleting consensus metadata
I20260811 15:07:26.820446 7343 catalog_manager.cc:4841] TS 8e63f584b9804ec1afc03bf1397e25c1 (127.19.236.67:36811): tablet b4294e34f99b447fb435c42a5b6e6fce (table test-table [id=6eab90c987c8424396001d47b3a6bc17]) successfully deleted
W20260811 15:07:26.823689 7344 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.19.236.65:36487 (error 108)
I20260811 15:07:26.823920 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 7587
I20260811 15:07:26.827431 7908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:26.826971 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.65:36487 (local address 127.0.0.1:52364)
0811 15:07:26.827207 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:26.827318 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.65:36487: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128}
W20260811 15:07:26.827765 7344 catalog_manager.cc:4584] TS f97454635ce64d0696be53c1f0e3bf67 (127.19.236.65:36487): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet b4294e34f99b447fb435c42a5b6e6fce: Network error: Client connection negotiation failed: client connection to 127.19.236.65:36487: connect: Connection refused (error 111)
I20260811 15:07:26.833770 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 7742
I20260811 15:07:26.845165 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 7323
2026-08-11T15:07:26Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2440 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-11T15:07:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T15:07:26Z Disabled control of system clock
I20260811 15:07:26.879778 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460596631409-20401-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460596631409-20401-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460596631409-20401-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:46765
--webserver_interface=127.19.236.126
--webserver_port=0
--builtin_ntp_servers=127.19.236.84:42351
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.236.126:46765
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 15:07:26.995808 7945 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:07:26.996091 7945 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:07:26.996129 7945 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:07:27.000077 7945 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:07:27.000145 7945 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:07:27.000160 7945 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:07:27.000177 7945 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:07:27.000193 7945 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:07:27.005105 7945 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:42351
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460596631409-20401-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460596631409-20401-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.236.126:46765
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:46765
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.236.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7945
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460596631409-20401-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:07:27.006245 7945 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:07:27.007653 7945 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 15:07:27.016587 7945 server_base.cc:1034] running on GCE node
W20260811 15:07:27.016507 7950 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:07:27.016518 7954 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:07:27.016527 7951 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:07:27.017486 7945 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:07:27.018644 7945 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:07:27.019816 7945 hybrid_clock.cc:648] HybridClock initialized: now 1786460847019802 us; error 39 us; skew 500 ppm
I20260811 15:07:27.021870 7945 webserver.cc:460] Webserver started at http://127.19.236.126:33391/ using document root <none> and password file <none>
I20260811 15:07:27.022475 7945 fs_manager.cc:359] Metadata directory not provided
I20260811 15:07:27.022549 7945 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:07:27.022779 7945 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:07:27.024974 7945 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460596631409-20401-0/minicluster-data/master-0/data/instance:
uuid: "38ec1cbc02af4041aeaa3ee806e318dc"
format_stamp: "Formatted at 2026-08-11 15:07:27 on dist-test-slave-8n49"
server_key: "4af5346e91c3ea6cc5e4d5073f57ef03"
server_key_iv: "47159494a9c2a53f6273546b304705b8"
server_key_version: "encryptionkey@0"
I20260811 15:07:27.025631 7945 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460596631409-20401-0/minicluster-data/master-0/wal/instance:
uuid: "38ec1cbc02af4041aeaa3ee806e318dc"
format_stamp: "Formatted at 2026-08-11 15:07:27 on dist-test-slave-8n49"
server_key: "4af5346e91c3ea6cc5e4d5073f57ef03"
server_key_iv: "47159494a9c2a53f6273546b304705b8"
server_key_version: "encryptionkey@0"
I20260811 15:07:27.029477 7945 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260811 15:07:27.031934 7962 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:07:27.033258 7945 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 15:07:27.033406 7945 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460596631409-20401-0/minicluster-data/master-0/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460596631409-20401-0/minicluster-data/master-0/wal
uuid: "38ec1cbc02af4041aeaa3ee806e318dc"
format_stamp: "Formatted at 2026-08-11 15:07:27 on dist-test-slave-8n49"
server_key: "4af5346e91c3ea6cc5e4d5073f57ef03"
server_key_iv: "47159494a9c2a53f6273546b304705b8"
server_key_version: "encryptionkey@0"
I20260811 15:07:27.033535 7945 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460596631409-20401-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460596631409-20401-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460596631409-20401-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:07:27.049556 7945 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:07:27.050339 7945 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:07:27.050565 7945 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:07:27.058670 7945 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.126:46765
I20260811 15:07:27.058677 8020 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.126:46765 every 8 connection(s)
I20260811 15:07:27.059719 7945 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
I20260811 15:07:27.063176 8021 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:07:27.066152 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 7945
I20260811 15:07:27.066334 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460596631409-20401-0/minicluster-data/master-0/wal/instance
I20260811 15:07:27.066632 20401 external_mini_cluster.cc:1428] Setting key 60df1e44bbe9c046efceff2d157dc529
I20260811 15:07:27.069479 8021 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 38ec1cbc02af4041aeaa3ee806e318dc: Bootstrap starting.
I20260811 15:07:27.072142 8021 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 38ec1cbc02af4041aeaa3ee806e318dc: Neither blocks nor log segments found. Creating new log.
I20260811 15:07:27.073115 8021 log.cc:824] T 00000000000000000000000000000000 P 38ec1cbc02af4041aeaa3ee806e318dc: Log is configured to *not* fsync() on all Append() calls
I20260811 15:07:27.075440 8021 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 38ec1cbc02af4041aeaa3ee806e318dc: No bootstrap required, opened a new log
I20260811 15:07:27.076654 8024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:27.068175 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59370 (local address 127.19.236.126:46765)
0811 15:07:27.068847 (+ 672us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:27.068863 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:27.068899 (+ 36us) server_negotiation.cc:407] Connection header received
0811 15:07:27.069552 (+ 653us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:27.069568 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:27.070017 (+ 449us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:27.070301 (+ 284us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:07:27.070658 (+ 357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:27.071629 (+ 971us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:27.072924 (+ 1295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:27.073451 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:27.073630 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:27.074451 (+ 821us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:07:27.074457 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:07:27.074473 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:07:27.074967 (+ 494us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:07:27.075038 (+ 71us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:07:27.075066 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:07:27.075172 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:27.075351 (+ 179us) server_negotiation.cc:299] Negotiation successful
0811 15:07:27.075703 (+ 352us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":280,"thread_start_us":148,"threads_started":1}
I20260811 15:07:27.079778 8021 raft_consensus.cc:348] T 00000000000000000000000000000000 P 38ec1cbc02af4041aeaa3ee806e318dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38ec1cbc02af4041aeaa3ee806e318dc" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 46765 } }
I20260811 15:07:27.080003 8021 raft_consensus.cc:374] T 00000000000000000000000000000000 P 38ec1cbc02af4041aeaa3ee806e318dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:07:27.080037 8021 raft_consensus.cc:729] T 00000000000000000000000000000000 P 38ec1cbc02af4041aeaa3ee806e318dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38ec1cbc02af4041aeaa3ee806e318dc, State: Initialized, Role: FOLLOWER
I20260811 15:07:27.080400 8021 consensus_queue.cc:260] T 00000000000000000000000000000000 P 38ec1cbc02af4041aeaa3ee806e318dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38ec1cbc02af4041aeaa3ee806e318dc" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 46765 } }
I20260811 15:07:27.080514 8021 raft_consensus.cc:388] T 00000000000000000000000000000000 P 38ec1cbc02af4041aeaa3ee806e318dc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 15:07:27.080614 8021 raft_consensus.cc:482] T 00000000000000000000000000000000 P 38ec1cbc02af4041aeaa3ee806e318dc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 15:07:27.080699 8021 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 38ec1cbc02af4041aeaa3ee806e318dc [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:07:27.081635 8021 raft_consensus.cc:504] T 00000000000000000000000000000000 P 38ec1cbc02af4041aeaa3ee806e318dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38ec1cbc02af4041aeaa3ee806e318dc" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 46765 } }
I20260811 15:07:27.081945 8021 leader_election.cc:302] T 00000000000000000000000000000000 P 38ec1cbc02af4041aeaa3ee806e318dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 38ec1cbc02af4041aeaa3ee806e318dc; no voters:
I20260811 15:07:27.082249 8021 leader_election.cc:288] T 00000000000000000000000000000000 P 38ec1cbc02af4041aeaa3ee806e318dc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 15:07:27.082448 8026 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 38ec1cbc02af4041aeaa3ee806e318dc [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:07:27.082687 8026 raft_consensus.cc:686] T 00000000000000000000000000000000 P 38ec1cbc02af4041aeaa3ee806e318dc [term 1 LEADER]: Becoming Leader. State: Replica: 38ec1cbc02af4041aeaa3ee806e318dc, State: Running, Role: LEADER
I20260811 15:07:27.083032 8026 consensus_queue.cc:237] T 00000000000000000000000000000000 P 38ec1cbc02af4041aeaa3ee806e318dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38ec1cbc02af4041aeaa3ee806e318dc" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 46765 } }
I20260811 15:07:27.083595 8021 sys_catalog.cc:564] T 00000000000000000000000000000000 P 38ec1cbc02af4041aeaa3ee806e318dc [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:07:27.084816 8027 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38ec1cbc02af4041aeaa3ee806e318dc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "38ec1cbc02af4041aeaa3ee806e318dc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38ec1cbc02af4041aeaa3ee806e318dc" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 46765 } } }
I20260811 15:07:27.084957 8027 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38ec1cbc02af4041aeaa3ee806e318dc [sys.catalog]: This master's current role is: LEADER
I20260811 15:07:27.085310 8028 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38ec1cbc02af4041aeaa3ee806e318dc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 38ec1cbc02af4041aeaa3ee806e318dc. Latest consensus state: current_term: 1 leader_uuid: "38ec1cbc02af4041aeaa3ee806e318dc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38ec1cbc02af4041aeaa3ee806e318dc" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 46765 } } }
I20260811 15:07:27.085467 8028 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38ec1cbc02af4041aeaa3ee806e318dc [sys.catalog]: This master's current role is: LEADER
I20260811 15:07:27.085796 8036 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:07:27.088689 8036 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:07:27.094029 8036 catalog_manager.cc:1347] Generated new cluster ID: 044f76555a03412e8c9df18f1dd37d8f
I20260811 15:07:27.094112 8036 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:07:27.117583 8036 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 15:07:27.118701 8036 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:07:27.125952 8036 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 38ec1cbc02af4041aeaa3ee806e318dc: Generated new TSK 0
I20260811 15:07:27.126825 8036 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 15:07:27.140638 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460596631409-20401-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460596631409-20401-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460596631409-20401-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.65:0
--local_ip_for_outbound_sockets=127.19.236.65
--webserver_interface=127.19.236.65
--webserver_port=0
--tserver_master_addrs=127.19.236.126:46765
--builtin_ntp_servers=127.19.236.84:42351
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 15:07:27.257620 8046 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:07:27.257877 8046 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:07:27.257958 8046 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:07:27.262674 8046 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:07:27.262744 8046 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:07:27.262800 8046 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.65
I20260811 15:07:27.267971 8046 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:42351
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460596631409-20401-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460596631409-20401-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.236.65
--webserver_port=0
--tserver_master_addrs=127.19.236.126:46765
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8046
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.65
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460596631409-20401-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:07:27.269388 8046 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:07:27.271430 8046 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:07:27.281818 8052 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:07:27.281929 8046 server_base.cc:1034] running on GCE node
W20260811 15:07:27.281831 8051 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:07:27.281818 8054 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:07:27.282474 8046 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:07:27.283206 8046 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:07:27.284404 8046 hybrid_clock.cc:648] HybridClock initialized: now 1786460847284400 us; error 40 us; skew 500 ppm
I20260811 15:07:27.286410 8046 webserver.cc:460] Webserver started at http://127.19.236.65:34939/ using document root <none> and password file <none>
I20260811 15:07:27.287037 8046 fs_manager.cc:359] Metadata directory not provided
I20260811 15:07:27.287140 8046 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:07:27.287393 8046 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:07:27.289772 8046 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460596631409-20401-0/minicluster-data/ts-0/data/instance:
uuid: "6193290edcc04f84bf90b32a1dc96334"
format_stamp: "Formatted at 2026-08-11 15:07:27 on dist-test-slave-8n49"
server_key: "5fd6736f13fd2b18564a005aa5633b99"
server_key_iv: "1039674e50783e690cd26368bc9eae1b"
server_key_version: "encryptionkey@0"
I20260811 15:07:27.290395 8046 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460596631409-20401-0/minicluster-data/ts-0/wal/instance:
uuid: "6193290edcc04f84bf90b32a1dc96334"
format_stamp: "Formatted at 2026-08-11 15:07:27 on dist-test-slave-8n49"
server_key: "5fd6736f13fd2b18564a005aa5633b99"
server_key_iv: "1039674e50783e690cd26368bc9eae1b"
server_key_version: "encryptionkey@0"
I20260811 15:07:27.294932 8046 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 15:07:27.298812 8062 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:07:27.300357 8046 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 15:07:27.300606 8046 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460596631409-20401-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460596631409-20401-0/minicluster-data/ts-0/wal
uuid: "6193290edcc04f84bf90b32a1dc96334"
format_stamp: "Formatted at 2026-08-11 15:07:27 on dist-test-slave-8n49"
server_key: "5fd6736f13fd2b18564a005aa5633b99"
server_key_iv: "1039674e50783e690cd26368bc9eae1b"
server_key_version: "encryptionkey@0"
I20260811 15:07:27.300771 8046 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460596631409-20401-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460596631409-20401-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460596631409-20401-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:07:27.323062 8046 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:07:27.323880 8046 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:07:27.324112 8046 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:07:27.324805 8046 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:07:27.325872 8046 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:07:27.325953 8046 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:07:27.326035 8046 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:07:27.326081 8046 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:07:27.335803 8046 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.65:42947
I20260811 15:07:27.335880 8185 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.65:42947 every 8 connection(s)
I20260811 15:07:27.336944 8046 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
I20260811 15:07:27.339083 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 8046
I20260811 15:07:27.339218 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460596631409-20401-0/minicluster-data/ts-0/wal/instance
I20260811 15:07:27.339542 20401 external_mini_cluster.cc:1428] Setting key 75fc594539d701327c602a708f4911b3
I20260811 15:07:27.341984 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460596631409-20401-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460596631409-20401-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460596631409-20401-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.66:0
--local_ip_for_outbound_sockets=127.19.236.66
--webserver_interface=127.19.236.66
--webserver_port=0
--tserver_master_addrs=127.19.236.126:46765
--builtin_ntp_servers=127.19.236.84:42351
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 15:07:27.348246 8024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:27.339200 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.65:51605 (local address 127.19.236.126:46765)
0811 15:07:27.339334 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:27.339338 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:27.340803 (+ 1465us) server_negotiation.cc:407] Connection header received
0811 15:07:27.342862 (+ 2059us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:27.342867 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:27.342935 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:27.343039 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:07:27.344295 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:27.344957 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:27.346136 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:27.346368 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:27.346482 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:27.347729 (+ 1247us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:07:27.347738 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:07:27.347740 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:07:27.347753 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:07:27.347772 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:07:27.347779 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:07:27.347861 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:27.348023 (+ 162us) server_negotiation.cc:299] Negotiation successful
0811 15:07:27.348096 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 15:07:27.349193 8188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:27.339798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:46765 (local address 127.19.236.65:51605)
0811 15:07:27.340651 (+ 853us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:27.340706 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0811 15:07:27.342560 (+ 1854us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:07:27.343255 (+ 695us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:07:27.343267 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:07:27.343382 (+ 115us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:07:27.344134 (+ 752us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:27.344160 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:27.345089 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:27.345092 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:27.345997 (+ 905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:27.346007 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:27.346530 (+ 523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:27.346534 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:27.346749 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:27.347445 (+ 696us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 15:07:27.347447 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:07:27.347488 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 15:07:27.347556 (+ 68us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:07:27.347863 (+ 307us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:07:27.347876 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:07:27.347883 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 15:07:27.348023 (+ 140us) client_negotiation.cc:240] Negotiation successful
0811 15:07:27.348312 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":341,"thread_start_us":171,"threads_started":1}
I20260811 15:07:27.350512 8186 heartbeater.cc:347] Connected to a master server at 127.19.236.126:46765
I20260811 15:07:27.350771 8186 heartbeater.cc:464] Registering TS with master...
I20260811 15:07:27.351320 8186 heartbeater.cc:511] Master 127.19.236.126:46765 requested a full tablet report, sending...
I20260811 15:07:27.353262 7981 ts_manager.cc:194] Registered new tserver with Master: 6193290edcc04f84bf90b32a1dc96334 (127.19.236.65:42947)
I20260811 15:07:27.355033 7981 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.19.236.65:51605
W20260811 15:07:27.465087 8189 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:07:27.465371 8189 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:07:27.465411 8189 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:07:27.469477 8189 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:07:27.469535 8189 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:07:27.469591 8189 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.66
I20260811 15:07:27.474524 8189 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:42351
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460596631409-20401-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460596631409-20401-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.236.66
--webserver_port=0
--tserver_master_addrs=127.19.236.126:46765
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8189
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.66
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460596631409-20401-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:07:27.475696 8189 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:07:27.477126 8189 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:07:27.487516 8196 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:07:27.487498 8195 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:07:27.487483 8198 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:07:27.487850 8189 server_base.cc:1034] running on GCE node
I20260811 15:07:27.488310 8189 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:07:27.489068 8189 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:07:27.490240 8189 hybrid_clock.cc:648] HybridClock initialized: now 1786460847490210 us; error 45 us; skew 500 ppm
I20260811 15:07:27.492071 8189 webserver.cc:460] Webserver started at http://127.19.236.66:41545/ using document root <none> and password file <none>
I20260811 15:07:27.492772 8189 fs_manager.cc:359] Metadata directory not provided
I20260811 15:07:27.492839 8189 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:07:27.493113 8189 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:07:27.495302 8189 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460596631409-20401-0/minicluster-data/ts-1/data/instance:
uuid: "37940468327f45e1b9a95f6b74566c9c"
format_stamp: "Formatted at 2026-08-11 15:07:27 on dist-test-slave-8n49"
server_key: "88d21fd25c9d27cb944a43d42352aea0"
server_key_iv: "783873bb8e06e47962f6c03750e5b6e2"
server_key_version: "encryptionkey@0"
I20260811 15:07:27.495901 8189 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460596631409-20401-0/minicluster-data/ts-1/wal/instance:
uuid: "37940468327f45e1b9a95f6b74566c9c"
format_stamp: "Formatted at 2026-08-11 15:07:27 on dist-test-slave-8n49"
server_key: "88d21fd25c9d27cb944a43d42352aea0"
server_key_iv: "783873bb8e06e47962f6c03750e5b6e2"
server_key_version: "encryptionkey@0"
I20260811 15:07:27.499776 8189 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260811 15:07:27.502398 8204 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:07:27.503654 8189 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 15:07:27.503779 8189 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460596631409-20401-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460596631409-20401-0/minicluster-data/ts-1/wal
uuid: "37940468327f45e1b9a95f6b74566c9c"
format_stamp: "Formatted at 2026-08-11 15:07:27 on dist-test-slave-8n49"
server_key: "88d21fd25c9d27cb944a43d42352aea0"
server_key_iv: "783873bb8e06e47962f6c03750e5b6e2"
server_key_version: "encryptionkey@0"
I20260811 15:07:27.503892 8189 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460596631409-20401-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460596631409-20401-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460596631409-20401-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:07:27.523815 8189 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:07:27.524657 8189 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:07:27.524866 8189 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:07:27.525507 8189 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:07:27.526516 8189 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:07:27.526566 8189 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:07:27.526607 8189 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:07:27.526669 8189 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:07:27.535905 8189 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.66:34107
I20260811 15:07:27.535933 8334 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.66:34107 every 8 connection(s)
I20260811 15:07:27.536909 8189 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
I20260811 15:07:27.540180 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 8189
I20260811 15:07:27.540324 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460596631409-20401-0/minicluster-data/ts-1/wal/instance
I20260811 15:07:27.540706 20401 external_mini_cluster.cc:1428] Setting key a2f835f876b70de1be6069fe0978848a
I20260811 15:07:27.542706 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460596631409-20401-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460596631409-20401-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460596631409-20401-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.67:0
--local_ip_for_outbound_sockets=127.19.236.67
--webserver_interface=127.19.236.67
--webserver_port=0
--tserver_master_addrs=127.19.236.126:46765
--builtin_ntp_servers=127.19.236.84:42351
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 15:07:27.547410 8024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:27.538862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.66:35477 (local address 127.19.236.126:46765)
0811 15:07:27.539004 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:27.539007 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:27.540044 (+ 1037us) server_negotiation.cc:407] Connection header received
0811 15:07:27.541808 (+ 1764us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:27.541812 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:27.541865 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:27.541963 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:07:27.543003 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:27.543847 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:27.545366 (+ 1519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:27.545591 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:27.545732 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:27.546895 (+ 1163us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:07:27.546899 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:07:27.546902 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:07:27.546923 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:07:27.546942 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:07:27.546950 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:07:27.547031 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:27.547196 (+ 165us) server_negotiation.cc:299] Negotiation successful
0811 15:07:27.547263 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 15:07:27.548285 8337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:27.539227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:46765 (local address 127.19.236.66:35477)
0811 15:07:27.539870 (+ 643us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:27.539929 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0811 15:07:27.541600 (+ 1671us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:07:27.542179 (+ 579us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:07:27.542188 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:07:27.542289 (+ 101us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:07:27.542784 (+ 495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:27.542797 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:27.543975 (+ 1178us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:27.543978 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:27.545223 (+ 1245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:27.545234 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:27.545773 (+ 539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:27.545776 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:27.545959 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:27.546602 (+ 643us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 15:07:27.546604 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:07:27.546662 (+ 58us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 15:07:27.546729 (+ 67us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:07:27.547034 (+ 305us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:07:27.547046 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:07:27.547054 (+ 8us) client_negotiation.cc:769] Sending connection context
0811 15:07:27.547195 (+ 141us) client_negotiation.cc:240] Negotiation successful
0811 15:07:27.547489 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":266,"thread_start_us":111,"threads_started":1}
I20260811 15:07:27.549657 8335 heartbeater.cc:347] Connected to a master server at 127.19.236.126:46765
I20260811 15:07:27.549916 8335 heartbeater.cc:464] Registering TS with master...
I20260811 15:07:27.550465 8335 heartbeater.cc:511] Master 127.19.236.126:46765 requested a full tablet report, sending...
I20260811 15:07:27.551633 7981 ts_manager.cc:194] Registered new tserver with Master: 37940468327f45e1b9a95f6b74566c9c (127.19.236.66:34107)
I20260811 15:07:27.552218 7981 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.19.236.66:35477
W20260811 15:07:27.662021 8338 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:07:27.662360 8338 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:07:27.662443 8338 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:07:27.666721 8338 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:07:27.666834 8338 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:07:27.666934 8338 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.67
I20260811 15:07:27.671929 8338 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:42351
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460596631409-20401-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460596631409-20401-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.236.67
--webserver_port=0
--tserver_master_addrs=127.19.236.126:46765
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8338
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.67
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460596631409-20401-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:07:27.673162 8338 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:07:27.674642 8338 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:07:27.684667 8344 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:07:27.684669 8346 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:07:27.684667 8348 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:07:27.685184 8338 server_base.cc:1034] running on GCE node
I20260811 15:07:27.685570 8338 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:07:27.686249 8338 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:07:27.687417 8338 hybrid_clock.cc:648] HybridClock initialized: now 1786460847687402 us; error 26 us; skew 500 ppm
I20260811 15:07:27.693111 8338 webserver.cc:460] Webserver started at http://127.19.236.67:41127/ using document root <none> and password file <none>
I20260811 15:07:27.693784 8338 fs_manager.cc:359] Metadata directory not provided
I20260811 15:07:27.693858 8338 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:07:27.694096 8338 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:07:27.696382 8338 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460596631409-20401-0/minicluster-data/ts-2/data/instance:
uuid: "7a0a3edf94f54e6cb96cf874fe582f60"
format_stamp: "Formatted at 2026-08-11 15:07:27 on dist-test-slave-8n49"
server_key: "78e850555172c88e04b1daa40bf89a78"
server_key_iv: "ffb1ba11fd07b2c56b65c394874bd174"
server_key_version: "encryptionkey@0"
I20260811 15:07:27.697117 8338 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460596631409-20401-0/minicluster-data/ts-2/wal/instance:
uuid: "7a0a3edf94f54e6cb96cf874fe582f60"
format_stamp: "Formatted at 2026-08-11 15:07:27 on dist-test-slave-8n49"
server_key: "78e850555172c88e04b1daa40bf89a78"
server_key_iv: "ffb1ba11fd07b2c56b65c394874bd174"
server_key_version: "encryptionkey@0"
I20260811 15:07:27.701395 8338 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 15:07:27.704082 8355 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:07:27.705778 8338 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 15:07:27.706038 8338 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460596631409-20401-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460596631409-20401-0/minicluster-data/ts-2/wal
uuid: "7a0a3edf94f54e6cb96cf874fe582f60"
format_stamp: "Formatted at 2026-08-11 15:07:27 on dist-test-slave-8n49"
server_key: "78e850555172c88e04b1daa40bf89a78"
server_key_iv: "ffb1ba11fd07b2c56b65c394874bd174"
server_key_version: "encryptionkey@0"
I20260811 15:07:27.706171 8338 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460596631409-20401-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460596631409-20401-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460596631409-20401-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:07:27.725545 8338 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:07:27.726326 8338 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:07:27.726511 8338 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:07:27.727097 8338 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:07:27.728068 8338 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:07:27.728118 8338 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:07:27.728159 8338 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:07:27.728174 8338 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:07:27.738201 8338 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.67:46003
I20260811 15:07:27.738409 8484 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.67:46003 every 8 connection(s)
I20260811 15:07:27.739297 8338 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
I20260811 15:07:27.741094 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 8338
I20260811 15:07:27.741233 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460596631409-20401-0/minicluster-data/ts-2/wal/instance
I20260811 15:07:27.741590 20401 external_mini_cluster.cc:1428] Setting key 52c27a7f7b58e2a42e9bf08e21d2b052
I20260811 15:07:27.750200 8024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:27.741515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.67:48949 (local address 127.19.236.126:46765)
0811 15:07:27.741706 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:27.741712 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:27.742985 (+ 1273us) server_negotiation.cc:407] Connection header received
0811 15:07:27.744832 (+ 1847us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:27.744836 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:27.744896 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:27.745020 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:07:27.746170 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:27.746719 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:27.747921 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:27.748162 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:27.748281 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:27.749616 (+ 1335us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:07:27.749620 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:07:27.749622 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:07:27.749636 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:07:27.749661 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:07:27.749671 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:07:27.749763 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:27.749961 (+ 198us) server_negotiation.cc:299] Negotiation successful
0811 15:07:27.750034 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 15:07:27.751214 8487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:27.742009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:46765 (local address 127.19.236.67:48949)
0811 15:07:27.742826 (+ 817us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:27.742882 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0811 15:07:27.744610 (+ 1728us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:07:27.745323 (+ 713us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:07:27.745332 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:07:27.745428 (+ 96us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:07:27.745971 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:27.745985 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:27.746872 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:27.746875 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:27.747782 (+ 907us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:27.747792 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:27.748328 (+ 536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:27.748332 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:27.748529 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:27.749257 (+ 728us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 15:07:27.749259 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:07:27.749303 (+ 44us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 15:07:27.749399 (+ 96us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:07:27.749777 (+ 378us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:07:27.749790 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:07:27.749798 (+ 8us) client_negotiation.cc:769] Sending connection context
0811 15:07:27.749958 (+ 160us) client_negotiation.cc:240] Negotiation successful
0811 15:07:27.750284 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":332,"thread_start_us":166,"threads_started":1}
I20260811 15:07:27.752463 8485 heartbeater.cc:347] Connected to a master server at 127.19.236.126:46765
I20260811 15:07:27.752754 8485 heartbeater.cc:464] Registering TS with master...
I20260811 15:07:27.753324 8485 heartbeater.cc:511] Master 127.19.236.126:46765 requested a full tablet report, sending...
I20260811 15:07:27.754552 7981 ts_manager.cc:194] Registered new tserver with Master: 7a0a3edf94f54e6cb96cf874fe582f60 (127.19.236.67:46003)
I20260811 15:07:27.755330 7981 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.19.236.67:48949
I20260811 15:07:27.756001 20401 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 15:07:27.762248 8024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:27.758259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59376 (local address 127.19.236.126:46765)
0811 15:07:27.758394 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:27.758398 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:27.758534 (+ 136us) server_negotiation.cc:407] Connection header received
0811 15:07:27.758651 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:27.758653 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:27.758688 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:27.758756 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:07:27.758985 (+ 229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:27.759473 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:27.760302 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:27.760514 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:27.760759 (+ 245us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:27.761739 (+ 980us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:07:27.761742 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:07:27.761744 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:07:27.761756 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:07:27.761775 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:07:27.761784 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:07:27.761845 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:27.762068 (+ 223us) server_negotiation.cc:299] Negotiation successful
0811 15:07:27.762136 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 15:07:27.765506 7980 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59376:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 15:07:27.770165 7980 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 15:07:27.788360 8497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:27.782339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.67:46003 (local address 127.0.0.1:60386)
0811 15:07:27.782713 (+ 374us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:27.782773 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0811 15:07:27.782942 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:07:27.783543 (+ 601us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:07:27.783549 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:07:27.783572 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:07:27.783732 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:27.783740 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:27.785194 (+ 1454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:27.785197 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:27.786209 (+ 1012us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:27.786220 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:27.787740 (+ 1520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:27.787743 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:27.787859 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:27.787906 (+ 47us) client_negotiation.cc:769] Sending connection context
0811 15:07:27.788058 (+ 152us) client_negotiation.cc:240] Negotiation successful
0811 15:07:27.788189 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":182,"mutex_wait_us":24,"spinlock_wait_cycles":21632,"thread_start_us":98,"threads_started":1}
I20260811 15:07:27.788367 8496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:27.782097 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60386 (local address 127.19.236.67:46003)
0811 15:07:27.782443 (+ 346us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:27.782457 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:27.782862 (+ 405us) server_negotiation.cc:407] Connection header received
0811 15:07:27.783099 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:27.783107 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:27.783396 (+ 289us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:27.783563 (+ 167us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:07:27.783828 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:27.785036 (+ 1208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:27.786347 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:27.787220 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:27.787325 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:27.787551 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:27.788095 (+ 544us) server_negotiation.cc:299] Negotiation successful
0811 15:07:27.788193 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":227,"thread_start_us":106,"threads_started":1}
I20260811 15:07:27.789789 8500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:27.783124 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.65:42947 (local address 127.0.0.1:49720)
0811 15:07:27.783401 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:27.783427 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0811 15:07:27.783856 (+ 429us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:07:27.785122 (+ 1266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:07:27.785127 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:07:27.785151 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:07:27.785275 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:27.785280 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:27.786827 (+ 1547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:27.786830 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:27.788010 (+ 1180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:27.788021 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:27.789344 (+ 1323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:27.789347 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:27.789483 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:27.789505 (+ 22us) client_negotiation.cc:769] Sending connection context
0811 15:07:27.789578 (+ 73us) client_negotiation.cc:240] Negotiation successful
0811 15:07:27.789648 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":207,"mutex_wait_us":29,"thread_start_us":118,"threads_started":1}
I20260811 15:07:27.791555 8499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:27.782389 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.66:34107 (local address 127.0.0.1:54014)
0811 15:07:27.782713 (+ 324us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:27.782773 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0811 15:07:27.782942 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:07:27.786654 (+ 3712us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:07:27.786659 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:07:27.786682 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:07:27.786811 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:27.786820 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:27.788271 (+ 1451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:27.788275 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:27.789746 (+ 1471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:27.789756 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:27.791064 (+ 1308us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:27.791071 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:27.791195 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:27.791219 (+ 24us) client_negotiation.cc:769] Sending connection context
0811 15:07:27.791290 (+ 71us) client_negotiation.cc:240] Negotiation successful
0811 15:07:27.791381 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"mutex_wait_us":21,"thread_start_us":93,"threads_started":1}
I20260811 15:07:27.792157 8503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:27.783213 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54014 (local address 127.19.236.66:34107)
0811 15:07:27.783728 (+ 515us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:27.783740 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:27.783763 (+ 23us) server_negotiation.cc:407] Connection header received
0811 15:07:27.783845 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:27.783853 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:27.784043 (+ 190us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:27.784252 (+ 209us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:07:27.787057 (+ 2805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:27.788153 (+ 1096us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:27.789895 (+ 1742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:27.790718 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:27.790824 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:27.790997 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:27.791837 (+ 840us) server_negotiation.cc:299] Negotiation successful
0811 15:07:27.791941 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":413,"thread_start_us":103,"threads_started":1}
I20260811 15:07:27.795506 8261 tablet_service.cc:1467] Processing CreateTablet for tablet a0d6837c3d7948798db30f538070c1d6 (DEFAULT_TABLE table=test-table [id=a3d81575738645ea9bae3eb344abfb32]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:07:27.792474 8409 tablet_service.cc:1467] Processing CreateTablet for tablet a0d6837c3d7948798db30f538070c1d6 (DEFAULT_TABLE table=test-table [id=a3d81575738645ea9bae3eb344abfb32]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:07:27.796830 8261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a0d6837c3d7948798db30f538070c1d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:07:27.797420 8409 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a0d6837c3d7948798db30f538070c1d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:07:27.800771 8504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:27.783734 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49720 (local address 127.19.236.65:42947)
0811 15:07:27.784545 (+ 811us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:27.784585 (+ 40us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:27.784624 (+ 39us) server_negotiation.cc:407] Connection header received
0811 15:07:27.784760 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:27.784767 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:27.784958 (+ 191us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:27.785121 (+ 163us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:07:27.785427 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:27.786693 (+ 1266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:27.788165 (+ 1472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:27.789012 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:27.789112 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:27.789282 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:27.789661 (+ 379us) server_negotiation.cc:299] Negotiation successful
0811 15:07:27.789790 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":690,"thread_start_us":117,"threads_started":1}
I20260811 15:07:27.803934 8117 tablet_service.cc:1467] Processing CreateTablet for tablet a0d6837c3d7948798db30f538070c1d6 (DEFAULT_TABLE table=test-table [id=a3d81575738645ea9bae3eb344abfb32]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:07:27.805140 8117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a0d6837c3d7948798db30f538070c1d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:07:27.806454 8505 tablet_bootstrap.cc:492] T a0d6837c3d7948798db30f538070c1d6 P 37940468327f45e1b9a95f6b74566c9c: Bootstrap starting.
I20260811 15:07:27.808166 8506 tablet_bootstrap.cc:492] T a0d6837c3d7948798db30f538070c1d6 P 7a0a3edf94f54e6cb96cf874fe582f60: Bootstrap starting.
I20260811 15:07:27.809015 8505 tablet_bootstrap.cc:654] T a0d6837c3d7948798db30f538070c1d6 P 37940468327f45e1b9a95f6b74566c9c: Neither blocks nor log segments found. Creating new log.
I20260811 15:07:27.809969 8505 log.cc:824] T a0d6837c3d7948798db30f538070c1d6 P 37940468327f45e1b9a95f6b74566c9c: Log is configured to *not* fsync() on all Append() calls
I20260811 15:07:27.810624 8506 tablet_bootstrap.cc:654] T a0d6837c3d7948798db30f538070c1d6 P 7a0a3edf94f54e6cb96cf874fe582f60: Neither blocks nor log segments found. Creating new log.
I20260811 15:07:27.811496 8506 log.cc:824] T a0d6837c3d7948798db30f538070c1d6 P 7a0a3edf94f54e6cb96cf874fe582f60: Log is configured to *not* fsync() on all Append() calls
I20260811 15:07:27.812497 8505 tablet_bootstrap.cc:492] T a0d6837c3d7948798db30f538070c1d6 P 37940468327f45e1b9a95f6b74566c9c: No bootstrap required, opened a new log
I20260811 15:07:27.812738 8505 ts_tablet_manager.cc:1397] T a0d6837c3d7948798db30f538070c1d6 P 37940468327f45e1b9a95f6b74566c9c: Time spent bootstrapping tablet: real 0.006s user 0.006s sys 0.000s
I20260811 15:07:27.813400 8510 tablet_bootstrap.cc:492] T a0d6837c3d7948798db30f538070c1d6 P 6193290edcc04f84bf90b32a1dc96334: Bootstrap starting.
I20260811 15:07:27.814033 8506 tablet_bootstrap.cc:492] T a0d6837c3d7948798db30f538070c1d6 P 7a0a3edf94f54e6cb96cf874fe582f60: No bootstrap required, opened a new log
I20260811 15:07:27.814225 8506 ts_tablet_manager.cc:1397] T a0d6837c3d7948798db30f538070c1d6 P 7a0a3edf94f54e6cb96cf874fe582f60: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260811 15:07:27.815421 8510 tablet_bootstrap.cc:654] T a0d6837c3d7948798db30f538070c1d6 P 6193290edcc04f84bf90b32a1dc96334: Neither blocks nor log segments found. Creating new log.
I20260811 15:07:27.816114 8510 log.cc:824] T a0d6837c3d7948798db30f538070c1d6 P 6193290edcc04f84bf90b32a1dc96334: Log is configured to *not* fsync() on all Append() calls
I20260811 15:07:27.817261 8505 raft_consensus.cc:348] T a0d6837c3d7948798db30f538070c1d6 P 37940468327f45e1b9a95f6b74566c9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a0a3edf94f54e6cb96cf874fe582f60" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 46003 } } peers { permanent_uuid: "6193290edcc04f84bf90b32a1dc96334" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 42947 } } peers { permanent_uuid: "37940468327f45e1b9a95f6b74566c9c" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 34107 } }
I20260811 15:07:27.817557 8505 raft_consensus.cc:374] T a0d6837c3d7948798db30f538070c1d6 P 37940468327f45e1b9a95f6b74566c9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:07:27.817620 8505 raft_consensus.cc:729] T a0d6837c3d7948798db30f538070c1d6 P 37940468327f45e1b9a95f6b74566c9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37940468327f45e1b9a95f6b74566c9c, State: Initialized, Role: FOLLOWER
I20260811 15:07:27.818143 8505 consensus_queue.cc:260] T a0d6837c3d7948798db30f538070c1d6 P 37940468327f45e1b9a95f6b74566c9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a0a3edf94f54e6cb96cf874fe582f60" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 46003 } } peers { permanent_uuid: "6193290edcc04f84bf90b32a1dc96334" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 42947 } } peers { permanent_uuid: "37940468327f45e1b9a95f6b74566c9c" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 34107 } }
I20260811 15:07:27.818323 8510 tablet_bootstrap.cc:492] T a0d6837c3d7948798db30f538070c1d6 P 6193290edcc04f84bf90b32a1dc96334: No bootstrap required, opened a new log
I20260811 15:07:27.818506 8510 ts_tablet_manager.cc:1397] T a0d6837c3d7948798db30f538070c1d6 P 6193290edcc04f84bf90b32a1dc96334: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260811 15:07:27.818434 8506 raft_consensus.cc:348] T a0d6837c3d7948798db30f538070c1d6 P 7a0a3edf94f54e6cb96cf874fe582f60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a0a3edf94f54e6cb96cf874fe582f60" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 46003 } } peers { permanent_uuid: "6193290edcc04f84bf90b32a1dc96334" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 42947 } } peers { permanent_uuid: "37940468327f45e1b9a95f6b74566c9c" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 34107 } }
I20260811 15:07:27.818668 8506 raft_consensus.cc:374] T a0d6837c3d7948798db30f538070c1d6 P 7a0a3edf94f54e6cb96cf874fe582f60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:07:27.818715 8506 raft_consensus.cc:729] T a0d6837c3d7948798db30f538070c1d6 P 7a0a3edf94f54e6cb96cf874fe582f60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a0a3edf94f54e6cb96cf874fe582f60, State: Initialized, Role: FOLLOWER
I20260811 15:07:27.819116 8506 consensus_queue.cc:260] T a0d6837c3d7948798db30f538070c1d6 P 7a0a3edf94f54e6cb96cf874fe582f60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a0a3edf94f54e6cb96cf874fe582f60" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 46003 } } peers { permanent_uuid: "6193290edcc04f84bf90b32a1dc96334" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 42947 } } peers { permanent_uuid: "37940468327f45e1b9a95f6b74566c9c" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 34107 } }
I20260811 15:07:27.819198 8505 ts_tablet_manager.cc:1428] T a0d6837c3d7948798db30f538070c1d6 P 37940468327f45e1b9a95f6b74566c9c: Time spent starting tablet: real 0.006s user 0.002s sys 0.004s
I20260811 15:07:27.819571 8335 heartbeater.cc:503] Master 127.19.236.126:46765 was elected leader, sending a full tablet report...
I20260811 15:07:27.820034 8506 ts_tablet_manager.cc:1428] T a0d6837c3d7948798db30f538070c1d6 P 7a0a3edf94f54e6cb96cf874fe582f60: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260811 15:07:27.820364 8485 heartbeater.cc:503] Master 127.19.236.126:46765 was elected leader, sending a full tablet report...
I20260811 15:07:27.828409 8510 raft_consensus.cc:348] T a0d6837c3d7948798db30f538070c1d6 P 6193290edcc04f84bf90b32a1dc96334 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a0a3edf94f54e6cb96cf874fe582f60" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 46003 } } peers { permanent_uuid: "6193290edcc04f84bf90b32a1dc96334" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 42947 } } peers { permanent_uuid: "37940468327f45e1b9a95f6b74566c9c" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 34107 } }
I20260811 15:07:27.828799 8510 raft_consensus.cc:374] T a0d6837c3d7948798db30f538070c1d6 P 6193290edcc04f84bf90b32a1dc96334 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:07:27.828868 8510 raft_consensus.cc:729] T a0d6837c3d7948798db30f538070c1d6 P 6193290edcc04f84bf90b32a1dc96334 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6193290edcc04f84bf90b32a1dc96334, State: Initialized, Role: FOLLOWER
I20260811 15:07:27.829422 8510 consensus_queue.cc:260] T a0d6837c3d7948798db30f538070c1d6 P 6193290edcc04f84bf90b32a1dc96334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a0a3edf94f54e6cb96cf874fe582f60" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 46003 } } peers { permanent_uuid: "6193290edcc04f84bf90b32a1dc96334" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 42947 } } peers { permanent_uuid: "37940468327f45e1b9a95f6b74566c9c" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 34107 } }
I20260811 15:07:27.830236 8186 heartbeater.cc:503] Master 127.19.236.126:46765 was elected leader, sending a full tablet report...
I20260811 15:07:27.830610 8510 ts_tablet_manager.cc:1428] T a0d6837c3d7948798db30f538070c1d6 P 6193290edcc04f84bf90b32a1dc96334: Time spent starting tablet: real 0.012s user 0.009s sys 0.000s
W20260811 15:07:27.838163 8187 tablet.cc:2369] T a0d6837c3d7948798db30f538070c1d6 P 6193290edcc04f84bf90b32a1dc96334: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 15:07:27.990487 8486 tablet.cc:2369] T a0d6837c3d7948798db30f538070c1d6 P 7a0a3edf94f54e6cb96cf874fe582f60: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 15:07:28.038194 8336 tablet.cc:2369] T a0d6837c3d7948798db30f538070c1d6 P 37940468327f45e1b9a95f6b74566c9c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 15:07:28.127617 8514 raft_consensus.cc:482] T a0d6837c3d7948798db30f538070c1d6 P 6193290edcc04f84bf90b32a1dc96334 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 15:07:28.127872 8514 raft_consensus.cc:504] T a0d6837c3d7948798db30f538070c1d6 P 6193290edcc04f84bf90b32a1dc96334 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a0a3edf94f54e6cb96cf874fe582f60" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 46003 } } peers { permanent_uuid: "6193290edcc04f84bf90b32a1dc96334" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 42947 } } peers { permanent_uuid: "37940468327f45e1b9a95f6b74566c9c" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 34107 } }
I20260811 15:07:28.129135 8514 leader_election.cc:288] T a0d6837c3d7948798db30f538070c1d6 P 6193290edcc04f84bf90b32a1dc96334 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a0a3edf94f54e6cb96cf874fe582f60 (127.19.236.67:46003), 37940468327f45e1b9a95f6b74566c9c (127.19.236.66:34107)
I20260811 15:07:28.133093 8496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:28.129490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.65:48813 (local address 127.19.236.67:46003)
0811 15:07:28.129645 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:28.129650 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:28.129731 (+ 81us) server_negotiation.cc:407] Connection header received
0811 15:07:28.129989 (+ 258us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:28.129992 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:28.130037 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:28.130125 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:07:28.130409 (+ 284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:28.130940 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:28.132058 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:28.132485 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:28.132645 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:28.132699 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:28.132877 (+ 178us) server_negotiation.cc:299] Negotiation successful
0811 15:07:28.132957 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260811 15:07:28.133109 8515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:28.129365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.67:46003 (local address 127.19.236.65:48813)
0811 15:07:28.129638 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:28.129654 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 15:07:28.129823 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:07:28.130142 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:07:28.130145 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:07:28.130165 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:07:28.130291 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:28.130297 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:28.131062 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:28.131066 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:28.131930 (+ 864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:28.131939 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:28.132634 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:28.132638 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:28.132737 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:28.132768 (+ 31us) client_negotiation.cc:769] Sending connection context
0811 15:07:28.132859 (+ 91us) client_negotiation.cc:240] Negotiation successful
0811 15:07:28.132930 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":197,"mutex_wait_us":25,"thread_start_us":85,"threads_started":1}
I20260811 15:07:28.133108 8503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:28.129679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.65:56233 (local address 127.19.236.66:34107)
0811 15:07:28.129802 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:28.129806 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:28.129961 (+ 155us) server_negotiation.cc:407] Connection header received
0811 15:07:28.130135 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:28.130138 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:28.130190 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:28.130276 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:07:28.130569 (+ 293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:28.131060 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:28.132117 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:28.132522 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:28.132674 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:28.132722 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:28.132913 (+ 191us) server_negotiation.cc:299] Negotiation successful
0811 15:07:28.132981 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 15:07:28.133128 8516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:28.129493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.66:34107 (local address 127.19.236.65:56233)
0811 15:07:28.129850 (+ 357us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:28.129862 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 15:07:28.130011 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:07:28.130291 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:07:28.130294 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:07:28.130311 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:07:28.130445 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:28.130451 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:28.131177 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:28.131181 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:28.131975 (+ 794us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:28.131993 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:28.132670 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:28.132674 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:28.132778 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:28.132805 (+ 27us) client_negotiation.cc:769] Sending connection context
0811 15:07:28.132895 (+ 90us) client_negotiation.cc:240] Negotiation successful
0811 15:07:28.132966 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":290,"mutex_wait_us":1,"thread_start_us":153,"threads_started":1}
I20260811 15:07:28.133968 8285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a0d6837c3d7948798db30f538070c1d6" candidate_uuid: "6193290edcc04f84bf90b32a1dc96334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37940468327f45e1b9a95f6b74566c9c" is_pre_election: true
I20260811 15:07:28.133976 8430 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a0d6837c3d7948798db30f538070c1d6" candidate_uuid: "6193290edcc04f84bf90b32a1dc96334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a0a3edf94f54e6cb96cf874fe582f60" is_pre_election: true
I20260811 15:07:28.134302 8285 raft_consensus.cc:2454] T a0d6837c3d7948798db30f538070c1d6 P 37940468327f45e1b9a95f6b74566c9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6193290edcc04f84bf90b32a1dc96334 in term 0.
I20260811 15:07:28.134302 8430 raft_consensus.cc:2454] T a0d6837c3d7948798db30f538070c1d6 P 7a0a3edf94f54e6cb96cf874fe582f60 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6193290edcc04f84bf90b32a1dc96334 in term 0.
I20260811 15:07:28.134847 8065 leader_election.cc:302] T a0d6837c3d7948798db30f538070c1d6 P 6193290edcc04f84bf90b32a1dc96334 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 37940468327f45e1b9a95f6b74566c9c, 6193290edcc04f84bf90b32a1dc96334, 7a0a3edf94f54e6cb96cf874fe582f60; no voters:
I20260811 15:07:28.135155 8514 raft_consensus.cc:2781] T a0d6837c3d7948798db30f538070c1d6 P 6193290edcc04f84bf90b32a1dc96334 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 15:07:28.135234 8514 raft_consensus.cc:482] T a0d6837c3d7948798db30f538070c1d6 P 6193290edcc04f84bf90b32a1dc96334 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 15:07:28.135265 8514 raft_consensus.cc:3037] T a0d6837c3d7948798db30f538070c1d6 P 6193290edcc04f84bf90b32a1dc96334 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:07:28.136353 8514 raft_consensus.cc:504] T a0d6837c3d7948798db30f538070c1d6 P 6193290edcc04f84bf90b32a1dc96334 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a0a3edf94f54e6cb96cf874fe582f60" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 46003 } } peers { permanent_uuid: "6193290edcc04f84bf90b32a1dc96334" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 42947 } } peers { permanent_uuid: "37940468327f45e1b9a95f6b74566c9c" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 34107 } }
I20260811 15:07:28.136842 8514 leader_election.cc:288] T a0d6837c3d7948798db30f538070c1d6 P 6193290edcc04f84bf90b32a1dc96334 [CANDIDATE]: Term 1 election: Requested vote from peers 7a0a3edf94f54e6cb96cf874fe582f60 (127.19.236.67:46003), 37940468327f45e1b9a95f6b74566c9c (127.19.236.66:34107)
I20260811 15:07:28.137212 8430 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a0d6837c3d7948798db30f538070c1d6" candidate_uuid: "6193290edcc04f84bf90b32a1dc96334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a0a3edf94f54e6cb96cf874fe582f60"
I20260811 15:07:28.137212 8285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a0d6837c3d7948798db30f538070c1d6" candidate_uuid: "6193290edcc04f84bf90b32a1dc96334" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37940468327f45e1b9a95f6b74566c9c"
I20260811 15:07:28.137341 8285 raft_consensus.cc:3037] T a0d6837c3d7948798db30f538070c1d6 P 37940468327f45e1b9a95f6b74566c9c [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:07:28.137367 8430 raft_consensus.cc:3037] T a0d6837c3d7948798db30f538070c1d6 P 7a0a3edf94f54e6cb96cf874fe582f60 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:07:28.138620 8430 raft_consensus.cc:2454] T a0d6837c3d7948798db30f538070c1d6 P 7a0a3edf94f54e6cb96cf874fe582f60 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6193290edcc04f84bf90b32a1dc96334 in term 1.
I20260811 15:07:28.138620 8285 raft_consensus.cc:2454] T a0d6837c3d7948798db30f538070c1d6 P 37940468327f45e1b9a95f6b74566c9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6193290edcc04f84bf90b32a1dc96334 in term 1.
I20260811 15:07:28.138928 8065 leader_election.cc:302] T a0d6837c3d7948798db30f538070c1d6 P 6193290edcc04f84bf90b32a1dc96334 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 37940468327f45e1b9a95f6b74566c9c, 6193290edcc04f84bf90b32a1dc96334, 7a0a3edf94f54e6cb96cf874fe582f60; no voters:
I20260811 15:07:28.139076 8514 raft_consensus.cc:2781] T a0d6837c3d7948798db30f538070c1d6 P 6193290edcc04f84bf90b32a1dc96334 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:07:28.139297 8514 raft_consensus.cc:686] T a0d6837c3d7948798db30f538070c1d6 P 6193290edcc04f84bf90b32a1dc96334 [term 1 LEADER]: Becoming Leader. State: Replica: 6193290edcc04f84bf90b32a1dc96334, State: Running, Role: LEADER
I20260811 15:07:28.139659 8514 consensus_queue.cc:237] T a0d6837c3d7948798db30f538070c1d6 P 6193290edcc04f84bf90b32a1dc96334 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a0a3edf94f54e6cb96cf874fe582f60" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 46003 } } peers { permanent_uuid: "6193290edcc04f84bf90b32a1dc96334" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 42947 } } peers { permanent_uuid: "37940468327f45e1b9a95f6b74566c9c" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 34107 } }
I20260811 15:07:28.142931 7979 catalog_manager.cc:5495] T a0d6837c3d7948798db30f538070c1d6 P 6193290edcc04f84bf90b32a1dc96334 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6193290edcc04f84bf90b32a1dc96334 (127.19.236.65). New cstate: current_term: 1 leader_uuid: "6193290edcc04f84bf90b32a1dc96334" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a0a3edf94f54e6cb96cf874fe582f60" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 46003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6193290edcc04f84bf90b32a1dc96334" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 42947 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37940468327f45e1b9a95f6b74566c9c" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 34107 } health_report { overall_health: UNKNOWN } } }
I20260811 15:07:28.242590 8504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:28.238901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49724 (local address 127.19.236.65:42947)
0811 15:07:28.239068 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:28.239073 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:28.239089 (+ 16us) server_negotiation.cc:407] Connection header received
0811 15:07:28.239214 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:28.239217 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:28.239276 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:28.239392 (+ 116us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 15:07:28.239656 (+ 264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:28.240186 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:28.241094 (+ 908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:28.241315 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:28.241431 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:28.241756 (+ 325us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 15:07:28.242189 (+ 433us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 15:07:28.242324 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:28.242385 (+ 61us) server_negotiation.cc:299] Negotiation successful
0811 15:07:28.242440 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 15:07:28.248607 8430 raft_consensus.cc:1261] T a0d6837c3d7948798db30f538070c1d6 P 7a0a3edf94f54e6cb96cf874fe582f60 [term 1 FOLLOWER]: Refusing update from remote peer 6193290edcc04f84bf90b32a1dc96334: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:07:28.248644 8285 raft_consensus.cc:1261] T a0d6837c3d7948798db30f538070c1d6 P 37940468327f45e1b9a95f6b74566c9c [term 1 FOLLOWER]: Refusing update from remote peer 6193290edcc04f84bf90b32a1dc96334: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:07:28.249378 8514 consensus_queue.cc:1035] T a0d6837c3d7948798db30f538070c1d6 P 6193290edcc04f84bf90b32a1dc96334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37940468327f45e1b9a95f6b74566c9c" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 34107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:07:28.249586 8517 consensus_queue.cc:1035] T a0d6837c3d7948798db30f538070c1d6 P 6193290edcc04f84bf90b32a1dc96334 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a0a3edf94f54e6cb96cf874fe582f60" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 46003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:07:28.266988 7980 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59376:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 15:07:28.267184 7980 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59376:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 15:07:28.269886 7980 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 38ec1cbc02af4041aeaa3ee806e318dc: Sending DeleteTablet for 3 replicas of tablet a0d6837c3d7948798db30f538070c1d6
I20260811 15:07:28.270800 8261 tablet_service.cc:1514] Processing DeleteTablet for tablet a0d6837c3d7948798db30f538070c1d6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:07:28 UTC) from {username='slave'} at 127.0.0.1:54014
I20260811 15:07:28.270838 8409 tablet_service.cc:1514] Processing DeleteTablet for tablet a0d6837c3d7948798db30f538070c1d6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:07:28 UTC) from {username='slave'} at 127.0.0.1:60386
I20260811 15:07:28.271039 8117 tablet_service.cc:1514] Processing DeleteTablet for tablet a0d6837c3d7948798db30f538070c1d6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:07:28 UTC) from {username='slave'} at 127.0.0.1:49720
I20260811 15:07:28.271328 8532 tablet_replica.cc:330] T a0d6837c3d7948798db30f538070c1d6 P 7a0a3edf94f54e6cb96cf874fe582f60: stopping tablet replica
I20260811 15:07:28.271484 8534 tablet_replica.cc:330] T a0d6837c3d7948798db30f538070c1d6 P 6193290edcc04f84bf90b32a1dc96334: stopping tablet replica
I20260811 15:07:28.271665 8532 raft_consensus.cc:2229] T a0d6837c3d7948798db30f538070c1d6 P 7a0a3edf94f54e6cb96cf874fe582f60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 15:07:28.271716 8534 raft_consensus.cc:2229] T a0d6837c3d7948798db30f538070c1d6 P 6193290edcc04f84bf90b32a1dc96334 [term 1 LEADER]: Raft consensus shutting down.
I20260811 15:07:28.271997 8532 raft_consensus.cc:2258] T a0d6837c3d7948798db30f538070c1d6 P 7a0a3edf94f54e6cb96cf874fe582f60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:07:28.272055 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 8046
I20260811 15:07:28.272065 8534 raft_consensus.cc:2258] T a0d6837c3d7948798db30f538070c1d6 P 6193290edcc04f84bf90b32a1dc96334 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:07:28.276027 8532 ts_tablet_manager.cc:1905] T a0d6837c3d7948798db30f538070c1d6 P 7a0a3edf94f54e6cb96cf874fe582f60: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 15:07:28.280221 8532 ts_tablet_manager.cc:1918] T a0d6837c3d7948798db30f538070c1d6 P 7a0a3edf94f54e6cb96cf874fe582f60: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 15:07:28.280360 8532 log.cc:1196] T a0d6837c3d7948798db30f538070c1d6 P 7a0a3edf94f54e6cb96cf874fe582f60: Deleting WAL directory at /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460596631409-20401-0/minicluster-data/ts-2/wal/wals/a0d6837c3d7948798db30f538070c1d6
I20260811 15:07:28.280833 8532 ts_tablet_manager.cc:1939] T a0d6837c3d7948798db30f538070c1d6 P 7a0a3edf94f54e6cb96cf874fe582f60: Deleting consensus metadata
I20260811 15:07:28.282359 8533 tablet_replica.cc:330] T a0d6837c3d7948798db30f538070c1d6 P 37940468327f45e1b9a95f6b74566c9c: stopping tablet replica
I20260811 15:07:28.282647 7964 catalog_manager.cc:4841] TS 7a0a3edf94f54e6cb96cf874fe582f60 (127.19.236.67:46003): tablet a0d6837c3d7948798db30f538070c1d6 (table test-table [id=a3d81575738645ea9bae3eb344abfb32]) successfully deleted
I20260811 15:07:28.282832 8533 raft_consensus.cc:2229] T a0d6837c3d7948798db30f538070c1d6 P 37940468327f45e1b9a95f6b74566c9c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 15:07:28.283221 8533 raft_consensus.cc:2258] T a0d6837c3d7948798db30f538070c1d6 P 37940468327f45e1b9a95f6b74566c9c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:07:28.284727 8533 ts_tablet_manager.cc:1905] T a0d6837c3d7948798db30f538070c1d6 P 37940468327f45e1b9a95f6b74566c9c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 15:07:28.287252 8533 ts_tablet_manager.cc:1918] T a0d6837c3d7948798db30f538070c1d6 P 37940468327f45e1b9a95f6b74566c9c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 15:07:28.287376 8533 log.cc:1196] T a0d6837c3d7948798db30f538070c1d6 P 37940468327f45e1b9a95f6b74566c9c: Deleting WAL directory at /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786460596631409-20401-0/minicluster-data/ts-1/wal/wals/a0d6837c3d7948798db30f538070c1d6
I20260811 15:07:28.287660 8533 ts_tablet_manager.cc:1939] T a0d6837c3d7948798db30f538070c1d6 P 37940468327f45e1b9a95f6b74566c9c: Deleting consensus metadata
I20260811 15:07:28.288986 7967 catalog_manager.cc:4841] TS 37940468327f45e1b9a95f6b74566c9c (127.19.236.66:34107): tablet a0d6837c3d7948798db30f538070c1d6 (table test-table [id=a3d81575738645ea9bae3eb344abfb32]) successfully deleted
W20260811 15:07:28.289657 7964 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.19.236.65:42947 (error 108)
I20260811 15:07:28.289970 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 8189
I20260811 15:07:28.293279 8536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:28.292847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.65:42947 (local address 127.0.0.1:49738)
0811 15:07:28.293102 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:28.293186 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.65:42947: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":74,"threads_started":1}
W20260811 15:07:28.293598 7964 catalog_manager.cc:4584] TS 6193290edcc04f84bf90b32a1dc96334 (127.19.236.65:42947): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet a0d6837c3d7948798db30f538070c1d6: Network error: Client connection negotiation failed: client connection to 127.19.236.65:42947: connect: Connection refused (error 111)
I20260811 15:07:28.298449 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 8338
I20260811 15:07:28.308039 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 7945
2026-08-11T15:07:28Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (1462 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 15:07:28 dist-test-slave-8n49 krb5kdc[8540](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 15:07:28 dist-test-slave-8n49 krb5kdc[8540](info): set up 2 sockets
Aug 11 15:07:28 dist-test-slave-8n49 krb5kdc[8540](info): commencing operation
krb5kdc: starting...
W20260811 15:07:29.422279 20401 mini_kdc.cc:121] Time spent starting KDC: real 1.089s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/krb5kdc/test-user.keytab.
Aug 11 15:07:29 dist-test-slave-8n49 krb5kdc[8540](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460849, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T15:07:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T15:07:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.236.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.236.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.236.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab.
Entry for principal kudu/127.19.236.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab.
I20260811 15:07:29.560613 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:46455
--webserver_interface=127.19.236.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab
--principal=kudu/127.19.236.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:36325
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.236.126:46455
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:07:29.678938 8556 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:07:29.679286 8556 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:07:29.679373 8556 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:07:29.683538 8556 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:07:29.683650 8556 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:07:29.683691 8556 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:07:29.683729 8556 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:07:29.683765 8556 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:07:29.689440 8556 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:36325
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.236.126:46455
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab
--principal=kudu/127.19.236.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:46455
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.236.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8556
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:07:29.690670 8556 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:07:29.691761 8556 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:07:29.701018 8561 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:07:29.701205 8556 server_base.cc:1034] running on GCE node
W20260811 15:07:29.701035 8562 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:07:29.701042 8564 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:07:29.702001 8556 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:07:29.703094 8556 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:07:29.704263 8556 hybrid_clock.cc:648] HybridClock initialized: now 1786460849704250 us; error 27 us; skew 500 ppm
Aug 11 15:07:29 dist-test-slave-8n49 krb5kdc[8540](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460849, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:07:29.710795 8556 init.cc:377] Logged in from keytab as kudu/127.19.236.126@KRBTEST.COM (short username kudu)
I20260811 15:07:29.711819 8556 webserver.cc:460] Webserver started at http://127.19.236.126:38619/ using document root <none> and password file <none>
I20260811 15:07:29.712389 8556 fs_manager.cc:359] Metadata directory not provided
I20260811 15:07:29.712452 8556 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:07:29.712713 8556 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:07:29.714805 8556 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/minicluster-data/master-0/data/instance:
uuid: "bec865480dff41e1912963d1686bc63a"
format_stamp: "Formatted at 2026-08-11 15:07:29 on dist-test-slave-8n49"
server_key: "9cdf63a053f5543b30c0d4efc42ec12b"
server_key_iv: "bddbe600dcf2d95565ad6f0a6984e80d"
server_key_version: "encryptionkey@0"
I20260811 15:07:29.715353 8556 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/minicluster-data/master-0/wal/instance:
uuid: "bec865480dff41e1912963d1686bc63a"
format_stamp: "Formatted at 2026-08-11 15:07:29 on dist-test-slave-8n49"
server_key: "9cdf63a053f5543b30c0d4efc42ec12b"
server_key_iv: "bddbe600dcf2d95565ad6f0a6984e80d"
server_key_version: "encryptionkey@0"
I20260811 15:07:29.719247 8556 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260811 15:07:29.721773 8575 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:07:29.723130 8556 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 15:07:29.723284 8556 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/minicluster-data/master-0/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/minicluster-data/master-0/wal
uuid: "bec865480dff41e1912963d1686bc63a"
format_stamp: "Formatted at 2026-08-11 15:07:29 on dist-test-slave-8n49"
server_key: "9cdf63a053f5543b30c0d4efc42ec12b"
server_key_iv: "bddbe600dcf2d95565ad6f0a6984e80d"
server_key_version: "encryptionkey@0"
I20260811 15:07:29.723409 8556 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:07:29.737043 8556 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:07:29.740046 8556 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:07:29.740278 8556 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:07:29.747596 8556 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.126:46455
I20260811 15:07:29.747622 8635 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.126:46455 every 8 connection(s)
I20260811 15:07:29.748703 8556 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
I20260811 15:07:29.751441 8636 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:07:29.756942 8636 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bec865480dff41e1912963d1686bc63a: Bootstrap starting.
I20260811 15:07:29.758682 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 8556
I20260811 15:07:29.758827 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/minicluster-data/master-0/wal/instance
I20260811 15:07:29.759147 20401 external_mini_cluster.cc:1428] Setting key b6f5498a79df7e111aeafec5ee04eb01
I20260811 15:07:29.759649 8636 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bec865480dff41e1912963d1686bc63a: Neither blocks nor log segments found. Creating new log.
I20260811 15:07:29.760500 8636 log.cc:824] T 00000000000000000000000000000000 P bec865480dff41e1912963d1686bc63a: Log is configured to *not* fsync() on all Append() calls
I20260811 15:07:29.762341 8636 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bec865480dff41e1912963d1686bc63a: No bootstrap required, opened a new log
I20260811 15:07:29.765842 8636 raft_consensus.cc:348] T 00000000000000000000000000000000 P bec865480dff41e1912963d1686bc63a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bec865480dff41e1912963d1686bc63a" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 46455 } }
I20260811 15:07:29.766155 8636 raft_consensus.cc:374] T 00000000000000000000000000000000 P bec865480dff41e1912963d1686bc63a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:07:29.766223 8636 raft_consensus.cc:729] T 00000000000000000000000000000000 P bec865480dff41e1912963d1686bc63a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bec865480dff41e1912963d1686bc63a, State: Initialized, Role: FOLLOWER
I20260811 15:07:29.766675 8636 consensus_queue.cc:260] T 00000000000000000000000000000000 P bec865480dff41e1912963d1686bc63a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bec865480dff41e1912963d1686bc63a" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 46455 } }
I20260811 15:07:29.766848 8636 raft_consensus.cc:388] T 00000000000000000000000000000000 P bec865480dff41e1912963d1686bc63a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 15:07:29.766928 8636 raft_consensus.cc:482] T 00000000000000000000000000000000 P bec865480dff41e1912963d1686bc63a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 15:07:29.767055 8636 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bec865480dff41e1912963d1686bc63a [term 0 FOLLOWER]: Advancing to term 1
Aug 11 15:07:29 dist-test-slave-8n49 krb5kdc[8540](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460849, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
I20260811 15:07:29.767992 8636 raft_consensus.cc:504] T 00000000000000000000000000000000 P bec865480dff41e1912963d1686bc63a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bec865480dff41e1912963d1686bc63a" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 46455 } }
I20260811 15:07:29.768344 8636 leader_election.cc:302] T 00000000000000000000000000000000 P bec865480dff41e1912963d1686bc63a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bec865480dff41e1912963d1686bc63a; no voters:
I20260811 15:07:29.768716 8636 leader_election.cc:288] T 00000000000000000000000000000000 P bec865480dff41e1912963d1686bc63a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 15:07:29.768824 8644 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bec865480dff41e1912963d1686bc63a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:07:29.769096 8644 raft_consensus.cc:686] T 00000000000000000000000000000000 P bec865480dff41e1912963d1686bc63a [term 1 LEADER]: Becoming Leader. State: Replica: bec865480dff41e1912963d1686bc63a, State: Running, Role: LEADER
I20260811 15:07:29.769425 8644 consensus_queue.cc:237] T 00000000000000000000000000000000 P bec865480dff41e1912963d1686bc63a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bec865480dff41e1912963d1686bc63a" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 46455 } }
I20260811 15:07:29.770110 8636 sys_catalog.cc:564] T 00000000000000000000000000000000 P bec865480dff41e1912963d1686bc63a [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:07:29.770730 8644 sys_catalog.cc:455] T 00000000000000000000000000000000 P bec865480dff41e1912963d1686bc63a [sys.catalog]: SysCatalogTable state changed. Reason: New leader bec865480dff41e1912963d1686bc63a. Latest consensus state: current_term: 1 leader_uuid: "bec865480dff41e1912963d1686bc63a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bec865480dff41e1912963d1686bc63a" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 46455 } } }
I20260811 15:07:29.770859 8644 sys_catalog.cc:458] T 00000000000000000000000000000000 P bec865480dff41e1912963d1686bc63a [sys.catalog]: This master's current role is: LEADER
I20260811 15:07:29.771718 8645 sys_catalog.cc:455] T 00000000000000000000000000000000 P bec865480dff41e1912963d1686bc63a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bec865480dff41e1912963d1686bc63a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bec865480dff41e1912963d1686bc63a" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 46455 } } }
I20260811 15:07:29.771895 8645 sys_catalog.cc:458] T 00000000000000000000000000000000 P bec865480dff41e1912963d1686bc63a [sys.catalog]: This master's current role is: LEADER
I20260811 15:07:29.775214 8641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:29.760368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36242 (local address 127.19.236.126:46455)
0811 15:07:29.760867 (+ 499us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:29.760883 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:29.760918 (+ 35us) server_negotiation.cc:407] Connection header received
0811 15:07:29.761561 (+ 643us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:29.761577 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:29.761875 (+ 298us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:29.762246 (+ 371us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:07:29.763085 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:29.764048 (+ 963us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:29.764984 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:29.765446 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:29.765628 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:29.768507 (+ 2879us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:07:29.768515 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:07:29.768540 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:07:29.768612 (+ 72us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:07:29.770717 (+ 2105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:07:29.772035 (+ 1318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:07:29.772044 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:07:29.772050 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:07:29.772202 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:07:29.772606 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:07:29.772612 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:07:29.772615 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:07:29.773190 (+ 575us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:07:29.773392 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:29.773885 (+ 493us) server_negotiation.cc:299] Negotiation successful
0811 15:07:29.774225 (+ 340us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":358,"thread_start_us":182,"threads_started":1}
W20260811 15:07:29.776968 8661 catalog_manager.cc:1558] T 00000000000000000000000000000000 P bec865480dff41e1912963d1686bc63a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 15:07:29.777056 8661 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 15:07:29.777138 8652 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:07:29.778000 8652 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:07:29.783732 8652 catalog_manager.cc:1347] Generated new cluster ID: f6a9fd1be422412598b243a6215f39d6
I20260811 15:07:29.783833 8652 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:07:29.807492 8652 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 15:07:29.808849 8652 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:07:29.814858 8652 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bec865480dff41e1912963d1686bc63a: Generated new TSK 0
I20260811 15:07:29.815677 8652 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.236.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.236.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.236.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.65.keytab.
Entry for principal kudu/127.19.236.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.65.keytab.
I20260811 15:07:29.859475 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.65:0
--local_ip_for_outbound_sockets=127.19.236.65
--webserver_interface=127.19.236.65
--webserver_port=0
--tserver_master_addrs=127.19.236.126:46455
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.65.keytab
--principal=kudu/127.19.236.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:36325
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:07:29.973826 8667 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:07:29.974112 8667 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:07:29.974186 8667 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:07:29.978152 8667 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:07:29.978231 8667 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:07:29.978317 8667 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.65
I20260811 15:07:29.983458 8667 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:36325
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.65.keytab
--principal=kudu/127.19.236.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.236.65
--webserver_port=0
--tserver_master_addrs=127.19.236.126:46455
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8667
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.65
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:07:29.984699 8667 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:07:29.986063 8667 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:07:29.996018 8673 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:07:29.996081 8672 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:07:29.996049 8676 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:07:29.996269 8667 server_base.cc:1034] running on GCE node
I20260811 15:07:29.996752 8667 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:07:29.997421 8667 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:07:29.998610 8667 hybrid_clock.cc:648] HybridClock initialized: now 1786460849998594 us; error 39 us; skew 500 ppm
Aug 11 15:07:29 dist-test-slave-8n49 krb5kdc[8540](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460849, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:07:30.001348 8667 init.cc:377] Logged in from keytab as kudu/127.19.236.65@KRBTEST.COM (short username kudu)
I20260811 15:07:30.002209 8667 webserver.cc:460] Webserver started at http://127.19.236.65:46121/ using document root <none> and password file <none>
I20260811 15:07:30.002779 8667 fs_manager.cc:359] Metadata directory not provided
I20260811 15:07:30.002868 8667 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:07:30.003111 8667 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:07:30.005203 8667 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/minicluster-data/ts-0/data/instance:
uuid: "ca4485b9a34647fa8af4c17ec92aa30b"
format_stamp: "Formatted at 2026-08-11 15:07:29 on dist-test-slave-8n49"
server_key: "d4978bb6f94cb7b2d9d29bc77e321834"
server_key_iv: "03f5f722bf81e7011416665232cac207"
server_key_version: "encryptionkey@0"
I20260811 15:07:30.005775 8667 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/minicluster-data/ts-0/wal/instance:
uuid: "ca4485b9a34647fa8af4c17ec92aa30b"
format_stamp: "Formatted at 2026-08-11 15:07:29 on dist-test-slave-8n49"
server_key: "d4978bb6f94cb7b2d9d29bc77e321834"
server_key_iv: "03f5f722bf81e7011416665232cac207"
server_key_version: "encryptionkey@0"
I20260811 15:07:30.009512 8667 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260811 15:07:30.011869 8683 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:07:30.013154 8667 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 15:07:30.013291 8667 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/minicluster-data/ts-0/wal
uuid: "ca4485b9a34647fa8af4c17ec92aa30b"
format_stamp: "Formatted at 2026-08-11 15:07:29 on dist-test-slave-8n49"
server_key: "d4978bb6f94cb7b2d9d29bc77e321834"
server_key_iv: "03f5f722bf81e7011416665232cac207"
server_key_version: "encryptionkey@0"
I20260811 15:07:30.013404 8667 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:07:30.045522 8667 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:07:30.048589 8667 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:07:30.048805 8667 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:07:30.049494 8667 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:07:30.050359 8667 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:07:30.050433 8667 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:07:30.050503 8667 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:07:30.050547 8667 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:07:30.059616 8667 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.65:34411
I20260811 15:07:30.059635 8808 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.65:34411 every 8 connection(s)
I20260811 15:07:30.060541 8667 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
I20260811 15:07:30.067173 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 8667
I20260811 15:07:30.067322 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/minicluster-data/ts-0/wal/instance
I20260811 15:07:30.067655 20401 external_mini_cluster.cc:1428] Setting key febda19cd3669d98f3f8b1ed5418321e
Aug 11 15:07:30 dist-test-slave-8n49 krb5kdc[8540](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460849, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.65@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
I20260811 15:07:30.075448 8641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:30.062516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.65:57649 (local address 127.19.236.126:46455)
0811 15:07:30.062671 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:30.062675 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:30.063475 (+ 800us) server_negotiation.cc:407] Connection header received
0811 15:07:30.064895 (+ 1420us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:30.064898 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:30.064959 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:30.065041 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:07:30.066175 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:30.066734 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:30.068328 (+ 1594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:30.068683 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:30.068784 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:30.071650 (+ 2866us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:07:30.071653 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:07:30.071655 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:07:30.071679 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:07:30.073318 (+ 1639us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:07:30.073850 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:07:30.073854 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:07:30.073855 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:07:30.073942 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:07:30.074319 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:07:30.074322 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:07:30.074324 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:07:30.074512 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:07:30.074624 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:30.075133 (+ 509us) server_negotiation.cc:299] Negotiation successful
0811 15:07:30.075267 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 15:07:30.076269 8811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:30.062862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:46455 (local address 127.19.236.65:57649)
0811 15:07:30.063316 (+ 454us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:30.063359 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 15:07:30.064676 (+ 1317us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:07:30.065204 (+ 528us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:07:30.065210 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:07:30.065553 (+ 343us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:07:30.066025 (+ 472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:30.066038 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:30.066871 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:30.066875 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:30.068190 (+ 1315us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:30.068201 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:30.068829 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:30.068832 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:30.069053 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:30.069750 (+ 697us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:07:30.069767 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:07:30.071461 (+ 1694us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:07:30.073448 (+ 1987us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:07:30.073454 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:07:30.073468 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:07:30.073736 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:07:30.074042 (+ 306us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:07:30.074046 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:07:30.074048 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:07:30.074207 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:07:30.074626 (+ 419us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:07:30.074635 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:07:30.074887 (+ 252us) client_negotiation.cc:769] Sending connection context
0811 15:07:30.075092 (+ 205us) client_negotiation.cc:240] Negotiation successful
0811 15:07:30.075418 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":263,"thread_start_us":112,"threads_started":1}
I20260811 15:07:30.077591 8809 heartbeater.cc:347] Connected to a master server at 127.19.236.126:46455
WARNING: no policy specified for kudu/127.19.236.66@KRBTEST.COM; defaulting to no policy
I20260811 15:07:30.077858 8809 heartbeater.cc:464] Registering TS with master...
I20260811 15:07:30.078393 8809 heartbeater.cc:511] Master 127.19.236.126:46455 requested a full tablet report, sending...
I20260811 15:07:30.079991 8594 ts_manager.cc:194] Registered new tserver with Master: ca4485b9a34647fa8af4c17ec92aa30b (127.19.236.65:34411)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.236.66@KRBTEST.COM" created.
I20260811 15:07:30.081422 8594 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.236.65@KRBTEST.COM'} at 127.19.236.65:57649
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.236.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.66.keytab.
Entry for principal kudu/127.19.236.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.66.keytab.
I20260811 15:07:30.095731 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.66:0
--local_ip_for_outbound_sockets=127.19.236.66
--webserver_interface=127.19.236.66
--webserver_port=0
--tserver_master_addrs=127.19.236.126:46455
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.66.keytab
--principal=kudu/127.19.236.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:36325
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:07:30.208691 8814 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:07:30.208953 8814 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:07:30.208997 8814 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:07:30.213114 8814 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:07:30.213168 8814 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:07:30.213268 8814 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.66
I20260811 15:07:30.218644 8814 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:36325
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.66.keytab
--principal=kudu/127.19.236.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.236.66
--webserver_port=0
--tserver_master_addrs=127.19.236.126:46455
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8814
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.66
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:07:30.219748 8814 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:07:30.220983 8814 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:07:30.230736 8819 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:07:30.230784 8820 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:07:30.230918 8814 server_base.cc:1034] running on GCE node
W20260811 15:07:30.230729 8822 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:07:30.231554 8814 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:07:30.232303 8814 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:07:30.233515 8814 hybrid_clock.cc:648] HybridClock initialized: now 1786460850233442 us; error 82 us; skew 500 ppm
Aug 11 15:07:30 dist-test-slave-8n49 krb5kdc[8540](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460850, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:07:30.236212 8814 init.cc:377] Logged in from keytab as kudu/127.19.236.66@KRBTEST.COM (short username kudu)
I20260811 15:07:30.237150 8814 webserver.cc:460] Webserver started at http://127.19.236.66:39111/ using document root <none> and password file <none>
I20260811 15:07:30.237725 8814 fs_manager.cc:359] Metadata directory not provided
I20260811 15:07:30.237819 8814 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:07:30.238068 8814 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:07:30.240099 8814 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/minicluster-data/ts-1/data/instance:
uuid: "e7bc29de68ec4dfe99ca6113793b399b"
format_stamp: "Formatted at 2026-08-11 15:07:30 on dist-test-slave-8n49"
server_key: "6dd06b59a8166887a3e54bc316a1acbf"
server_key_iv: "d42a73c0f3e560ff606214d70d2ad182"
server_key_version: "encryptionkey@0"
I20260811 15:07:30.240741 8814 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/minicluster-data/ts-1/wal/instance:
uuid: "e7bc29de68ec4dfe99ca6113793b399b"
format_stamp: "Formatted at 2026-08-11 15:07:30 on dist-test-slave-8n49"
server_key: "6dd06b59a8166887a3e54bc316a1acbf"
server_key_iv: "d42a73c0f3e560ff606214d70d2ad182"
server_key_version: "encryptionkey@0"
I20260811 15:07:30.244644 8814 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 15:07:30.246987 8829 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:07:30.248188 8814 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 15:07:30.248344 8814 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/minicluster-data/ts-1/wal
uuid: "e7bc29de68ec4dfe99ca6113793b399b"
format_stamp: "Formatted at 2026-08-11 15:07:30 on dist-test-slave-8n49"
server_key: "6dd06b59a8166887a3e54bc316a1acbf"
server_key_iv: "d42a73c0f3e560ff606214d70d2ad182"
server_key_version: "encryptionkey@0"
I20260811 15:07:30.248461 8814 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:07:30.271940 8814 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:07:30.275162 8814 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:07:30.275375 8814 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:07:30.275979 8814 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:07:30.276868 8814 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:07:30.276916 8814 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:07:30.276983 8814 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:07:30.277020 8814 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:07:30.286684 8814 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.66:42961
I20260811 15:07:30.286768 8959 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.66:42961 every 8 connection(s)
I20260811 15:07:30.287601 8814 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
I20260811 15:07:30.292837 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 8814
I20260811 15:07:30.292968 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/minicluster-data/ts-1/wal/instance
I20260811 15:07:30.293323 20401 external_mini_cluster.cc:1428] Setting key 47fa4173823c42ad89cf61e93c8b8695
Aug 11 15:07:30 dist-test-slave-8n49 krb5kdc[8540](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460850, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.66@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
I20260811 15:07:30.302421 8641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:30.289470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.66:46091 (local address 127.19.236.126:46455)
0811 15:07:30.289616 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:30.289620 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:30.290909 (+ 1289us) server_negotiation.cc:407] Connection header received
0811 15:07:30.291756 (+ 847us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:30.291759 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:30.291808 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:30.291886 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:07:30.293187 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:30.293919 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:30.295367 (+ 1448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:30.295745 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:30.295877 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:30.298432 (+ 2555us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:07:30.298439 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:07:30.298445 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:07:30.298479 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:07:30.300178 (+ 1699us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:07:30.300699 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:07:30.300703 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:07:30.300705 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:07:30.300805 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:07:30.301158 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:07:30.301165 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:07:30.301170 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:07:30.301447 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:07:30.301561 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:30.302069 (+ 508us) server_negotiation.cc:299] Negotiation successful
0811 15:07:30.302227 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 15:07:30.303115 8962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:30.289844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:46455 (local address 127.19.236.66:46091)
0811 15:07:30.290749 (+ 905us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:30.290793 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 15:07:30.291564 (+ 771us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:07:30.292052 (+ 488us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:07:30.292058 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:07:30.292412 (+ 354us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:07:30.292995 (+ 583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:30.293020 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:30.294083 (+ 1063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:30.294087 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:30.295241 (+ 1154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:30.295251 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:30.295898 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:30.295901 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:30.296048 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:30.296687 (+ 639us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:07:30.296704 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:07:30.298270 (+ 1566us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:07:30.300296 (+ 2026us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:07:30.300300 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:07:30.300313 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:07:30.300611 (+ 298us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:07:30.300905 (+ 294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:07:30.300908 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:07:30.300909 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:07:30.301045 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:07:30.301567 (+ 522us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:07:30.301571 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:07:30.301797 (+ 226us) client_negotiation.cc:769] Sending connection context
0811 15:07:30.301946 (+ 149us) client_negotiation.cc:240] Negotiation successful
0811 15:07:30.302207 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":724,"thread_start_us":572,"threads_started":1}
I20260811 15:07:30.304324 8960 heartbeater.cc:347] Connected to a master server at 127.19.236.126:46455
I20260811 15:07:30.304615 8960 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.19.236.67@KRBTEST.COM; defaulting to no policy
I20260811 15:07:30.305133 8960 heartbeater.cc:511] Master 127.19.236.126:46455 requested a full tablet report, sending...
I20260811 15:07:30.306231 8594 ts_manager.cc:194] Registered new tserver with Master: e7bc29de68ec4dfe99ca6113793b399b (127.19.236.66:42961)
I20260811 15:07:30.306931 8594 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.236.66@KRBTEST.COM'} at 127.19.236.66:46091
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.236.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.236.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.67.keytab.
Entry for principal kudu/127.19.236.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.67.keytab.
I20260811 15:07:30.324460 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.67:0
--local_ip_for_outbound_sockets=127.19.236.67
--webserver_interface=127.19.236.67
--webserver_port=0
--tserver_master_addrs=127.19.236.126:46455
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.67.keytab
--principal=kudu/127.19.236.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:36325
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:07:30.438081 8965 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:07:30.438355 8965 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:07:30.438460 8965 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:07:30.442538 8965 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:07:30.442598 8965 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:07:30.442657 8965 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.67
I20260811 15:07:30.447906 8965 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:36325
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.67.keytab
--principal=kudu/127.19.236.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.236.67
--webserver_port=0
--tserver_master_addrs=127.19.236.126:46455
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8965
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.67
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:07:30.449014 8965 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:07:30.450124 8965 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:07:30.460140 8972 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:07:30.460134 8974 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:07:30.460134 8970 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:07:30.460671 8965 server_base.cc:1034] running on GCE node
I20260811 15:07:30.461083 8965 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:07:30.461684 8965 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:07:30.462843 8965 hybrid_clock.cc:648] HybridClock initialized: now 1786460850462831 us; error 26 us; skew 500 ppm
Aug 11 15:07:30 dist-test-slave-8n49 krb5kdc[8540](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460850, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:07:30.465715 8965 init.cc:377] Logged in from keytab as kudu/127.19.236.67@KRBTEST.COM (short username kudu)
I20260811 15:07:30.466591 8965 webserver.cc:460] Webserver started at http://127.19.236.67:39267/ using document root <none> and password file <none>
I20260811 15:07:30.467156 8965 fs_manager.cc:359] Metadata directory not provided
I20260811 15:07:30.467217 8965 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:07:30.467406 8965 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:07:30.469547 8965 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/minicluster-data/ts-2/data/instance:
uuid: "200e3b1b6354485bb6493d72fd554491"
format_stamp: "Formatted at 2026-08-11 15:07:30 on dist-test-slave-8n49"
server_key: "d7d14814e2b72da70869a6375d56808f"
server_key_iv: "780d61d4bd58b6fca460f5c8bc8496df"
server_key_version: "encryptionkey@0"
I20260811 15:07:30.470239 8965 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/minicluster-data/ts-2/wal/instance:
uuid: "200e3b1b6354485bb6493d72fd554491"
format_stamp: "Formatted at 2026-08-11 15:07:30 on dist-test-slave-8n49"
server_key: "d7d14814e2b72da70869a6375d56808f"
server_key_iv: "780d61d4bd58b6fca460f5c8bc8496df"
server_key_version: "encryptionkey@0"
I20260811 15:07:30.474371 8965 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 15:07:30.477079 8982 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:07:30.478379 8965 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 15:07:30.478536 8965 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/minicluster-data/ts-2/wal
uuid: "200e3b1b6354485bb6493d72fd554491"
format_stamp: "Formatted at 2026-08-11 15:07:30 on dist-test-slave-8n49"
server_key: "d7d14814e2b72da70869a6375d56808f"
server_key_iv: "780d61d4bd58b6fca460f5c8bc8496df"
server_key_version: "encryptionkey@0"
I20260811 15:07:30.478662 8965 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:07:30.492408 8965 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:07:30.495697 8965 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:07:30.495929 8965 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:07:30.496655 8965 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:07:30.497529 8965 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:07:30.497599 8965 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:07:30.497673 8965 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:07:30.497725 8965 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:07:30.506665 8965 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.67:35843
I20260811 15:07:30.506688 9107 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.67:35843 every 8 connection(s)
I20260811 15:07:30.507611 8965 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
I20260811 15:07:30.511718 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 8965
I20260811 15:07:30.511862 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/minicluster-data/ts-2/wal/instance
I20260811 15:07:30.512159 20401 external_mini_cluster.cc:1428] Setting key fdfb623ec89d078d22438c1d777caaa5
Aug 11 15:07:30 dist-test-slave-8n49 krb5kdc[8540](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460850, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.67@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
I20260811 15:07:30.521425 8641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:30.509663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.67:44129 (local address 127.19.236.126:46455)
0811 15:07:30.509813 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:30.509817 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:30.510653 (+ 836us) server_negotiation.cc:407] Connection header received
0811 15:07:30.512017 (+ 1364us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:30.512020 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:30.512088 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:30.512195 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:07:30.513478 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:30.514018 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:30.515228 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:30.515454 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:30.515567 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:30.518139 (+ 2572us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:07:30.518142 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:07:30.518145 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:07:30.518169 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:07:30.519608 (+ 1439us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:07:30.520051 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:07:30.520053 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:07:30.520055 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:07:30.520127 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:07:30.520418 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:07:30.520421 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:07:30.520422 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:07:30.520666 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:07:30.520746 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:30.521198 (+ 452us) server_negotiation.cc:299] Negotiation successful
0811 15:07:30.521299 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 15:07:30.522243 9111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:30.510046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:46455 (local address 127.19.236.67:44129)
0811 15:07:30.510494 (+ 448us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:30.510547 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 15:07:30.511795 (+ 1248us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:07:30.512384 (+ 589us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:07:30.512391 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:07:30.512846 (+ 455us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:07:30.513332 (+ 486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:30.513345 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:30.514155 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:30.514158 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:30.515101 (+ 943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:30.515112 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:30.515607 (+ 495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:30.515611 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:30.515781 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:30.516372 (+ 591us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:07:30.516389 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:07:30.517978 (+ 1589us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:07:30.519709 (+ 1731us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:07:30.519714 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:07:30.519725 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:07:30.519966 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:07:30.520208 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:07:30.520210 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:07:30.520211 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:07:30.520339 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:07:30.520755 (+ 416us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:07:30.520761 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:07:30.520984 (+ 223us) client_negotiation.cc:769] Sending connection context
0811 15:07:30.521151 (+ 167us) client_negotiation.cc:240] Negotiation successful
0811 15:07:30.521401 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":117,"threads_started":1}
I20260811 15:07:30.523401 9109 heartbeater.cc:347] Connected to a master server at 127.19.236.126:46455
I20260811 15:07:30.523648 9109 heartbeater.cc:464] Registering TS with master...
I20260811 15:07:30.524151 9109 heartbeater.cc:511] Master 127.19.236.126:46455 requested a full tablet report, sending...
I20260811 15:07:30.525599 8593 ts_manager.cc:194] Registered new tserver with Master: 200e3b1b6354485bb6493d72fd554491 (127.19.236.67:35843)
I20260811 15:07:30.526369 8593 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.236.67@KRBTEST.COM'} at 127.19.236.67:44129
I20260811 15:07:30.526510 20401 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 15:07:30.536612 8641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:30.528861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36254 (local address 127.19.236.126:46455)
0811 15:07:30.528994 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:30.528999 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:30.529196 (+ 197us) server_negotiation.cc:407] Connection header received
0811 15:07:30.529349 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:30.529352 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:30.529401 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:30.529483 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:07:30.530187 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:30.530700 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:30.531531 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:30.531750 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:30.531853 (+ 103us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:30.533524 (+ 1671us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:07:30.533528 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:07:30.533531 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:07:30.533556 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:07:30.534721 (+ 1165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:07:30.535237 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:07:30.535241 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:07:30.535243 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:07:30.535329 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:07:30.535663 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:07:30.535667 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:07:30.535668 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:07:30.535876 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:07:30.536043 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:30.536304 (+ 261us) server_negotiation.cc:299] Negotiation successful
0811 15:07:30.536398 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 15:07:30.539582 8593 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36254:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 15:07:30.542666 8593 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 15:07:30.561990 9121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:30.556087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.65:34411 (local address 127.0.0.1:44594)
0811 15:07:30.556607 (+ 520us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:30.556654 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 15:07:30.556801 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:07:30.557642 (+ 841us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:07:30.557649 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:07:30.557676 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:07:30.557856 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:30.557864 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:30.559265 (+ 1401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:30.559267 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:30.560414 (+ 1147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:30.560426 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:30.561452 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:30.561456 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:30.561572 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:30.561614 (+ 42us) client_negotiation.cc:769] Sending connection context
0811 15:07:30.561717 (+ 103us) client_negotiation.cc:240] Negotiation successful
0811 15:07:30.561837 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":332,"mutex_wait_us":30,"spinlock_wait_cycles":6272,"thread_start_us":94,"threads_started":1}
I20260811 15:07:30.561995 9123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:30.556238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44594 (local address 127.19.236.65:34411)
0811 15:07:30.557081 (+ 843us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:30.557102 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:30.557128 (+ 26us) server_negotiation.cc:407] Connection header received
0811 15:07:30.557212 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:30.557218 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:30.557428 (+ 210us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:30.557646 (+ 218us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:07:30.557994 (+ 348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:30.559120 (+ 1126us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:30.560589 (+ 1469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:30.561322 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:30.561441 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:30.561705 (+ 264us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:30.561761 (+ 56us) server_negotiation.cc:299] Negotiation successful
0811 15:07:30.561849 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":737,"thread_start_us":80,"threads_started":1}
I20260811 15:07:30.562355 9125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:30.556810 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.66:42961 (local address 127.0.0.1:50896)
0811 15:07:30.557042 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:30.557052 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 15:07:30.557109 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:07:30.558234 (+ 1125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:07:30.558236 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:07:30.558253 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:07:30.558323 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:30.558327 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:30.559520 (+ 1193us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:30.559524 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:30.560739 (+ 1215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:30.560749 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:30.561827 (+ 1078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:30.561834 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:30.561930 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:30.561955 (+ 25us) client_negotiation.cc:769] Sending connection context
0811 15:07:30.562004 (+ 49us) client_negotiation.cc:240] Negotiation successful
0811 15:07:30.562226 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":111,"threads_started":1}
I20260811 15:07:30.563078 9127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:30.557398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50896 (local address 127.19.236.66:42961)
0811 15:07:30.557770 (+ 372us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:30.557782 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:30.557808 (+ 26us) server_negotiation.cc:407] Connection header received
0811 15:07:30.557884 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:30.557891 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:30.558091 (+ 200us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:30.558234 (+ 143us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:07:30.558437 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:30.559376 (+ 939us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:30.560876 (+ 1500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:30.561699 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:30.562613 (+ 914us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:30.562755 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:30.562805 (+ 50us) server_negotiation.cc:299] Negotiation successful
0811 15:07:30.562928 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":283,"thread_start_us":92,"threads_started":1}
I20260811 15:07:30.563468 9124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:30.556254 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.67:35843 (local address 127.0.0.1:43908)
0811 15:07:30.556649 (+ 395us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:30.556663 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 15:07:30.556800 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:07:30.558931 (+ 2131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:07:30.558934 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:07:30.558952 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:07:30.559070 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:30.559076 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:30.560450 (+ 1374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:30.560454 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:30.561602 (+ 1148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:30.561613 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:30.563096 (+ 1483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:30.563100 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:30.563200 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:30.563223 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 15:07:30.563287 (+ 64us) client_negotiation.cc:240] Negotiation successful
0811 15:07:30.563348 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":288,"spinlock_wait_cycles":6016,"thread_start_us":99,"threads_started":1}
I20260811 15:07:30.564322 9126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:30.557298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43908 (local address 127.19.236.67:35843)
0811 15:07:30.558525 (+ 1227us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:30.558535 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:30.558556 (+ 21us) server_negotiation.cc:407] Connection header received
0811 15:07:30.558624 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:30.558628 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:30.558786 (+ 158us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:30.558922 (+ 136us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:07:30.559193 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:30.560297 (+ 1104us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:30.561767 (+ 1470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:30.562983 (+ 1216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:30.563101 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:30.564051 (+ 950us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:30.564102 (+ 51us) server_negotiation.cc:299] Negotiation successful
0811 15:07:30.564188 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1126,"thread_start_us":106,"threads_started":1}
I20260811 15:07:30.565275 8734 tablet_service.cc:1467] Processing CreateTablet for tablet 99a21f9bdf2e4077b529774d6341381f (DEFAULT_TABLE table=test-table [id=c5327bd302804a0097bcd323e68b3a18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:07:30.565790 8886 tablet_service.cc:1467] Processing CreateTablet for tablet 99a21f9bdf2e4077b529774d6341381f (DEFAULT_TABLE table=test-table [id=c5327bd302804a0097bcd323e68b3a18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:07:30.566295 8734 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 99a21f9bdf2e4077b529774d6341381f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:07:30.566757 8886 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 99a21f9bdf2e4077b529774d6341381f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:07:30.566761 9034 tablet_service.cc:1467] Processing CreateTablet for tablet 99a21f9bdf2e4077b529774d6341381f (DEFAULT_TABLE table=test-table [id=c5327bd302804a0097bcd323e68b3a18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:07:30.567682 9034 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 99a21f9bdf2e4077b529774d6341381f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:07:30.574473 9130 tablet_bootstrap.cc:492] T 99a21f9bdf2e4077b529774d6341381f P 200e3b1b6354485bb6493d72fd554491: Bootstrap starting.
I20260811 15:07:30.574473 9129 tablet_bootstrap.cc:492] T 99a21f9bdf2e4077b529774d6341381f P e7bc29de68ec4dfe99ca6113793b399b: Bootstrap starting.
I20260811 15:07:30.575423 9128 tablet_bootstrap.cc:492] T 99a21f9bdf2e4077b529774d6341381f P ca4485b9a34647fa8af4c17ec92aa30b: Bootstrap starting.
I20260811 15:07:30.576901 9129 tablet_bootstrap.cc:654] T 99a21f9bdf2e4077b529774d6341381f P e7bc29de68ec4dfe99ca6113793b399b: Neither blocks nor log segments found. Creating new log.
I20260811 15:07:30.576900 9130 tablet_bootstrap.cc:654] T 99a21f9bdf2e4077b529774d6341381f P 200e3b1b6354485bb6493d72fd554491: Neither blocks nor log segments found. Creating new log.
I20260811 15:07:30.577836 9128 tablet_bootstrap.cc:654] T 99a21f9bdf2e4077b529774d6341381f P ca4485b9a34647fa8af4c17ec92aa30b: Neither blocks nor log segments found. Creating new log.
I20260811 15:07:30.578329 9129 log.cc:824] T 99a21f9bdf2e4077b529774d6341381f P e7bc29de68ec4dfe99ca6113793b399b: Log is configured to *not* fsync() on all Append() calls
I20260811 15:07:30.578330 9130 log.cc:824] T 99a21f9bdf2e4077b529774d6341381f P 200e3b1b6354485bb6493d72fd554491: Log is configured to *not* fsync() on all Append() calls
I20260811 15:07:30.578621 9128 log.cc:824] T 99a21f9bdf2e4077b529774d6341381f P ca4485b9a34647fa8af4c17ec92aa30b: Log is configured to *not* fsync() on all Append() calls
I20260811 15:07:30.580255 9129 tablet_bootstrap.cc:492] T 99a21f9bdf2e4077b529774d6341381f P e7bc29de68ec4dfe99ca6113793b399b: No bootstrap required, opened a new log
I20260811 15:07:30.580385 9128 tablet_bootstrap.cc:492] T 99a21f9bdf2e4077b529774d6341381f P ca4485b9a34647fa8af4c17ec92aa30b: No bootstrap required, opened a new log
I20260811 15:07:30.580385 9130 tablet_bootstrap.cc:492] T 99a21f9bdf2e4077b529774d6341381f P 200e3b1b6354485bb6493d72fd554491: No bootstrap required, opened a new log
I20260811 15:07:30.580494 9129 ts_tablet_manager.cc:1397] T 99a21f9bdf2e4077b529774d6341381f P e7bc29de68ec4dfe99ca6113793b399b: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260811 15:07:30.580600 9130 ts_tablet_manager.cc:1397] T 99a21f9bdf2e4077b529774d6341381f P 200e3b1b6354485bb6493d72fd554491: Time spent bootstrapping tablet: real 0.006s user 0.006s sys 0.000s
I20260811 15:07:30.580600 9128 ts_tablet_manager.cc:1397] T 99a21f9bdf2e4077b529774d6341381f P ca4485b9a34647fa8af4c17ec92aa30b: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20260811 15:07:30.583992 9129 raft_consensus.cc:348] T 99a21f9bdf2e4077b529774d6341381f P e7bc29de68ec4dfe99ca6113793b399b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca4485b9a34647fa8af4c17ec92aa30b" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 34411 } } peers { permanent_uuid: "200e3b1b6354485bb6493d72fd554491" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 35843 } } peers { permanent_uuid: "e7bc29de68ec4dfe99ca6113793b399b" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 42961 } }
I20260811 15:07:30.584251 9129 raft_consensus.cc:374] T 99a21f9bdf2e4077b529774d6341381f P e7bc29de68ec4dfe99ca6113793b399b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:07:30.584306 9129 raft_consensus.cc:729] T 99a21f9bdf2e4077b529774d6341381f P e7bc29de68ec4dfe99ca6113793b399b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7bc29de68ec4dfe99ca6113793b399b, State: Initialized, Role: FOLLOWER
I20260811 15:07:30.584615 9130 raft_consensus.cc:348] T 99a21f9bdf2e4077b529774d6341381f P 200e3b1b6354485bb6493d72fd554491 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca4485b9a34647fa8af4c17ec92aa30b" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 34411 } } peers { permanent_uuid: "200e3b1b6354485bb6493d72fd554491" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 35843 } } peers { permanent_uuid: "e7bc29de68ec4dfe99ca6113793b399b" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 42961 } }
I20260811 15:07:30.584771 9129 consensus_queue.cc:260] T 99a21f9bdf2e4077b529774d6341381f P e7bc29de68ec4dfe99ca6113793b399b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca4485b9a34647fa8af4c17ec92aa30b" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 34411 } } peers { permanent_uuid: "200e3b1b6354485bb6493d72fd554491" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 35843 } } peers { permanent_uuid: "e7bc29de68ec4dfe99ca6113793b399b" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 42961 } }
I20260811 15:07:30.584854 9130 raft_consensus.cc:374] T 99a21f9bdf2e4077b529774d6341381f P 200e3b1b6354485bb6493d72fd554491 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:07:30.584914 9130 raft_consensus.cc:729] T 99a21f9bdf2e4077b529774d6341381f P 200e3b1b6354485bb6493d72fd554491 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 200e3b1b6354485bb6493d72fd554491, State: Initialized, Role: FOLLOWER
I20260811 15:07:30.584880 9128 raft_consensus.cc:348] T 99a21f9bdf2e4077b529774d6341381f P ca4485b9a34647fa8af4c17ec92aa30b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca4485b9a34647fa8af4c17ec92aa30b" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 34411 } } peers { permanent_uuid: "200e3b1b6354485bb6493d72fd554491" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 35843 } } peers { permanent_uuid: "e7bc29de68ec4dfe99ca6113793b399b" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 42961 } }
I20260811 15:07:30.585112 9128 raft_consensus.cc:374] T 99a21f9bdf2e4077b529774d6341381f P ca4485b9a34647fa8af4c17ec92aa30b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:07:30.585175 9128 raft_consensus.cc:729] T 99a21f9bdf2e4077b529774d6341381f P ca4485b9a34647fa8af4c17ec92aa30b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca4485b9a34647fa8af4c17ec92aa30b, State: Initialized, Role: FOLLOWER
I20260811 15:07:30.585384 9130 consensus_queue.cc:260] T 99a21f9bdf2e4077b529774d6341381f P 200e3b1b6354485bb6493d72fd554491 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca4485b9a34647fa8af4c17ec92aa30b" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 34411 } } peers { permanent_uuid: "200e3b1b6354485bb6493d72fd554491" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 35843 } } peers { permanent_uuid: "e7bc29de68ec4dfe99ca6113793b399b" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 42961 } }
I20260811 15:07:30.585542 9128 consensus_queue.cc:260] T 99a21f9bdf2e4077b529774d6341381f P ca4485b9a34647fa8af4c17ec92aa30b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca4485b9a34647fa8af4c17ec92aa30b" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 34411 } } peers { permanent_uuid: "200e3b1b6354485bb6493d72fd554491" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 35843 } } peers { permanent_uuid: "e7bc29de68ec4dfe99ca6113793b399b" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 42961 } }
I20260811 15:07:30.585929 9129 ts_tablet_manager.cc:1428] T 99a21f9bdf2e4077b529774d6341381f P e7bc29de68ec4dfe99ca6113793b399b: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260811 15:07:30.586112 9109 heartbeater.cc:503] Master 127.19.236.126:46455 was elected leader, sending a full tablet report...
I20260811 15:07:30.586287 8960 heartbeater.cc:503] Master 127.19.236.126:46455 was elected leader, sending a full tablet report...
I20260811 15:07:30.586382 9128 ts_tablet_manager.cc:1428] T 99a21f9bdf2e4077b529774d6341381f P ca4485b9a34647fa8af4c17ec92aa30b: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260811 15:07:30.587126 8809 heartbeater.cc:503] Master 127.19.236.126:46455 was elected leader, sending a full tablet report...
I20260811 15:07:30.588270 9130 ts_tablet_manager.cc:1428] T 99a21f9bdf2e4077b529774d6341381f P 200e3b1b6354485bb6493d72fd554491: Time spent starting tablet: real 0.008s user 0.005s sys 0.000s
I20260811 15:07:30.743618 9137 raft_consensus.cc:482] T 99a21f9bdf2e4077b529774d6341381f P ca4485b9a34647fa8af4c17ec92aa30b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 15:07:30.743855 9137 raft_consensus.cc:504] T 99a21f9bdf2e4077b529774d6341381f P ca4485b9a34647fa8af4c17ec92aa30b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca4485b9a34647fa8af4c17ec92aa30b" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 34411 } } peers { permanent_uuid: "200e3b1b6354485bb6493d72fd554491" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 35843 } } peers { permanent_uuid: "e7bc29de68ec4dfe99ca6113793b399b" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 42961 } }
I20260811 15:07:30.745018 9137 leader_election.cc:288] T 99a21f9bdf2e4077b529774d6341381f P ca4485b9a34647fa8af4c17ec92aa30b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 200e3b1b6354485bb6493d72fd554491 (127.19.236.67:35843), e7bc29de68ec4dfe99ca6113793b399b (127.19.236.66:42961)
I20260811 15:07:30.750028 9126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:30.745423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.65:53439 (local address 127.19.236.67:35843)
0811 15:07:30.745577 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:30.745581 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:30.745826 (+ 245us) server_negotiation.cc:407] Connection header received
0811 15:07:30.746028 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:30.746035 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:30.746102 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:30.746150 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:07:30.746589 (+ 439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:30.747144 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:30.748686 (+ 1542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:30.749270 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:30.749384 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:30.749451 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:30.749812 (+ 361us) server_negotiation.cc:299] Negotiation successful
0811 15:07:30.749897 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 15:07:30.750489 9138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:30.745361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.67:35843 (local address 127.19.236.65:53439)
0811 15:07:30.745716 (+ 355us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:30.745735 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 15:07:30.745861 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:07:30.746294 (+ 433us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:07:30.746296 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:07:30.746313 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:07:30.746437 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:30.746441 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:30.747258 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:30.747261 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:30.748530 (+ 1269us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:30.748540 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:30.749533 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:30.749537 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:30.749637 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:30.749676 (+ 39us) client_negotiation.cc:769] Sending connection context
0811 15:07:30.750220 (+ 544us) client_negotiation.cc:240] Negotiation successful
0811 15:07:30.750302 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":269,"mutex_wait_us":4,"thread_start_us":148,"threads_started":1}
I20260811 15:07:30.751075 9140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:30.745814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.66:42961 (local address 127.19.236.65:54251)
0811 15:07:30.746111 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:30.746126 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 15:07:30.746276 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:07:30.747301 (+ 1025us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:07:30.747305 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:07:30.747327 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:07:30.747457 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:30.747464 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:30.748491 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:30.748495 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:30.749662 (+ 1167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:30.749673 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:30.750681 (+ 1008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:30.750684 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:30.750784 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:30.750803 (+ 19us) client_negotiation.cc:769] Sending connection context
0811 15:07:30.750874 (+ 71us) client_negotiation.cc:240] Negotiation successful
0811 15:07:30.750940 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":98,"threads_started":1}
I20260811 15:07:30.751088 9127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:30.745986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.65:54251 (local address 127.19.236.66:42961)
0811 15:07:30.746111 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:30.746118 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:30.746228 (+ 110us) server_negotiation.cc:407] Connection header received
0811 15:07:30.746397 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:30.746400 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:30.746472 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:30.746572 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:07:30.747604 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:30.748347 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:30.749820 (+ 1473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:30.750434 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:30.750540 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:30.750587 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:30.750917 (+ 330us) server_negotiation.cc:299] Negotiation successful
0811 15:07:30.750990 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 15:07:30.751703 8908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99a21f9bdf2e4077b529774d6341381f" candidate_uuid: "ca4485b9a34647fa8af4c17ec92aa30b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7bc29de68ec4dfe99ca6113793b399b" is_pre_election: true
I20260811 15:07:30.751724 9055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99a21f9bdf2e4077b529774d6341381f" candidate_uuid: "ca4485b9a34647fa8af4c17ec92aa30b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "200e3b1b6354485bb6493d72fd554491" is_pre_election: true
I20260811 15:07:30.752044 8908 raft_consensus.cc:2454] T 99a21f9bdf2e4077b529774d6341381f P e7bc29de68ec4dfe99ca6113793b399b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca4485b9a34647fa8af4c17ec92aa30b in term 0.
I20260811 15:07:30.752063 9055 raft_consensus.cc:2454] T 99a21f9bdf2e4077b529774d6341381f P 200e3b1b6354485bb6493d72fd554491 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca4485b9a34647fa8af4c17ec92aa30b in term 0.
I20260811 15:07:30.752596 8685 leader_election.cc:302] T 99a21f9bdf2e4077b529774d6341381f P ca4485b9a34647fa8af4c17ec92aa30b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ca4485b9a34647fa8af4c17ec92aa30b, e7bc29de68ec4dfe99ca6113793b399b; no voters:
I20260811 15:07:30.752933 9137 raft_consensus.cc:2781] T 99a21f9bdf2e4077b529774d6341381f P ca4485b9a34647fa8af4c17ec92aa30b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 15:07:30.753034 9137 raft_consensus.cc:482] T 99a21f9bdf2e4077b529774d6341381f P ca4485b9a34647fa8af4c17ec92aa30b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 15:07:30.753090 9137 raft_consensus.cc:3037] T 99a21f9bdf2e4077b529774d6341381f P ca4485b9a34647fa8af4c17ec92aa30b [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:07:30.754550 9137 raft_consensus.cc:504] T 99a21f9bdf2e4077b529774d6341381f P ca4485b9a34647fa8af4c17ec92aa30b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca4485b9a34647fa8af4c17ec92aa30b" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 34411 } } peers { permanent_uuid: "200e3b1b6354485bb6493d72fd554491" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 35843 } } peers { permanent_uuid: "e7bc29de68ec4dfe99ca6113793b399b" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 42961 } }
I20260811 15:07:30.754905 9137 leader_election.cc:288] T 99a21f9bdf2e4077b529774d6341381f P ca4485b9a34647fa8af4c17ec92aa30b [CANDIDATE]: Term 1 election: Requested vote from peers 200e3b1b6354485bb6493d72fd554491 (127.19.236.67:35843), e7bc29de68ec4dfe99ca6113793b399b (127.19.236.66:42961)
I20260811 15:07:30.755280 9055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99a21f9bdf2e4077b529774d6341381f" candidate_uuid: "ca4485b9a34647fa8af4c17ec92aa30b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "200e3b1b6354485bb6493d72fd554491"
I20260811 15:07:30.755383 8908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "99a21f9bdf2e4077b529774d6341381f" candidate_uuid: "ca4485b9a34647fa8af4c17ec92aa30b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7bc29de68ec4dfe99ca6113793b399b"
I20260811 15:07:30.755439 9055 raft_consensus.cc:3037] T 99a21f9bdf2e4077b529774d6341381f P 200e3b1b6354485bb6493d72fd554491 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:07:30.755507 8908 raft_consensus.cc:3037] T 99a21f9bdf2e4077b529774d6341381f P e7bc29de68ec4dfe99ca6113793b399b [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:07:30.756536 9055 raft_consensus.cc:2454] T 99a21f9bdf2e4077b529774d6341381f P 200e3b1b6354485bb6493d72fd554491 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca4485b9a34647fa8af4c17ec92aa30b in term 1.
I20260811 15:07:30.756744 8908 raft_consensus.cc:2454] T 99a21f9bdf2e4077b529774d6341381f P e7bc29de68ec4dfe99ca6113793b399b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca4485b9a34647fa8af4c17ec92aa30b in term 1.
I20260811 15:07:30.756982 8685 leader_election.cc:302] T 99a21f9bdf2e4077b529774d6341381f P ca4485b9a34647fa8af4c17ec92aa30b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 200e3b1b6354485bb6493d72fd554491, ca4485b9a34647fa8af4c17ec92aa30b; no voters:
I20260811 15:07:30.757184 9137 raft_consensus.cc:2781] T 99a21f9bdf2e4077b529774d6341381f P ca4485b9a34647fa8af4c17ec92aa30b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:07:30.757401 9137 raft_consensus.cc:686] T 99a21f9bdf2e4077b529774d6341381f P ca4485b9a34647fa8af4c17ec92aa30b [term 1 LEADER]: Becoming Leader. State: Replica: ca4485b9a34647fa8af4c17ec92aa30b, State: Running, Role: LEADER
I20260811 15:07:30.757776 9137 consensus_queue.cc:237] T 99a21f9bdf2e4077b529774d6341381f P ca4485b9a34647fa8af4c17ec92aa30b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca4485b9a34647fa8af4c17ec92aa30b" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 34411 } } peers { permanent_uuid: "200e3b1b6354485bb6493d72fd554491" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 35843 } } peers { permanent_uuid: "e7bc29de68ec4dfe99ca6113793b399b" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 42961 } }
W20260811 15:07:30.758580 9110 tablet.cc:2369] T 99a21f9bdf2e4077b529774d6341381f P 200e3b1b6354485bb6493d72fd554491: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 15:07:30.761765 8593 catalog_manager.cc:5495] T 99a21f9bdf2e4077b529774d6341381f P ca4485b9a34647fa8af4c17ec92aa30b reported cstate change: term changed from 0 to 1, leader changed from <none> to ca4485b9a34647fa8af4c17ec92aa30b (127.19.236.65). New cstate: current_term: 1 leader_uuid: "ca4485b9a34647fa8af4c17ec92aa30b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca4485b9a34647fa8af4c17ec92aa30b" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 34411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "200e3b1b6354485bb6493d72fd554491" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 35843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e7bc29de68ec4dfe99ca6113793b399b" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 42961 } health_report { overall_health: UNKNOWN } } }
W20260811 15:07:30.788805 8961 tablet.cc:2369] T 99a21f9bdf2e4077b529774d6341381f P e7bc29de68ec4dfe99ca6113793b399b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 15:07:30.804207 9123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:30.800777 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44608 (local address 127.19.236.65:34411)
0811 15:07:30.800924 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:30.800928 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:30.800942 (+ 14us) server_negotiation.cc:407] Connection header received
0811 15:07:30.801022 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:30.801024 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:30.801081 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:30.801175 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 15:07:30.801408 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:30.801909 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:30.802751 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:30.802969 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:30.803044 (+ 75us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:30.803325 (+ 281us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 15:07:30.803824 (+ 499us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 15:07:30.803937 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:30.804054 (+ 117us) server_negotiation.cc:299] Negotiation successful
0811 15:07:30.804093 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 15:07:30.810359 8908 raft_consensus.cc:1261] T 99a21f9bdf2e4077b529774d6341381f P e7bc29de68ec4dfe99ca6113793b399b [term 1 FOLLOWER]: Refusing update from remote peer ca4485b9a34647fa8af4c17ec92aa30b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:07:30.810359 9055 raft_consensus.cc:1261] T 99a21f9bdf2e4077b529774d6341381f P 200e3b1b6354485bb6493d72fd554491 [term 1 FOLLOWER]: Refusing update from remote peer ca4485b9a34647fa8af4c17ec92aa30b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:07:30.811117 9141 consensus_queue.cc:1035] T 99a21f9bdf2e4077b529774d6341381f P ca4485b9a34647fa8af4c17ec92aa30b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7bc29de68ec4dfe99ca6113793b399b" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 42961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:07:30.811319 9137 consensus_queue.cc:1035] T 99a21f9bdf2e4077b529774d6341381f P ca4485b9a34647fa8af4c17ec92aa30b [LEADER]: Connected to new peer: Peer: permanent_uuid: "200e3b1b6354485bb6493d72fd554491" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 35843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 15:07:30.811898 8810 tablet.cc:2369] T 99a21f9bdf2e4077b529774d6341381f P ca4485b9a34647fa8af4c17ec92aa30b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 15:07:30.819777 9147 mvcc.cc:205] Tried to move back new op lower bound from 7317343644910956544 to 7317343644706676736. Current Snapshot: MvccSnapshot[applied={T|T < 7317343644910956544}]
I20260811 15:07:30.821738 9146 mvcc.cc:205] Tried to move back new op lower bound from 7317343644910956544 to 7317343644706676736. Current Snapshot: MvccSnapshot[applied={T|T < 7317343644910956544}]
I20260811 15:07:30.829200 8593 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36254:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 15:07:30.829404 8593 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36254:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 15:07:30.831965 8593 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bec865480dff41e1912963d1686bc63a: Sending DeleteTablet for 3 replicas of tablet 99a21f9bdf2e4077b529774d6341381f
I20260811 15:07:30.832795 8734 tablet_service.cc:1514] Processing DeleteTablet for tablet 99a21f9bdf2e4077b529774d6341381f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:07:30 UTC) from {username='kudu', principal='kudu/127.19.236.126@KRBTEST.COM'} at 127.0.0.1:44594
I20260811 15:07:30.832882 8886 tablet_service.cc:1514] Processing DeleteTablet for tablet 99a21f9bdf2e4077b529774d6341381f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:07:30 UTC) from {username='kudu', principal='kudu/127.19.236.126@KRBTEST.COM'} at 127.0.0.1:50896
I20260811 15:07:30.833374 9155 tablet_replica.cc:330] T 99a21f9bdf2e4077b529774d6341381f P ca4485b9a34647fa8af4c17ec92aa30b: stopping tablet replica
I20260811 15:07:30.833416 9034 tablet_service.cc:1514] Processing DeleteTablet for tablet 99a21f9bdf2e4077b529774d6341381f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:07:30 UTC) from {username='kudu', principal='kudu/127.19.236.126@KRBTEST.COM'} at 127.0.0.1:43908
I20260811 15:07:30.833739 9155 raft_consensus.cc:2229] T 99a21f9bdf2e4077b529774d6341381f P ca4485b9a34647fa8af4c17ec92aa30b [term 1 LEADER]: Raft consensus shutting down.
I20260811 15:07:30.834115 9157 tablet_replica.cc:330] T 99a21f9bdf2e4077b529774d6341381f P 200e3b1b6354485bb6493d72fd554491: stopping tablet replica
I20260811 15:07:30.834210 9155 raft_consensus.cc:2258] T 99a21f9bdf2e4077b529774d6341381f P ca4485b9a34647fa8af4c17ec92aa30b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:07:30.834405 9157 raft_consensus.cc:2229] T 99a21f9bdf2e4077b529774d6341381f P 200e3b1b6354485bb6493d72fd554491 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 15:07:30.834621 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 8667
I20260811 15:07:30.834722 9157 raft_consensus.cc:2258] T 99a21f9bdf2e4077b529774d6341381f P 200e3b1b6354485bb6493d72fd554491 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:07:30.837020 9156 tablet_replica.cc:330] T 99a21f9bdf2e4077b529774d6341381f P e7bc29de68ec4dfe99ca6113793b399b: stopping tablet replica
I20260811 15:07:30.837342 9156 raft_consensus.cc:2229] T 99a21f9bdf2e4077b529774d6341381f P e7bc29de68ec4dfe99ca6113793b399b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 15:07:30.837666 9156 raft_consensus.cc:2258] T 99a21f9bdf2e4077b529774d6341381f P e7bc29de68ec4dfe99ca6113793b399b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:07:30.838510 9157 ts_tablet_manager.cc:1905] T 99a21f9bdf2e4077b529774d6341381f P 200e3b1b6354485bb6493d72fd554491: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 15:07:30.840986 9157 ts_tablet_manager.cc:1918] T 99a21f9bdf2e4077b529774d6341381f P 200e3b1b6354485bb6493d72fd554491: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 15:07:30.841118 9157 log.cc:1196] T 99a21f9bdf2e4077b529774d6341381f P 200e3b1b6354485bb6493d72fd554491: Deleting WAL directory at /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786460596631409-20401-0/minicluster-data/ts-2/wal/wals/99a21f9bdf2e4077b529774d6341381f
I20260811 15:07:30.841480 9157 ts_tablet_manager.cc:1939] T 99a21f9bdf2e4077b529774d6341381f P 200e3b1b6354485bb6493d72fd554491: Deleting consensus metadata
I20260811 15:07:30.842587 9156 ts_tablet_manager.cc:1905] T 99a21f9bdf2e4077b529774d6341381f P e7bc29de68ec4dfe99ca6113793b399b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 15:07:30.842727 8577 catalog_manager.cc:4841] TS 200e3b1b6354485bb6493d72fd554491 (127.19.236.67:35843): tablet 99a21f9bdf2e4077b529774d6341381f (table test-table [id=c5327bd302804a0097bcd323e68b3a18]) successfully deleted
W20260811 15:07:30.844328 8579 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.19.236.65:34411 (error 108)
I20260811 15:07:30.845333 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 8814
I20260811 15:07:30.845502 9124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:30.845164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.65:34411 (local address 127.0.0.1:44620)
0811 15:07:30.845304 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:30.845376 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.65:34411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260811 15:07:30.846927 8579 catalog_manager.cc:4584] TS ca4485b9a34647fa8af4c17ec92aa30b (127.19.236.65:34411): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 99a21f9bdf2e4077b529774d6341381f: Network error: Client connection negotiation failed: client connection to 127.19.236.65:34411: connect: Connection refused (error 111)
I20260811 15:07:30.854354 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 8965
I20260811 15:07:30.857247 9124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:30.854592 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.66:42961 (local address 127.0.0.1:50904)
0811 15:07:30.857022 (+ 2430us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:30.857117 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.66:42961: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2299}
I20260811 15:07:30.864501 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 8556
2026-08-11T15:07:30Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2555 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-11T15:07:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T15:07:30Z Disabled control of system clock
I20260811 15:07:30.898171 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460596631409-20401-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460596631409-20401-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460596631409-20401-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:41083
--webserver_interface=127.19.236.126
--webserver_port=0
--builtin_ntp_servers=127.19.236.84:42097
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.236.126:41083
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 15:07:31.013115 9162 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:07:31.013466 9162 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:07:31.013509 9162 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:07:31.017625 9162 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:07:31.017686 9162 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:07:31.017702 9162 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:07:31.017720 9162 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:07:31.017736 9162 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:07:31.022698 9162 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:42097
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460596631409-20401-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460596631409-20401-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.236.126:41083
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:41083
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.236.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9162
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460596631409-20401-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:07:31.023950 9162 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:07:31.025458 9162 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:07:31.034324 9168 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:07:31.034392 9162 server_base.cc:1034] running on GCE node
W20260811 15:07:31.034305 9171 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:07:31.034332 9167 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:07:31.035130 9162 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:07:31.036314 9162 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:07:31.037480 9162 hybrid_clock.cc:648] HybridClock initialized: now 1786460851037451 us; error 43 us; skew 500 ppm
I20260811 15:07:31.039403 9162 webserver.cc:460] Webserver started at http://127.19.236.126:37349/ using document root <none> and password file <none>
I20260811 15:07:31.040014 9162 fs_manager.cc:359] Metadata directory not provided
I20260811 15:07:31.040081 9162 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:07:31.040310 9162 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:07:31.042552 9162 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460596631409-20401-0/minicluster-data/master-0/data/instance:
uuid: "f06c2ede550e439da741a584a0f7a200"
format_stamp: "Formatted at 2026-08-11 15:07:31 on dist-test-slave-8n49"
server_key: "1d63614c17106e7fb4ef00451fbed79b"
server_key_iv: "f650e52adc40a8087221ebd52d3cec9a"
server_key_version: "encryptionkey@0"
I20260811 15:07:31.043167 9162 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460596631409-20401-0/minicluster-data/master-0/wal/instance:
uuid: "f06c2ede550e439da741a584a0f7a200"
format_stamp: "Formatted at 2026-08-11 15:07:31 on dist-test-slave-8n49"
server_key: "1d63614c17106e7fb4ef00451fbed79b"
server_key_iv: "f650e52adc40a8087221ebd52d3cec9a"
server_key_version: "encryptionkey@0"
I20260811 15:07:31.046993 9162 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260811 15:07:31.049479 9179 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:07:31.050665 9162 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 15:07:31.050832 9162 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460596631409-20401-0/minicluster-data/master-0/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460596631409-20401-0/minicluster-data/master-0/wal
uuid: "f06c2ede550e439da741a584a0f7a200"
format_stamp: "Formatted at 2026-08-11 15:07:31 on dist-test-slave-8n49"
server_key: "1d63614c17106e7fb4ef00451fbed79b"
server_key_iv: "f650e52adc40a8087221ebd52d3cec9a"
server_key_version: "encryptionkey@0"
I20260811 15:07:31.051008 9162 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460596631409-20401-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460596631409-20401-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460596631409-20401-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:07:31.068238 9162 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:07:31.069058 9162 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:07:31.069273 9162 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:07:31.076529 9162 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.126:41083
I20260811 15:07:31.076573 9234 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.126:41083 every 8 connection(s)
I20260811 15:07:31.077538 9162 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
I20260811 15:07:31.080668 9235 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:07:31.084684 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 9162
I20260811 15:07:31.084821 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460596631409-20401-0/minicluster-data/master-0/wal/instance
I20260811 15:07:31.085148 20401 external_mini_cluster.cc:1428] Setting key 37494b663d3a44559ec52a6f3594fdb1
I20260811 15:07:31.086755 9235 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f06c2ede550e439da741a584a0f7a200: Bootstrap starting.
I20260811 15:07:31.089140 9235 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f06c2ede550e439da741a584a0f7a200: Neither blocks nor log segments found. Creating new log.
I20260811 15:07:31.089901 9235 log.cc:824] T 00000000000000000000000000000000 P f06c2ede550e439da741a584a0f7a200: Log is configured to *not* fsync() on all Append() calls
I20260811 15:07:31.091768 9235 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f06c2ede550e439da741a584a0f7a200: No bootstrap required, opened a new log
I20260811 15:07:31.094695 9239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:31.086612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37138 (local address 127.19.236.126:41083)
0811 15:07:31.087286 (+ 674us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:31.087313 (+ 27us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:31.087349 (+ 36us) server_negotiation.cc:407] Connection header received
0811 15:07:31.087989 (+ 640us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:31.088004 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:31.088408 (+ 404us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:31.088780 (+ 372us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:07:31.089294 (+ 514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:31.090399 (+ 1105us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:31.091303 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:31.091784 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:31.091982 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:31.092960 (+ 978us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:07:31.092966 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:07:31.092979 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:07:31.093362 (+ 383us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:07:31.093422 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:07:31.093447 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:07:31.093528 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:31.093694 (+ 166us) server_negotiation.cc:299] Negotiation successful
0811 15:07:31.093991 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":325,"thread_start_us":127,"threads_started":1}
I20260811 15:07:31.095799 9235 raft_consensus.cc:348] T 00000000000000000000000000000000 P f06c2ede550e439da741a584a0f7a200 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f06c2ede550e439da741a584a0f7a200" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 41083 } }
I20260811 15:07:31.096072 9235 raft_consensus.cc:374] T 00000000000000000000000000000000 P f06c2ede550e439da741a584a0f7a200 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:07:31.096124 9235 raft_consensus.cc:729] T 00000000000000000000000000000000 P f06c2ede550e439da741a584a0f7a200 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f06c2ede550e439da741a584a0f7a200, State: Initialized, Role: FOLLOWER
I20260811 15:07:31.096604 9235 consensus_queue.cc:260] T 00000000000000000000000000000000 P f06c2ede550e439da741a584a0f7a200 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f06c2ede550e439da741a584a0f7a200" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 41083 } }
I20260811 15:07:31.096760 9235 raft_consensus.cc:388] T 00000000000000000000000000000000 P f06c2ede550e439da741a584a0f7a200 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 15:07:31.096839 9235 raft_consensus.cc:482] T 00000000000000000000000000000000 P f06c2ede550e439da741a584a0f7a200 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 15:07:31.096957 9235 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f06c2ede550e439da741a584a0f7a200 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:07:31.097857 9235 raft_consensus.cc:504] T 00000000000000000000000000000000 P f06c2ede550e439da741a584a0f7a200 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f06c2ede550e439da741a584a0f7a200" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 41083 } }
I20260811 15:07:31.098143 9235 leader_election.cc:302] T 00000000000000000000000000000000 P f06c2ede550e439da741a584a0f7a200 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f06c2ede550e439da741a584a0f7a200; no voters:
I20260811 15:07:31.098389 9235 leader_election.cc:288] T 00000000000000000000000000000000 P f06c2ede550e439da741a584a0f7a200 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 15:07:31.098589 9241 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f06c2ede550e439da741a584a0f7a200 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:07:31.098832 9241 raft_consensus.cc:686] T 00000000000000000000000000000000 P f06c2ede550e439da741a584a0f7a200 [term 1 LEADER]: Becoming Leader. State: Replica: f06c2ede550e439da741a584a0f7a200, State: Running, Role: LEADER
I20260811 15:07:31.099134 9241 consensus_queue.cc:237] T 00000000000000000000000000000000 P f06c2ede550e439da741a584a0f7a200 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f06c2ede550e439da741a584a0f7a200" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 41083 } }
I20260811 15:07:31.099689 9235 sys_catalog.cc:564] T 00000000000000000000000000000000 P f06c2ede550e439da741a584a0f7a200 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:07:31.100795 9243 sys_catalog.cc:455] T 00000000000000000000000000000000 P f06c2ede550e439da741a584a0f7a200 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f06c2ede550e439da741a584a0f7a200. Latest consensus state: current_term: 1 leader_uuid: "f06c2ede550e439da741a584a0f7a200" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f06c2ede550e439da741a584a0f7a200" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 41083 } } }
I20260811 15:07:31.100944 9243 sys_catalog.cc:458] T 00000000000000000000000000000000 P f06c2ede550e439da741a584a0f7a200 [sys.catalog]: This master's current role is: LEADER
I20260811 15:07:31.101261 9242 sys_catalog.cc:455] T 00000000000000000000000000000000 P f06c2ede550e439da741a584a0f7a200 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f06c2ede550e439da741a584a0f7a200" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f06c2ede550e439da741a584a0f7a200" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 41083 } } }
I20260811 15:07:31.101356 9242 sys_catalog.cc:458] T 00000000000000000000000000000000 P f06c2ede550e439da741a584a0f7a200 [sys.catalog]: This master's current role is: LEADER
I20260811 15:07:31.101413 9250 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:07:31.104218 9250 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:07:31.109468 9250 catalog_manager.cc:1347] Generated new cluster ID: 02cada75bc0b4882b8eabd5e4370cc7c
I20260811 15:07:31.109542 9250 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:07:31.127868 9250 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 15:07:31.129168 9250 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:07:31.141803 9250 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f06c2ede550e439da741a584a0f7a200: Generated new TSK 0
I20260811 15:07:31.142639 9250 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 15:07:31.146193 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460596631409-20401-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460596631409-20401-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460596631409-20401-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.65:0
--local_ip_for_outbound_sockets=127.19.236.65
--webserver_interface=127.19.236.65
--webserver_port=0
--tserver_master_addrs=127.19.236.126:41083
--builtin_ntp_servers=127.19.236.84:42097
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 15:07:31.262684 9263 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:07:31.262989 9263 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:07:31.263067 9263 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:07:31.267156 9263 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:07:31.267242 9263 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:07:31.267334 9263 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.65
I20260811 15:07:31.272113 9263 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:42097
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460596631409-20401-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460596631409-20401-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.236.65
--webserver_port=0
--tserver_master_addrs=127.19.236.126:41083
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9263
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.65
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460596631409-20401-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:07:31.273394 9263 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:07:31.274827 9263 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:07:31.284785 9268 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:07:31.284785 9269 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:07:31.284874 9263 server_base.cc:1034] running on GCE node
W20260811 15:07:31.285118 9271 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:07:31.285611 9263 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:07:31.286502 9263 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:07:31.287696 9263 hybrid_clock.cc:648] HybridClock initialized: now 1786460851287663 us; error 46 us; skew 500 ppm
I20260811 15:07:31.289705 9263 webserver.cc:460] Webserver started at http://127.19.236.65:43835/ using document root <none> and password file <none>
I20260811 15:07:31.290254 9263 fs_manager.cc:359] Metadata directory not provided
I20260811 15:07:31.290314 9263 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:07:31.290480 9263 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:07:31.292529 9263 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460596631409-20401-0/minicluster-data/ts-0/data/instance:
uuid: "3843695880ff4d9a8d492564db9e75be"
format_stamp: "Formatted at 2026-08-11 15:07:31 on dist-test-slave-8n49"
server_key: "1a520021a96ad81fb051447ef96fe058"
server_key_iv: "9d6148f0f2470bedff87dc94823bb11a"
server_key_version: "encryptionkey@0"
I20260811 15:07:31.293215 9263 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460596631409-20401-0/minicluster-data/ts-0/wal/instance:
uuid: "3843695880ff4d9a8d492564db9e75be"
format_stamp: "Formatted at 2026-08-11 15:07:31 on dist-test-slave-8n49"
server_key: "1a520021a96ad81fb051447ef96fe058"
server_key_iv: "9d6148f0f2470bedff87dc94823bb11a"
server_key_version: "encryptionkey@0"
I20260811 15:07:31.296904 9263 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.003s
I20260811 15:07:31.299300 9278 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:07:31.300670 9263 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 15:07:31.300798 9263 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460596631409-20401-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460596631409-20401-0/minicluster-data/ts-0/wal
uuid: "3843695880ff4d9a8d492564db9e75be"
format_stamp: "Formatted at 2026-08-11 15:07:31 on dist-test-slave-8n49"
server_key: "1a520021a96ad81fb051447ef96fe058"
server_key_iv: "9d6148f0f2470bedff87dc94823bb11a"
server_key_version: "encryptionkey@0"
I20260811 15:07:31.300909 9263 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460596631409-20401-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460596631409-20401-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460596631409-20401-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:07:31.325117 9263 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:07:31.325899 9263 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:07:31.326118 9263 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:07:31.326761 9263 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:07:31.327754 9263 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:07:31.327804 9263 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:07:31.327876 9263 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:07:31.327909 9263 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:07:31.337253 9263 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.65:45257
I20260811 15:07:31.337294 9402 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.65:45257 every 8 connection(s)
I20260811 15:07:31.338192 9263 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
I20260811 15:07:31.343973 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 9263
I20260811 15:07:31.344089 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460596631409-20401-0/minicluster-data/ts-0/wal/instance
I20260811 15:07:31.344421 20401 external_mini_cluster.cc:1428] Setting key 30782a0b8340f2359a7b6e54d345ca72
I20260811 15:07:31.346530 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460596631409-20401-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460596631409-20401-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460596631409-20401-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.66:0
--local_ip_for_outbound_sockets=127.19.236.66
--webserver_interface=127.19.236.66
--webserver_port=0
--tserver_master_addrs=127.19.236.126:41083
--builtin_ntp_servers=127.19.236.84:42097
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 15:07:31.347929 9239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:31.340039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.65:44203 (local address 127.19.236.126:41083)
0811 15:07:31.340193 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:31.340197 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:31.341208 (+ 1011us) server_negotiation.cc:407] Connection header received
0811 15:07:31.342660 (+ 1452us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:31.342664 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:31.342729 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:31.342840 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:07:31.343772 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:31.344474 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:31.345684 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:31.345974 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:31.346092 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:31.347335 (+ 1243us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:07:31.347342 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:07:31.347349 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:07:31.347368 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:07:31.347394 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:07:31.347407 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:07:31.347489 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:31.347637 (+ 148us) server_negotiation.cc:299] Negotiation successful
0811 15:07:31.347710 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 15:07:31.348754 9405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:31.340377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:41083 (local address 127.19.236.65:44203)
0811 15:07:31.341050 (+ 673us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:31.341094 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 15:07:31.342429 (+ 1335us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:07:31.343019 (+ 590us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:07:31.343026 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:07:31.343113 (+ 87us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:07:31.343600 (+ 487us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:31.343612 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:31.344651 (+ 1039us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:31.344654 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:31.345537 (+ 883us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:31.345547 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:31.346141 (+ 594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:31.346146 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:31.346357 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:31.347065 (+ 708us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 15:07:31.347067 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:07:31.347106 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 15:07:31.347172 (+ 66us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:07:31.347497 (+ 325us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:07:31.347503 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:07:31.347508 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 15:07:31.347604 (+ 96us) client_negotiation.cc:240] Negotiation successful
0811 15:07:31.347829 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":293,"thread_start_us":146,"threads_started":1}
I20260811 15:07:31.350046 9403 heartbeater.cc:347] Connected to a master server at 127.19.236.126:41083
I20260811 15:07:31.350317 9403 heartbeater.cc:464] Registering TS with master...
I20260811 15:07:31.350852 9403 heartbeater.cc:511] Master 127.19.236.126:41083 requested a full tablet report, sending...
I20260811 15:07:31.352512 9196 ts_manager.cc:194] Registered new tserver with Master: 3843695880ff4d9a8d492564db9e75be (127.19.236.65:45257)
I20260811 15:07:31.353744 9196 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.19.236.65:44203
W20260811 15:07:31.465413 9407 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:07:31.465751 9407 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:07:31.465826 9407 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:07:31.469987 9407 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:07:31.470088 9407 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:07:31.470181 9407 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.66
I20260811 15:07:31.475155 9407 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:42097
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460596631409-20401-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460596631409-20401-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.236.66
--webserver_port=0
--tserver_master_addrs=127.19.236.126:41083
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9407
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.66
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460596631409-20401-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:07:31.476373 9407 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:07:31.477856 9407 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:07:31.487999 9413 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:07:31.487977 9416 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:07:31.488075 9407 server_base.cc:1034] running on GCE node
W20260811 15:07:31.488234 9414 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:07:31.488723 9407 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:07:31.489354 9407 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:07:31.490548 9407 hybrid_clock.cc:648] HybridClock initialized: now 1786460851490516 us; error 46 us; skew 500 ppm
I20260811 15:07:31.492482 9407 webserver.cc:460] Webserver started at http://127.19.236.66:41649/ using document root <none> and password file <none>
I20260811 15:07:31.493134 9407 fs_manager.cc:359] Metadata directory not provided
I20260811 15:07:31.493201 9407 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:07:31.493372 9407 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:07:31.495522 9407 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460596631409-20401-0/minicluster-data/ts-1/data/instance:
uuid: "4f9581bb1e25425fb6e6fabc239fa0fe"
format_stamp: "Formatted at 2026-08-11 15:07:31 on dist-test-slave-8n49"
server_key: "81dc328197b20a267d5460940023aa76"
server_key_iv: "497d241d7284b07450980f8de2dca27b"
server_key_version: "encryptionkey@0"
I20260811 15:07:31.496073 9407 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460596631409-20401-0/minicluster-data/ts-1/wal/instance:
uuid: "4f9581bb1e25425fb6e6fabc239fa0fe"
format_stamp: "Formatted at 2026-08-11 15:07:31 on dist-test-slave-8n49"
server_key: "81dc328197b20a267d5460940023aa76"
server_key_iv: "497d241d7284b07450980f8de2dca27b"
server_key_version: "encryptionkey@0"
I20260811 15:07:31.499879 9407 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260811 15:07:31.502624 9422 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:07:31.503997 9407 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260811 15:07:31.504103 9407 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460596631409-20401-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460596631409-20401-0/minicluster-data/ts-1/wal
uuid: "4f9581bb1e25425fb6e6fabc239fa0fe"
format_stamp: "Formatted at 2026-08-11 15:07:31 on dist-test-slave-8n49"
server_key: "81dc328197b20a267d5460940023aa76"
server_key_iv: "497d241d7284b07450980f8de2dca27b"
server_key_version: "encryptionkey@0"
I20260811 15:07:31.504197 9407 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460596631409-20401-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460596631409-20401-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460596631409-20401-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:07:31.519232 9407 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:07:31.519891 9407 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:07:31.520046 9407 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:07:31.520685 9407 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:07:31.521628 9407 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:07:31.521677 9407 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:07:31.521718 9407 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:07:31.521740 9407 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:07:31.530747 9407 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.66:38499
I20260811 15:07:31.530778 9545 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.66:38499 every 8 connection(s)
I20260811 15:07:31.531675 9407 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
I20260811 15:07:31.534446 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 9407
I20260811 15:07:31.534595 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460596631409-20401-0/minicluster-data/ts-1/wal/instance
I20260811 15:07:31.534902 20401 external_mini_cluster.cc:1428] Setting key abf618abbd98200c577e4abe2a09805c
I20260811 15:07:31.537009 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460596631409-20401-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460596631409-20401-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460596631409-20401-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.67:0
--local_ip_for_outbound_sockets=127.19.236.67
--webserver_interface=127.19.236.67
--webserver_port=0
--tserver_master_addrs=127.19.236.126:41083
--builtin_ntp_servers=127.19.236.84:42097
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 15:07:31.541766 9239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:31.533620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.66:45687 (local address 127.19.236.126:41083)
0811 15:07:31.533803 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:31.533809 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:31.535013 (+ 1204us) server_negotiation.cc:407] Connection header received
0811 15:07:31.536790 (+ 1777us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:31.536794 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:31.536848 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:31.536963 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:07:31.537952 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:31.538498 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:31.539676 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:31.539913 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:31.540031 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:31.541222 (+ 1191us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:07:31.541226 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:07:31.541229 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:07:31.541242 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:07:31.541270 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:07:31.541278 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:07:31.541360 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:31.541553 (+ 193us) server_negotiation.cc:299] Negotiation successful
0811 15:07:31.541621 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260811 15:07:31.542626 9548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:31.534013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:41083 (local address 127.19.236.66:45687)
0811 15:07:31.534845 (+ 832us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:31.534890 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 15:07:31.536526 (+ 1636us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:07:31.537180 (+ 654us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:07:31.537190 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:07:31.537305 (+ 115us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:07:31.537793 (+ 488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:31.537806 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:31.538639 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:31.538642 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:31.539541 (+ 899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:31.539551 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:31.540074 (+ 523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:31.540078 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:31.540250 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:31.540951 (+ 701us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 15:07:31.540953 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:07:31.540993 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 15:07:31.541056 (+ 63us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:07:31.541363 (+ 307us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:07:31.541375 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:07:31.541392 (+ 17us) client_negotiation.cc:769] Sending connection context
0811 15:07:31.541553 (+ 161us) client_negotiation.cc:240] Negotiation successful
0811 15:07:31.541833 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":366,"thread_start_us":186,"threads_started":1}
I20260811 15:07:31.543815 9546 heartbeater.cc:347] Connected to a master server at 127.19.236.126:41083
I20260811 15:07:31.544083 9546 heartbeater.cc:464] Registering TS with master...
I20260811 15:07:31.544682 9546 heartbeater.cc:511] Master 127.19.236.126:41083 requested a full tablet report, sending...
I20260811 15:07:31.545795 9196 ts_manager.cc:194] Registered new tserver with Master: 4f9581bb1e25425fb6e6fabc239fa0fe (127.19.236.66:38499)
I20260811 15:07:31.546697 9196 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.19.236.66:45687
W20260811 15:07:31.653296 9549 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:07:31.653571 9549 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:07:31.653611 9549 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:07:31.657807 9549 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:07:31.657868 9549 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:07:31.657925 9549 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.67
I20260811 15:07:31.662710 9549 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:42097
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460596631409-20401-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460596631409-20401-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.236.67
--webserver_port=0
--tserver_master_addrs=127.19.236.126:41083
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9549
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.67
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460596631409-20401-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:07:31.663829 9549 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:07:31.665274 9549 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:07:31.675146 9555 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:07:31.675158 9554 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:07:31.675166 9557 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:07:31.675359 9549 server_base.cc:1034] running on GCE node
I20260811 15:07:31.675803 9549 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:07:31.676509 9549 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:07:31.677744 9549 hybrid_clock.cc:648] HybridClock initialized: now 1786460851677712 us; error 42 us; skew 500 ppm
I20260811 15:07:31.679642 9549 webserver.cc:460] Webserver started at http://127.19.236.67:46473/ using document root <none> and password file <none>
I20260811 15:07:31.680269 9549 fs_manager.cc:359] Metadata directory not provided
I20260811 15:07:31.680370 9549 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:07:31.680686 9549 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:07:31.682863 9549 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460596631409-20401-0/minicluster-data/ts-2/data/instance:
uuid: "0cb9f8c7a02241eb8fbc97c1f8ed7cb7"
format_stamp: "Formatted at 2026-08-11 15:07:31 on dist-test-slave-8n49"
server_key: "2511905993dda46fec432ac7a90a2d33"
server_key_iv: "3acaef875ed1c705b5e2856572d92e15"
server_key_version: "encryptionkey@0"
I20260811 15:07:31.683475 9549 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460596631409-20401-0/minicluster-data/ts-2/wal/instance:
uuid: "0cb9f8c7a02241eb8fbc97c1f8ed7cb7"
format_stamp: "Formatted at 2026-08-11 15:07:31 on dist-test-slave-8n49"
server_key: "2511905993dda46fec432ac7a90a2d33"
server_key_iv: "3acaef875ed1c705b5e2856572d92e15"
server_key_version: "encryptionkey@0"
I20260811 15:07:31.687353 9549 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260811 15:07:31.689952 9564 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:07:31.691202 9549 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 15:07:31.691342 9549 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460596631409-20401-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460596631409-20401-0/minicluster-data/ts-2/wal
uuid: "0cb9f8c7a02241eb8fbc97c1f8ed7cb7"
format_stamp: "Formatted at 2026-08-11 15:07:31 on dist-test-slave-8n49"
server_key: "2511905993dda46fec432ac7a90a2d33"
server_key_iv: "3acaef875ed1c705b5e2856572d92e15"
server_key_version: "encryptionkey@0"
I20260811 15:07:31.691462 9549 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460596631409-20401-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460596631409-20401-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460596631409-20401-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:07:31.707032 9549 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:07:31.707789 9549 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:07:31.707989 9549 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:07:31.708707 9549 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:07:31.709674 9549 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:07:31.709745 9549 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:07:31.709816 9549 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:07:31.709863 9549 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:07:31.718883 9549 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.67:41791
I20260811 15:07:31.718914 9697 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.67:41791 every 8 connection(s)
I20260811 15:07:31.719821 9549 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
I20260811 15:07:31.724671 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 9549
I20260811 15:07:31.724788 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460596631409-20401-0/minicluster-data/ts-2/wal/instance
I20260811 15:07:31.725212 20401 external_mini_cluster.cc:1428] Setting key 0f3bba73b9f78e45c66900ed83200719
I20260811 15:07:31.730005 9239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:31.721754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.67:36317 (local address 127.19.236.126:41083)
0811 15:07:31.721925 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:31.721929 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:31.722964 (+ 1035us) server_negotiation.cc:407] Connection header received
0811 15:07:31.724369 (+ 1405us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:31.724372 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:31.724423 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:31.724498 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:07:31.725856 (+ 1358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:31.726754 (+ 898us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:31.728100 (+ 1346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:31.728333 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:31.728459 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:31.729576 (+ 1117us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:07:31.729579 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:07:31.729581 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:07:31.729593 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:07:31.729612 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:07:31.729619 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:07:31.729682 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:31.729830 (+ 148us) server_negotiation.cc:299] Negotiation successful
0811 15:07:31.729881 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260811 15:07:31.730893 9701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:31.722137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:41083 (local address 127.19.236.67:36317)
0811 15:07:31.722787 (+ 650us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:31.722827 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 15:07:31.724128 (+ 1301us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:07:31.724752 (+ 624us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:07:31.724763 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:07:31.724885 (+ 122us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:07:31.725677 (+ 792us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:31.725695 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:31.726906 (+ 1211us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:31.726909 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:31.727970 (+ 1061us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:31.727981 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:31.728494 (+ 513us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:31.728496 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:31.728704 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:31.729318 (+ 614us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 15:07:31.729319 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:07:31.729359 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 15:07:31.729426 (+ 67us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:07:31.729698 (+ 272us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:07:31.729704 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:07:31.729709 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 15:07:31.729804 (+ 95us) client_negotiation.cc:240] Negotiation successful
0811 15:07:31.730031 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":121,"threads_started":1}
I20260811 15:07:31.732141 9698 heartbeater.cc:347] Connected to a master server at 127.19.236.126:41083
I20260811 15:07:31.732389 9698 heartbeater.cc:464] Registering TS with master...
I20260811 15:07:31.732975 9698 heartbeater.cc:511] Master 127.19.236.126:41083 requested a full tablet report, sending...
I20260811 15:07:31.734072 9196 ts_manager.cc:194] Registered new tserver with Master: 0cb9f8c7a02241eb8fbc97c1f8ed7cb7 (127.19.236.67:41791)
I20260811 15:07:31.734647 9196 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.19.236.67:36317
I20260811 15:07:31.739324 20401 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 15:07:31.745496 9239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:31.741401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37142 (local address 127.19.236.126:41083)
0811 15:07:31.741566 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:31.741571 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:31.741716 (+ 145us) server_negotiation.cc:407] Connection header received
0811 15:07:31.741877 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:31.741885 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:31.741925 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:31.742007 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:07:31.742305 (+ 298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:31.742819 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:31.743682 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:31.743898 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:31.744007 (+ 109us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:31.744970 (+ 963us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:07:31.744974 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:07:31.744976 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:07:31.744987 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:07:31.745004 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:07:31.745012 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:07:31.745145 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:31.745308 (+ 163us) server_negotiation.cc:299] Negotiation successful
0811 15:07:31.745349 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 15:07:31.748258 9196 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37142:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 15:07:31.751324 9196 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 15:07:31.766659 9712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:31.760130 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52440 (local address 127.19.236.66:38499)
0811 15:07:31.761277 (+ 1147us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:31.761289 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:31.761311 (+ 22us) server_negotiation.cc:407] Connection header received
0811 15:07:31.761392 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:31.761399 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:31.761592 (+ 193us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:31.761743 (+ 151us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:07:31.762335 (+ 592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:31.763747 (+ 1412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:31.765321 (+ 1574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:31.765954 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:31.766103 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:31.766322 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:31.766385 (+ 63us) server_negotiation.cc:299] Negotiation successful
0811 15:07:31.766480 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1040,"thread_start_us":169,"threads_started":1}
I20260811 15:07:31.766662 9710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:31.759964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.66:38499 (local address 127.0.0.1:52440)
0811 15:07:31.760793 (+ 829us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:31.760848 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0811 15:07:31.760987 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:07:31.761916 (+ 929us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:07:31.761922 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:07:31.761949 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:07:31.762201 (+ 252us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:31.762208 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:31.763891 (+ 1683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:31.763895 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:31.765179 (+ 1284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:31.765189 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:31.766096 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:31.766100 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:31.766212 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:31.766250 (+ 38us) client_negotiation.cc:769] Sending connection context
0811 15:07:31.766359 (+ 109us) client_negotiation.cc:240] Negotiation successful
0811 15:07:31.766480 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":646,"mutex_wait_us":52,"spinlock_wait_cycles":13440,"thread_start_us":75,"threads_started":1}
I20260811 15:07:31.767022 9713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:31.760143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.65:45257 (local address 127.0.0.1:40916)
0811 15:07:31.760793 (+ 650us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:31.760849 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0811 15:07:31.760987 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:07:31.761913 (+ 926us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:07:31.761919 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:07:31.761969 (+ 50us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:07:31.762273 (+ 304us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:31.762279 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:31.764034 (+ 1755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:31.764038 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:31.765340 (+ 1302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:31.765350 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:31.766635 (+ 1285us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:31.766639 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:31.766722 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:31.766746 (+ 24us) client_negotiation.cc:769] Sending connection context
0811 15:07:31.766814 (+ 68us) client_negotiation.cc:240] Negotiation successful
0811 15:07:31.766876 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":598,"mutex_wait_us":192,"spinlock_wait_cycles":27392,"thread_start_us":94,"threads_started":1}
I20260811 15:07:31.767532 9715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:31.760764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40916 (local address 127.19.236.65:45257)
0811 15:07:31.761170 (+ 406us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:31.761183 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:31.761210 (+ 27us) server_negotiation.cc:407] Connection header received
0811 15:07:31.761296 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:31.761303 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:31.761525 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:31.761719 (+ 194us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:07:31.762422 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:31.763727 (+ 1305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:31.765486 (+ 1759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:31.766268 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:31.766375 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:31.766578 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:31.767246 (+ 668us) server_negotiation.cc:299] Negotiation successful
0811 15:07:31.767357 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":299,"thread_start_us":137,"threads_started":1}
I20260811 15:07:31.768082 9711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:31.760387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.67:41791 (local address 127.0.0.1:52762)
0811 15:07:31.761219 (+ 832us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:31.761232 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 15:07:31.761312 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:07:31.761989 (+ 677us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:07:31.761991 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:07:31.762017 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:07:31.762272 (+ 255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:31.762279 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:31.765271 (+ 2992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:31.765276 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:31.766401 (+ 1125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:31.766411 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:31.767672 (+ 1261us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:31.767675 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:31.767754 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:31.767776 (+ 22us) client_negotiation.cc:769] Sending connection context
0811 15:07:31.767849 (+ 73us) client_negotiation.cc:240] Negotiation successful
0811 15:07:31.767923 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":775,"mutex_wait_us":95,"spinlock_wait_cycles":1280,"thread_start_us":115,"threads_started":1}
I20260811 15:07:31.768553 9714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:31.760715 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52762 (local address 127.19.236.67:41791)
0811 15:07:31.761575 (+ 860us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:31.761586 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:31.761609 (+ 23us) server_negotiation.cc:407] Connection header received
0811 15:07:31.761680 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:31.761687 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:31.761853 (+ 166us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:31.762003 (+ 150us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:07:31.763918 (+ 1915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:31.765149 (+ 1231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:31.766541 (+ 1392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:31.767331 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:31.767431 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:31.767613 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:31.768302 (+ 689us) server_negotiation.cc:299] Negotiation successful
0811 15:07:31.768399 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":748,"thread_start_us":141,"threads_started":1}
I20260811 15:07:31.770327 9472 tablet_service.cc:1467] Processing CreateTablet for tablet 29ea676527f34d24bc2c49775d163f6e (DEFAULT_TABLE table=test-table [id=e32d48e656aa4df5ac4577a6b6173d8f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:07:31.770342 9332 tablet_service.cc:1467] Processing CreateTablet for tablet 29ea676527f34d24bc2c49775d163f6e (DEFAULT_TABLE table=test-table [id=e32d48e656aa4df5ac4577a6b6173d8f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:07:31.771354 9472 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29ea676527f34d24bc2c49775d163f6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:07:31.771402 9332 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29ea676527f34d24bc2c49775d163f6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:07:31.771175 9620 tablet_service.cc:1467] Processing CreateTablet for tablet 29ea676527f34d24bc2c49775d163f6e (DEFAULT_TABLE table=test-table [id=e32d48e656aa4df5ac4577a6b6173d8f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:07:31.772079 9620 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29ea676527f34d24bc2c49775d163f6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:07:31.778103 9716 tablet_bootstrap.cc:492] T 29ea676527f34d24bc2c49775d163f6e P 4f9581bb1e25425fb6e6fabc239fa0fe: Bootstrap starting.
I20260811 15:07:31.779564 9717 tablet_bootstrap.cc:492] T 29ea676527f34d24bc2c49775d163f6e P 0cb9f8c7a02241eb8fbc97c1f8ed7cb7: Bootstrap starting.
I20260811 15:07:31.779616 9718 tablet_bootstrap.cc:492] T 29ea676527f34d24bc2c49775d163f6e P 3843695880ff4d9a8d492564db9e75be: Bootstrap starting.
I20260811 15:07:31.780655 9716 tablet_bootstrap.cc:654] T 29ea676527f34d24bc2c49775d163f6e P 4f9581bb1e25425fb6e6fabc239fa0fe: Neither blocks nor log segments found. Creating new log.
I20260811 15:07:31.781430 9718 tablet_bootstrap.cc:654] T 29ea676527f34d24bc2c49775d163f6e P 3843695880ff4d9a8d492564db9e75be: Neither blocks nor log segments found. Creating new log.
I20260811 15:07:31.781570 9716 log.cc:824] T 29ea676527f34d24bc2c49775d163f6e P 4f9581bb1e25425fb6e6fabc239fa0fe: Log is configured to *not* fsync() on all Append() calls
I20260811 15:07:31.781754 9717 tablet_bootstrap.cc:654] T 29ea676527f34d24bc2c49775d163f6e P 0cb9f8c7a02241eb8fbc97c1f8ed7cb7: Neither blocks nor log segments found. Creating new log.
I20260811 15:07:31.782289 9718 log.cc:824] T 29ea676527f34d24bc2c49775d163f6e P 3843695880ff4d9a8d492564db9e75be: Log is configured to *not* fsync() on all Append() calls
I20260811 15:07:31.782719 9717 log.cc:824] T 29ea676527f34d24bc2c49775d163f6e P 0cb9f8c7a02241eb8fbc97c1f8ed7cb7: Log is configured to *not* fsync() on all Append() calls
I20260811 15:07:31.784409 9717 tablet_bootstrap.cc:492] T 29ea676527f34d24bc2c49775d163f6e P 0cb9f8c7a02241eb8fbc97c1f8ed7cb7: No bootstrap required, opened a new log
I20260811 15:07:31.784443 9716 tablet_bootstrap.cc:492] T 29ea676527f34d24bc2c49775d163f6e P 4f9581bb1e25425fb6e6fabc239fa0fe: No bootstrap required, opened a new log
I20260811 15:07:31.784505 9718 tablet_bootstrap.cc:492] T 29ea676527f34d24bc2c49775d163f6e P 3843695880ff4d9a8d492564db9e75be: No bootstrap required, opened a new log
I20260811 15:07:31.784680 9716 ts_tablet_manager.cc:1397] T 29ea676527f34d24bc2c49775d163f6e P 4f9581bb1e25425fb6e6fabc239fa0fe: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.004s
I20260811 15:07:31.784680 9718 ts_tablet_manager.cc:1397] T 29ea676527f34d24bc2c49775d163f6e P 3843695880ff4d9a8d492564db9e75be: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.001s
I20260811 15:07:31.784684 9717 ts_tablet_manager.cc:1397] T 29ea676527f34d24bc2c49775d163f6e P 0cb9f8c7a02241eb8fbc97c1f8ed7cb7: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20260811 15:07:31.787793 9717 raft_consensus.cc:348] T 29ea676527f34d24bc2c49775d163f6e P 0cb9f8c7a02241eb8fbc97c1f8ed7cb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f9581bb1e25425fb6e6fabc239fa0fe" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 38499 } } peers { permanent_uuid: "3843695880ff4d9a8d492564db9e75be" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 45257 } } peers { permanent_uuid: "0cb9f8c7a02241eb8fbc97c1f8ed7cb7" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 41791 } }
I20260811 15:07:31.788061 9717 raft_consensus.cc:374] T 29ea676527f34d24bc2c49775d163f6e P 0cb9f8c7a02241eb8fbc97c1f8ed7cb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:07:31.788118 9717 raft_consensus.cc:729] T 29ea676527f34d24bc2c49775d163f6e P 0cb9f8c7a02241eb8fbc97c1f8ed7cb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cb9f8c7a02241eb8fbc97c1f8ed7cb7, State: Initialized, Role: FOLLOWER
I20260811 15:07:31.788636 9717 consensus_queue.cc:260] T 29ea676527f34d24bc2c49775d163f6e P 0cb9f8c7a02241eb8fbc97c1f8ed7cb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f9581bb1e25425fb6e6fabc239fa0fe" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 38499 } } peers { permanent_uuid: "3843695880ff4d9a8d492564db9e75be" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 45257 } } peers { permanent_uuid: "0cb9f8c7a02241eb8fbc97c1f8ed7cb7" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 41791 } }
I20260811 15:07:31.788745 9718 raft_consensus.cc:348] T 29ea676527f34d24bc2c49775d163f6e P 3843695880ff4d9a8d492564db9e75be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f9581bb1e25425fb6e6fabc239fa0fe" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 38499 } } peers { permanent_uuid: "3843695880ff4d9a8d492564db9e75be" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 45257 } } peers { permanent_uuid: "0cb9f8c7a02241eb8fbc97c1f8ed7cb7" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 41791 } }
I20260811 15:07:31.788745 9716 raft_consensus.cc:348] T 29ea676527f34d24bc2c49775d163f6e P 4f9581bb1e25425fb6e6fabc239fa0fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f9581bb1e25425fb6e6fabc239fa0fe" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 38499 } } peers { permanent_uuid: "3843695880ff4d9a8d492564db9e75be" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 45257 } } peers { permanent_uuid: "0cb9f8c7a02241eb8fbc97c1f8ed7cb7" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 41791 } }
I20260811 15:07:31.788992 9716 raft_consensus.cc:374] T 29ea676527f34d24bc2c49775d163f6e P 4f9581bb1e25425fb6e6fabc239fa0fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:07:31.788992 9718 raft_consensus.cc:374] T 29ea676527f34d24bc2c49775d163f6e P 3843695880ff4d9a8d492564db9e75be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:07:31.789057 9716 raft_consensus.cc:729] T 29ea676527f34d24bc2c49775d163f6e P 4f9581bb1e25425fb6e6fabc239fa0fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f9581bb1e25425fb6e6fabc239fa0fe, State: Initialized, Role: FOLLOWER
I20260811 15:07:31.789067 9718 raft_consensus.cc:729] T 29ea676527f34d24bc2c49775d163f6e P 3843695880ff4d9a8d492564db9e75be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3843695880ff4d9a8d492564db9e75be, State: Initialized, Role: FOLLOWER
I20260811 15:07:31.789475 9698 heartbeater.cc:503] Master 127.19.236.126:41083 was elected leader, sending a full tablet report...
I20260811 15:07:31.789486 9716 consensus_queue.cc:260] T 29ea676527f34d24bc2c49775d163f6e P 4f9581bb1e25425fb6e6fabc239fa0fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f9581bb1e25425fb6e6fabc239fa0fe" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 38499 } } peers { permanent_uuid: "3843695880ff4d9a8d492564db9e75be" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 45257 } } peers { permanent_uuid: "0cb9f8c7a02241eb8fbc97c1f8ed7cb7" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 41791 } }
I20260811 15:07:31.789525 9718 consensus_queue.cc:260] T 29ea676527f34d24bc2c49775d163f6e P 3843695880ff4d9a8d492564db9e75be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f9581bb1e25425fb6e6fabc239fa0fe" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 38499 } } peers { permanent_uuid: "3843695880ff4d9a8d492564db9e75be" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 45257 } } peers { permanent_uuid: "0cb9f8c7a02241eb8fbc97c1f8ed7cb7" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 41791 } }
I20260811 15:07:31.790293 9717 ts_tablet_manager.cc:1428] T 29ea676527f34d24bc2c49775d163f6e P 0cb9f8c7a02241eb8fbc97c1f8ed7cb7: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260811 15:07:31.790459 9716 ts_tablet_manager.cc:1428] T 29ea676527f34d24bc2c49775d163f6e P 4f9581bb1e25425fb6e6fabc239fa0fe: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260811 15:07:31.790766 9546 heartbeater.cc:503] Master 127.19.236.126:41083 was elected leader, sending a full tablet report...
I20260811 15:07:31.790933 9718 ts_tablet_manager.cc:1428] T 29ea676527f34d24bc2c49775d163f6e P 3843695880ff4d9a8d492564db9e75be: Time spent starting tablet: real 0.006s user 0.003s sys 0.002s
I20260811 15:07:31.791234 9403 heartbeater.cc:503] Master 127.19.236.126:41083 was elected leader, sending a full tablet report...
I20260811 15:07:31.833187 9722 raft_consensus.cc:482] T 29ea676527f34d24bc2c49775d163f6e P 0cb9f8c7a02241eb8fbc97c1f8ed7cb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 15:07:31.833442 9722 raft_consensus.cc:504] T 29ea676527f34d24bc2c49775d163f6e P 0cb9f8c7a02241eb8fbc97c1f8ed7cb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f9581bb1e25425fb6e6fabc239fa0fe" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 38499 } } peers { permanent_uuid: "3843695880ff4d9a8d492564db9e75be" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 45257 } } peers { permanent_uuid: "0cb9f8c7a02241eb8fbc97c1f8ed7cb7" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 41791 } }
I20260811 15:07:31.834692 9722 leader_election.cc:288] T 29ea676527f34d24bc2c49775d163f6e P 0cb9f8c7a02241eb8fbc97c1f8ed7cb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f9581bb1e25425fb6e6fabc239fa0fe (127.19.236.66:38499), 3843695880ff4d9a8d492564db9e75be (127.19.236.65:45257)
I20260811 15:07:31.838603 9701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:31.834878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.66:38499 (local address 127.19.236.67:56897)
0811 15:07:31.835037 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:31.835055 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 15:07:31.835156 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:07:31.835491 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:07:31.835494 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:07:31.835513 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:07:31.835641 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:31.835647 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:31.836400 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:31.836405 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:31.837316 (+ 911us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:31.837328 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:31.838158 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:31.838162 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:31.838262 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:31.838291 (+ 29us) client_negotiation.cc:769] Sending connection context
0811 15:07:31.838370 (+ 79us) client_negotiation.cc:240] Negotiation successful
0811 15:07:31.838459 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":56,"mutex_wait_us":1}
I20260811 15:07:31.838692 9712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:31.835030 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.67:56897 (local address 127.19.236.66:38499)
0811 15:07:31.835191 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:31.835195 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:31.835242 (+ 47us) server_negotiation.cc:407] Connection header received
0811 15:07:31.835305 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:31.835308 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:31.835366 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:31.835474 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:07:31.835762 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:31.836281 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:31.837466 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:31.838030 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:31.838158 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:31.838211 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:31.838491 (+ 280us) server_negotiation.cc:299] Negotiation successful
0811 15:07:31.838565 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260811 15:07:31.838894 9715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:31.835216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.67:49011 (local address 127.19.236.65:45257)
0811 15:07:31.835343 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:31.835348 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:31.835541 (+ 193us) server_negotiation.cc:407] Connection header received
0811 15:07:31.835688 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:31.835697 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:31.835743 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:31.835827 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:07:31.836091 (+ 264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:31.836642 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:31.837744 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:31.838218 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:31.838356 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:31.838407 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:31.838660 (+ 253us) server_negotiation.cc:299] Negotiation successful
0811 15:07:31.838766 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 15:07:31.839293 9725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:31.835023 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.65:45257 (local address 127.19.236.67:49011)
0811 15:07:31.835420 (+ 397us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:31.835430 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 15:07:31.835564 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:07:31.835837 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:07:31.835839 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:07:31.835854 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:07:31.835975 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:31.835981 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:31.836750 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:31.836755 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:31.837603 (+ 848us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:31.837613 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:31.838367 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:31.838371 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:31.838492 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:31.838515 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 15:07:31.839052 (+ 537us) client_negotiation.cc:240] Negotiation successful
0811 15:07:31.839128 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":343,"thread_start_us":168,"threads_started":1}
W20260811 15:07:31.839383 9404 tablet.cc:2369] T 29ea676527f34d24bc2c49775d163f6e P 3843695880ff4d9a8d492564db9e75be: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 15:07:31.839498 9496 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29ea676527f34d24bc2c49775d163f6e" candidate_uuid: "0cb9f8c7a02241eb8fbc97c1f8ed7cb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f9581bb1e25425fb6e6fabc239fa0fe" is_pre_election: true
I20260811 15:07:31.839860 9496 raft_consensus.cc:2454] T 29ea676527f34d24bc2c49775d163f6e P 4f9581bb1e25425fb6e6fabc239fa0fe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cb9f8c7a02241eb8fbc97c1f8ed7cb7 in term 0.
I20260811 15:07:31.839879 9353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29ea676527f34d24bc2c49775d163f6e" candidate_uuid: "0cb9f8c7a02241eb8fbc97c1f8ed7cb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843695880ff4d9a8d492564db9e75be" is_pre_election: true
I20260811 15:07:31.840181 9353 raft_consensus.cc:2454] T 29ea676527f34d24bc2c49775d163f6e P 3843695880ff4d9a8d492564db9e75be [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cb9f8c7a02241eb8fbc97c1f8ed7cb7 in term 0.
I20260811 15:07:31.840356 9567 leader_election.cc:302] T 29ea676527f34d24bc2c49775d163f6e P 0cb9f8c7a02241eb8fbc97c1f8ed7cb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cb9f8c7a02241eb8fbc97c1f8ed7cb7, 4f9581bb1e25425fb6e6fabc239fa0fe; no voters:
I20260811 15:07:31.840680 9722 raft_consensus.cc:2781] T 29ea676527f34d24bc2c49775d163f6e P 0cb9f8c7a02241eb8fbc97c1f8ed7cb7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 15:07:31.840770 9722 raft_consensus.cc:482] T 29ea676527f34d24bc2c49775d163f6e P 0cb9f8c7a02241eb8fbc97c1f8ed7cb7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 15:07:31.840813 9722 raft_consensus.cc:3037] T 29ea676527f34d24bc2c49775d163f6e P 0cb9f8c7a02241eb8fbc97c1f8ed7cb7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:07:31.841863 9722 raft_consensus.cc:504] T 29ea676527f34d24bc2c49775d163f6e P 0cb9f8c7a02241eb8fbc97c1f8ed7cb7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f9581bb1e25425fb6e6fabc239fa0fe" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 38499 } } peers { permanent_uuid: "3843695880ff4d9a8d492564db9e75be" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 45257 } } peers { permanent_uuid: "0cb9f8c7a02241eb8fbc97c1f8ed7cb7" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 41791 } }
I20260811 15:07:31.842231 9722 leader_election.cc:288] T 29ea676527f34d24bc2c49775d163f6e P 0cb9f8c7a02241eb8fbc97c1f8ed7cb7 [CANDIDATE]: Term 1 election: Requested vote from peers 4f9581bb1e25425fb6e6fabc239fa0fe (127.19.236.66:38499), 3843695880ff4d9a8d492564db9e75be (127.19.236.65:45257)
I20260811 15:07:31.842587 9353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29ea676527f34d24bc2c49775d163f6e" candidate_uuid: "0cb9f8c7a02241eb8fbc97c1f8ed7cb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843695880ff4d9a8d492564db9e75be"
I20260811 15:07:31.842579 9496 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29ea676527f34d24bc2c49775d163f6e" candidate_uuid: "0cb9f8c7a02241eb8fbc97c1f8ed7cb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f9581bb1e25425fb6e6fabc239fa0fe"
I20260811 15:07:31.842693 9353 raft_consensus.cc:3037] T 29ea676527f34d24bc2c49775d163f6e P 3843695880ff4d9a8d492564db9e75be [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:07:31.842720 9496 raft_consensus.cc:3037] T 29ea676527f34d24bc2c49775d163f6e P 4f9581bb1e25425fb6e6fabc239fa0fe [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:07:31.843765 9353 raft_consensus.cc:2454] T 29ea676527f34d24bc2c49775d163f6e P 3843695880ff4d9a8d492564db9e75be [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cb9f8c7a02241eb8fbc97c1f8ed7cb7 in term 1.
I20260811 15:07:31.843791 9496 raft_consensus.cc:2454] T 29ea676527f34d24bc2c49775d163f6e P 4f9581bb1e25425fb6e6fabc239fa0fe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cb9f8c7a02241eb8fbc97c1f8ed7cb7 in term 1.
I20260811 15:07:31.844146 9570 leader_election.cc:302] T 29ea676527f34d24bc2c49775d163f6e P 0cb9f8c7a02241eb8fbc97c1f8ed7cb7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 0cb9f8c7a02241eb8fbc97c1f8ed7cb7, 3843695880ff4d9a8d492564db9e75be, 4f9581bb1e25425fb6e6fabc239fa0fe; no voters:
I20260811 15:07:31.844360 9722 raft_consensus.cc:2781] T 29ea676527f34d24bc2c49775d163f6e P 0cb9f8c7a02241eb8fbc97c1f8ed7cb7 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:07:31.844615 9722 raft_consensus.cc:686] T 29ea676527f34d24bc2c49775d163f6e P 0cb9f8c7a02241eb8fbc97c1f8ed7cb7 [term 1 LEADER]: Becoming Leader. State: Replica: 0cb9f8c7a02241eb8fbc97c1f8ed7cb7, State: Running, Role: LEADER
I20260811 15:07:31.844908 9722 consensus_queue.cc:237] T 29ea676527f34d24bc2c49775d163f6e P 0cb9f8c7a02241eb8fbc97c1f8ed7cb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f9581bb1e25425fb6e6fabc239fa0fe" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 38499 } } peers { permanent_uuid: "3843695880ff4d9a8d492564db9e75be" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 45257 } } peers { permanent_uuid: "0cb9f8c7a02241eb8fbc97c1f8ed7cb7" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 41791 } }
I20260811 15:07:31.848176 9195 catalog_manager.cc:5495] T 29ea676527f34d24bc2c49775d163f6e P 0cb9f8c7a02241eb8fbc97c1f8ed7cb7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0cb9f8c7a02241eb8fbc97c1f8ed7cb7 (127.19.236.67). New cstate: current_term: 1 leader_uuid: "0cb9f8c7a02241eb8fbc97c1f8ed7cb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f9581bb1e25425fb6e6fabc239fa0fe" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 38499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3843695880ff4d9a8d492564db9e75be" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 45257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0cb9f8c7a02241eb8fbc97c1f8ed7cb7" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 41791 } health_report { overall_health: HEALTHY } } }
I20260811 15:07:31.866665 9714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:31.862960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52772 (local address 127.19.236.67:41791)
0811 15:07:31.863093 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:31.863097 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:31.863111 (+ 14us) server_negotiation.cc:407] Connection header received
0811 15:07:31.863255 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:31.863257 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:31.863313 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:31.863395 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 15:07:31.863640 (+ 245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:31.864149 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:31.865150 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:31.865369 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:31.865474 (+ 105us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:31.865724 (+ 250us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 15:07:31.866144 (+ 420us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 15:07:31.866256 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:31.866418 (+ 162us) server_negotiation.cc:299] Negotiation successful
0811 15:07:31.866479 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 15:07:31.872877 9353 raft_consensus.cc:1261] T 29ea676527f34d24bc2c49775d163f6e P 3843695880ff4d9a8d492564db9e75be [term 1 FOLLOWER]: Refusing update from remote peer 0cb9f8c7a02241eb8fbc97c1f8ed7cb7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:07:31.872877 9496 raft_consensus.cc:1261] T 29ea676527f34d24bc2c49775d163f6e P 4f9581bb1e25425fb6e6fabc239fa0fe [term 1 FOLLOWER]: Refusing update from remote peer 0cb9f8c7a02241eb8fbc97c1f8ed7cb7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:07:31.873648 9726 consensus_queue.cc:1035] T 29ea676527f34d24bc2c49775d163f6e P 0cb9f8c7a02241eb8fbc97c1f8ed7cb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843695880ff4d9a8d492564db9e75be" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 45257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:07:31.873847 9722 consensus_queue.cc:1035] T 29ea676527f34d24bc2c49775d163f6e P 0cb9f8c7a02241eb8fbc97c1f8ed7cb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f9581bb1e25425fb6e6fabc239fa0fe" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 38499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:07:31.883296 9732 mvcc.cc:205] Tried to move back new op lower bound from 7317343649263026176 to 7317343649159151616. Current Snapshot: MvccSnapshot[applied={T|T < 7317343649263026176}]
I20260811 15:07:31.890933 9194 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37142:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 15:07:31.891131 9194 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37142:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 15:07:31.893533 9194 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f06c2ede550e439da741a584a0f7a200: Sending DeleteTablet for 3 replicas of tablet 29ea676527f34d24bc2c49775d163f6e
I20260811 15:07:31.894369 9620 tablet_service.cc:1514] Processing DeleteTablet for tablet 29ea676527f34d24bc2c49775d163f6e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:07:31 UTC) from {username='slave'} at 127.0.0.1:52762
I20260811 15:07:31.894354 9472 tablet_service.cc:1514] Processing DeleteTablet for tablet 29ea676527f34d24bc2c49775d163f6e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:07:31 UTC) from {username='slave'} at 127.0.0.1:52440
I20260811 15:07:31.894408 9332 tablet_service.cc:1514] Processing DeleteTablet for tablet 29ea676527f34d24bc2c49775d163f6e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:07:31 UTC) from {username='slave'} at 127.0.0.1:40916
I20260811 15:07:31.895041 9742 tablet_replica.cc:330] T 29ea676527f34d24bc2c49775d163f6e P 0cb9f8c7a02241eb8fbc97c1f8ed7cb7: stopping tablet replica
I20260811 15:07:31.895028 9743 tablet_replica.cc:330] T 29ea676527f34d24bc2c49775d163f6e P 3843695880ff4d9a8d492564db9e75be: stopping tablet replica
I20260811 15:07:31.895381 9742 raft_consensus.cc:2229] T 29ea676527f34d24bc2c49775d163f6e P 0cb9f8c7a02241eb8fbc97c1f8ed7cb7 [term 1 LEADER]: Raft consensus shutting down.
I20260811 15:07:31.895381 9743 raft_consensus.cc:2229] T 29ea676527f34d24bc2c49775d163f6e P 3843695880ff4d9a8d492564db9e75be [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 15:07:31.895695 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 9263
I20260811 15:07:31.895787 9742 raft_consensus.cc:2258] T 29ea676527f34d24bc2c49775d163f6e P 0cb9f8c7a02241eb8fbc97c1f8ed7cb7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:07:31.895911 9743 raft_consensus.cc:2258] T 29ea676527f34d24bc2c49775d163f6e P 3843695880ff4d9a8d492564db9e75be [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:07:31.896229 9741 tablet_replica.cc:330] T 29ea676527f34d24bc2c49775d163f6e P 4f9581bb1e25425fb6e6fabc239fa0fe: stopping tablet replica
I20260811 15:07:31.896529 9741 raft_consensus.cc:2229] T 29ea676527f34d24bc2c49775d163f6e P 4f9581bb1e25425fb6e6fabc239fa0fe [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 15:07:31.896819 9741 raft_consensus.cc:2258] T 29ea676527f34d24bc2c49775d163f6e P 4f9581bb1e25425fb6e6fabc239fa0fe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:07:31.897877 9742 ts_tablet_manager.cc:1905] T 29ea676527f34d24bc2c49775d163f6e P 0cb9f8c7a02241eb8fbc97c1f8ed7cb7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 15:07:31.900238 9742 ts_tablet_manager.cc:1918] T 29ea676527f34d24bc2c49775d163f6e P 0cb9f8c7a02241eb8fbc97c1f8ed7cb7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 15:07:31.900365 9742 log.cc:1196] T 29ea676527f34d24bc2c49775d163f6e P 0cb9f8c7a02241eb8fbc97c1f8ed7cb7: Deleting WAL directory at /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460596631409-20401-0/minicluster-data/ts-2/wal/wals/29ea676527f34d24bc2c49775d163f6e
I20260811 15:07:31.901106 9742 ts_tablet_manager.cc:1939] T 29ea676527f34d24bc2c49775d163f6e P 0cb9f8c7a02241eb8fbc97c1f8ed7cb7: Deleting consensus metadata
I20260811 15:07:31.902359 9180 catalog_manager.cc:4841] TS 0cb9f8c7a02241eb8fbc97c1f8ed7cb7 (127.19.236.67:41791): tablet 29ea676527f34d24bc2c49775d163f6e (table test-table [id=e32d48e656aa4df5ac4577a6b6173d8f]) successfully deleted
I20260811 15:07:31.904819 9741 ts_tablet_manager.cc:1905] T 29ea676527f34d24bc2c49775d163f6e P 4f9581bb1e25425fb6e6fabc239fa0fe: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 15:07:31.907161 9741 ts_tablet_manager.cc:1918] T 29ea676527f34d24bc2c49775d163f6e P 4f9581bb1e25425fb6e6fabc239fa0fe: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 15:07:31.907299 9741 log.cc:1196] T 29ea676527f34d24bc2c49775d163f6e P 4f9581bb1e25425fb6e6fabc239fa0fe: Deleting WAL directory at /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786460596631409-20401-0/minicluster-data/ts-1/wal/wals/29ea676527f34d24bc2c49775d163f6e
I20260811 15:07:31.907675 9741 ts_tablet_manager.cc:1939] T 29ea676527f34d24bc2c49775d163f6e P 4f9581bb1e25425fb6e6fabc239fa0fe: Deleting consensus metadata
W20260811 15:07:31.908847 9183 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.19.236.65:45257 (error 108)
I20260811 15:07:31.909063 9181 catalog_manager.cc:4841] TS 4f9581bb1e25425fb6e6fabc239fa0fe (127.19.236.66:38499): tablet 29ea676527f34d24bc2c49775d163f6e (table test-table [id=e32d48e656aa4df5ac4577a6b6173d8f]) successfully deleted
I20260811 15:07:31.909786 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 9407
I20260811 15:07:31.910012 9711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:31.909699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.65:45257 (local address 127.0.0.1:40926)
0811 15:07:31.909855 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:31.909927 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.65:45257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260811 15:07:31.911491 9183 catalog_manager.cc:4584] TS 3843695880ff4d9a8d492564db9e75be (127.19.236.65:45257): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 29ea676527f34d24bc2c49775d163f6e: Network error: Client connection negotiation failed: client connection to 127.19.236.65:45257: connect: Connection refused (error 111)
I20260811 15:07:31.919516 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 9549
I20260811 15:07:31.927974 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 9162
2026-08-11T15:07:31Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (1062 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 15:07:31 dist-test-slave-8n49 krb5kdc[9747](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 15:07:31 dist-test-slave-8n49 krb5kdc[9747](info): set up 2 sockets
Aug 11 15:07:31 dist-test-slave-8n49 krb5kdc[9747](info): commencing operation
krb5kdc: starting...
W20260811 15:07:33.039471 20401 mini_kdc.cc:121] Time spent starting KDC: real 1.088s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/krb5kdc/test-user.keytab.
Aug 11 15:07:33 dist-test-slave-8n49 krb5kdc[9747](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460853, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T15:07:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T15:07:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.236.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.236.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.236.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab.
Entry for principal kudu/127.19.236.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab.
I20260811 15:07:33.165710 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:37011
--webserver_interface=127.19.236.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab
--principal=kudu/127.19.236.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:37039
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.236.126:37011
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:07:33.279366 9761 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:07:33.279642 9761 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:07:33.279685 9761 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:07:33.283691 9761 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:07:33.283752 9761 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:07:33.283773 9761 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:07:33.283797 9761 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:07:33.283811 9761 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:07:33.289067 9761 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:37039
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.236.126:37011
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab
--principal=kudu/127.19.236.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:37011
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.236.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9761
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:07:33.290421 9761 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:07:33.291473 9761 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:07:33.300974 9769 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:07:33.301079 9761 server_base.cc:1034] running on GCE node
W20260811 15:07:33.300977 9770 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:07:33.300974 9772 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:07:33.301872 9761 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:07:33.303009 9761 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:07:33.304174 9761 hybrid_clock.cc:648] HybridClock initialized: now 1786460853304162 us; error 31 us; skew 500 ppm
Aug 11 15:07:33 dist-test-slave-8n49 krb5kdc[9747](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460853, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:07:33.307222 9761 init.cc:377] Logged in from keytab as kudu/127.19.236.126@KRBTEST.COM (short username kudu)
I20260811 15:07:33.308152 9761 webserver.cc:460] Webserver started at http://127.19.236.126:35141/ using document root <none> and password file <none>
I20260811 15:07:33.308815 9761 fs_manager.cc:359] Metadata directory not provided
I20260811 15:07:33.308909 9761 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:07:33.309154 9761 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:07:33.311261 9761 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/minicluster-data/master-0/data/instance:
uuid: "87d50ec3196f4361b24cca9aa1d717d1"
format_stamp: "Formatted at 2026-08-11 15:07:33 on dist-test-slave-8n49"
server_key: "5b2bc95a4de3c2d25ee6667654fe9e59"
server_key_iv: "f148da6d1de6d5e669b84de91fbdfbb8"
server_key_version: "encryptionkey@0"
I20260811 15:07:33.311851 9761 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/minicluster-data/master-0/wal/instance:
uuid: "87d50ec3196f4361b24cca9aa1d717d1"
format_stamp: "Formatted at 2026-08-11 15:07:33 on dist-test-slave-8n49"
server_key: "5b2bc95a4de3c2d25ee6667654fe9e59"
server_key_iv: "f148da6d1de6d5e669b84de91fbdfbb8"
server_key_version: "encryptionkey@0"
I20260811 15:07:33.315606 9761 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.001s
I20260811 15:07:33.318037 9779 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:07:33.319255 9761 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 15:07:33.319396 9761 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/minicluster-data/master-0/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/minicluster-data/master-0/wal
uuid: "87d50ec3196f4361b24cca9aa1d717d1"
format_stamp: "Formatted at 2026-08-11 15:07:33 on dist-test-slave-8n49"
server_key: "5b2bc95a4de3c2d25ee6667654fe9e59"
server_key_iv: "f148da6d1de6d5e669b84de91fbdfbb8"
server_key_version: "encryptionkey@0"
I20260811 15:07:33.319509 9761 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:07:33.341751 9761 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:07:33.345148 9761 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:07:33.345359 9761 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:07:33.352416 9761 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.126:37011
I20260811 15:07:33.352456 9839 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.126:37011 every 8 connection(s)
I20260811 15:07:33.353399 9761 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
I20260811 15:07:33.356489 9840 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:07:33.362562 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 9761
I20260811 15:07:33.362555 9840 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 87d50ec3196f4361b24cca9aa1d717d1: Bootstrap starting.
I20260811 15:07:33.362715 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/minicluster-data/master-0/wal/instance
I20260811 15:07:33.363004 20401 external_mini_cluster.cc:1428] Setting key 7101e37067c9e8f874cc4c5c7ed4b473
I20260811 15:07:33.365583 9840 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 87d50ec3196f4361b24cca9aa1d717d1: Neither blocks nor log segments found. Creating new log.
I20260811 15:07:33.366552 9840 log.cc:824] T 00000000000000000000000000000000 P 87d50ec3196f4361b24cca9aa1d717d1: Log is configured to *not* fsync() on all Append() calls
I20260811 15:07:33.369059 9840 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 87d50ec3196f4361b24cca9aa1d717d1: No bootstrap required, opened a new log
I20260811 15:07:33.373867 9840 raft_consensus.cc:348] T 00000000000000000000000000000000 P 87d50ec3196f4361b24cca9aa1d717d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87d50ec3196f4361b24cca9aa1d717d1" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 37011 } }
I20260811 15:07:33.374191 9840 raft_consensus.cc:374] T 00000000000000000000000000000000 P 87d50ec3196f4361b24cca9aa1d717d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:07:33.374261 9840 raft_consensus.cc:729] T 00000000000000000000000000000000 P 87d50ec3196f4361b24cca9aa1d717d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87d50ec3196f4361b24cca9aa1d717d1, State: Initialized, Role: FOLLOWER
Aug 11 15:07:33 dist-test-slave-8n49 krb5kdc[9747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460853, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
I20260811 15:07:33.374835 9840 consensus_queue.cc:260] T 00000000000000000000000000000000 P 87d50ec3196f4361b24cca9aa1d717d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87d50ec3196f4361b24cca9aa1d717d1" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 37011 } }
I20260811 15:07:33.375039 9840 raft_consensus.cc:388] T 00000000000000000000000000000000 P 87d50ec3196f4361b24cca9aa1d717d1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 15:07:33.375123 9840 raft_consensus.cc:482] T 00000000000000000000000000000000 P 87d50ec3196f4361b24cca9aa1d717d1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 15:07:33.375250 9840 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 87d50ec3196f4361b24cca9aa1d717d1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:07:33.376536 9840 raft_consensus.cc:504] T 00000000000000000000000000000000 P 87d50ec3196f4361b24cca9aa1d717d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87d50ec3196f4361b24cca9aa1d717d1" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 37011 } }
I20260811 15:07:33.376986 9840 leader_election.cc:302] T 00000000000000000000000000000000 P 87d50ec3196f4361b24cca9aa1d717d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 87d50ec3196f4361b24cca9aa1d717d1; no voters:
I20260811 15:07:33.377415 9840 leader_election.cc:288] T 00000000000000000000000000000000 P 87d50ec3196f4361b24cca9aa1d717d1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 15:07:33.377682 9846 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 87d50ec3196f4361b24cca9aa1d717d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:07:33.377893 9846 raft_consensus.cc:686] T 00000000000000000000000000000000 P 87d50ec3196f4361b24cca9aa1d717d1 [term 1 LEADER]: Becoming Leader. State: Replica: 87d50ec3196f4361b24cca9aa1d717d1, State: Running, Role: LEADER
I20260811 15:07:33.378213 9846 consensus_queue.cc:237] T 00000000000000000000000000000000 P 87d50ec3196f4361b24cca9aa1d717d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87d50ec3196f4361b24cca9aa1d717d1" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 37011 } }
I20260811 15:07:33.378909 9840 sys_catalog.cc:564] T 00000000000000000000000000000000 P 87d50ec3196f4361b24cca9aa1d717d1 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:07:33.380061 9847 sys_catalog.cc:455] T 00000000000000000000000000000000 P 87d50ec3196f4361b24cca9aa1d717d1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "87d50ec3196f4361b24cca9aa1d717d1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87d50ec3196f4361b24cca9aa1d717d1" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 37011 } } }
I20260811 15:07:33.380389 9848 sys_catalog.cc:455] T 00000000000000000000000000000000 P 87d50ec3196f4361b24cca9aa1d717d1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 87d50ec3196f4361b24cca9aa1d717d1. Latest consensus state: current_term: 1 leader_uuid: "87d50ec3196f4361b24cca9aa1d717d1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87d50ec3196f4361b24cca9aa1d717d1" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 37011 } } }
I20260811 15:07:33.381134 9848 sys_catalog.cc:458] T 00000000000000000000000000000000 P 87d50ec3196f4361b24cca9aa1d717d1 [sys.catalog]: This master's current role is: LEADER
I20260811 15:07:33.380525 9847 sys_catalog.cc:458] T 00000000000000000000000000000000 P 87d50ec3196f4361b24cca9aa1d717d1 [sys.catalog]: This master's current role is: LEADER
I20260811 15:07:33.382781 9843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:33.364413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58476 (local address 127.19.236.126:37011)
0811 15:07:33.364931 (+ 518us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:33.364952 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:33.364999 (+ 47us) server_negotiation.cc:407] Connection header received
0811 15:07:33.365967 (+ 968us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:33.365992 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:33.366435 (+ 443us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:33.366824 (+ 389us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:07:33.367779 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:33.369480 (+ 1701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:33.370906 (+ 1426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:33.371705 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:33.371919 (+ 214us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:33.375604 (+ 3685us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:07:33.375611 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:07:33.375629 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:07:33.375664 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:07:33.378464 (+ 2800us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:07:33.378975 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:07:33.379002 (+ 27us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:07:33.379010 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:07:33.379154 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:07:33.379500 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:07:33.379503 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:07:33.379506 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:07:33.380136 (+ 630us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:07:33.381242 (+ 1106us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:33.381429 (+ 187us) server_negotiation.cc:299] Negotiation successful
0811 15:07:33.381761 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":338,"thread_start_us":166,"threads_started":1}
W20260811 15:07:33.384358 9862 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 87d50ec3196f4361b24cca9aa1d717d1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 15:07:33.384454 9862 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 15:07:33.384528 9863 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:07:33.385398 9863 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:07:33.390720 9863 catalog_manager.cc:1347] Generated new cluster ID: 69d25c3421884eb28a555679c6c9d784
I20260811 15:07:33.390792 9863 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:07:33.413096 9863 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 15:07:33.414111 9863 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:07:33.417843 9863 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 87d50ec3196f4361b24cca9aa1d717d1: Generated new TSK 0
I20260811 15:07:33.418519 9863 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.236.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.236.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.236.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.65.keytab.
Entry for principal kudu/127.19.236.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.65.keytab.
I20260811 15:07:33.455960 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.65:0
--local_ip_for_outbound_sockets=127.19.236.65
--webserver_interface=127.19.236.65
--webserver_port=0
--tserver_master_addrs=127.19.236.126:37011
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.65.keytab
--principal=kudu/127.19.236.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:37039
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:07:33.570182 9869 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:07:33.570453 9869 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:07:33.570497 9869 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:07:33.574569 9869 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:07:33.574631 9869 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:07:33.574690 9869 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.65
I20260811 15:07:33.580148 9869 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:37039
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.65.keytab
--principal=kudu/127.19.236.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.236.65
--webserver_port=0
--tserver_master_addrs=127.19.236.126:37011
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9869
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.65
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:07:33.581267 9869 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:07:33.582316 9869 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:07:33.592083 9874 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:07:33.592067 9875 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:07:33.592067 9877 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:07:33.592387 9869 server_base.cc:1034] running on GCE node
I20260811 15:07:33.592931 9869 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:07:33.593516 9869 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:07:33.594698 9869 hybrid_clock.cc:648] HybridClock initialized: now 1786460853594688 us; error 29 us; skew 500 ppm
Aug 11 15:07:33 dist-test-slave-8n49 krb5kdc[9747](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460853, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:07:33.597705 9869 init.cc:377] Logged in from keytab as kudu/127.19.236.65@KRBTEST.COM (short username kudu)
I20260811 15:07:33.598680 9869 webserver.cc:460] Webserver started at http://127.19.236.65:39047/ using document root <none> and password file <none>
I20260811 15:07:33.599272 9869 fs_manager.cc:359] Metadata directory not provided
I20260811 15:07:33.599364 9869 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:07:33.599601 9869 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:07:33.601812 9869 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/minicluster-data/ts-0/data/instance:
uuid: "009a6eb0d6b0482fb4cd9e2ebb880b15"
format_stamp: "Formatted at 2026-08-11 15:07:33 on dist-test-slave-8n49"
server_key: "378bdacc60469030e193a1512def76cc"
server_key_iv: "78223da7083f43cd7deef49a7289d705"
server_key_version: "encryptionkey@0"
I20260811 15:07:33.602468 9869 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/minicluster-data/ts-0/wal/instance:
uuid: "009a6eb0d6b0482fb4cd9e2ebb880b15"
format_stamp: "Formatted at 2026-08-11 15:07:33 on dist-test-slave-8n49"
server_key: "378bdacc60469030e193a1512def76cc"
server_key_iv: "78223da7083f43cd7deef49a7289d705"
server_key_version: "encryptionkey@0"
I20260811 15:07:33.606353 9869 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260811 15:07:33.608852 9884 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:07:33.610167 9869 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260811 15:07:33.610319 9869 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/minicluster-data/ts-0/wal
uuid: "009a6eb0d6b0482fb4cd9e2ebb880b15"
format_stamp: "Formatted at 2026-08-11 15:07:33 on dist-test-slave-8n49"
server_key: "378bdacc60469030e193a1512def76cc"
server_key_iv: "78223da7083f43cd7deef49a7289d705"
server_key_version: "encryptionkey@0"
I20260811 15:07:33.610445 9869 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:07:33.627697 9869 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:07:33.631137 9869 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:07:33.631351 9869 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:07:33.631969 9869 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:07:33.632948 9869 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:07:33.633013 9869 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:07:33.633082 9869 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:07:33.633128 9869 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:07:33.642207 9869 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.65:41177
I20260811 15:07:33.642227 10009 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.65:41177 every 8 connection(s)
I20260811 15:07:33.643196 9869 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
Aug 11 15:07:33 dist-test-slave-8n49 krb5kdc[9747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460853, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.65@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
I20260811 15:07:33.653303 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 9869
I20260811 15:07:33.653506 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/minicluster-data/ts-0/wal/instance
I20260811 15:07:33.653887 20401 external_mini_cluster.cc:1428] Setting key 1da1f0e64a6cba1acbb98b7b07c55ce6
I20260811 15:07:33.658032 9843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:33.645115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.65:51989 (local address 127.19.236.126:37011)
0811 15:07:33.645270 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:33.645274 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:33.646132 (+ 858us) server_negotiation.cc:407] Connection header received
0811 15:07:33.647494 (+ 1362us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:33.647497 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:33.647556 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:33.647654 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:07:33.648840 (+ 1186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:33.649390 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:33.650546 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:33.650783 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:33.650895 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:33.653751 (+ 2856us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:07:33.653754 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:07:33.653756 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:07:33.653781 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:07:33.655480 (+ 1699us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:07:33.656135 (+ 655us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:07:33.656138 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:07:33.656139 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:07:33.656240 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:07:33.656674 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:07:33.656677 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:07:33.656678 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:07:33.656860 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:07:33.656942 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:33.657654 (+ 712us) server_negotiation.cc:299] Negotiation successful
0811 15:07:33.657797 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 15:07:33.658733 10013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:33.645506 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:37011 (local address 127.19.236.65:51989)
0811 15:07:33.645988 (+ 482us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:33.646030 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 15:07:33.647286 (+ 1256us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:07:33.647823 (+ 537us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:07:33.647830 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:07:33.648186 (+ 356us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:07:33.648690 (+ 504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:33.648704 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:33.649531 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:33.649535 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:33.650408 (+ 873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:33.650417 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:33.650940 (+ 523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:33.650944 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:33.651123 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:33.651691 (+ 568us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:07:33.651708 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:07:33.653511 (+ 1803us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:07:33.655605 (+ 2094us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:07:33.655614 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:07:33.655632 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:07:33.656016 (+ 384us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:07:33.656341 (+ 325us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:07:33.656347 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:07:33.656352 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:07:33.656581 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:07:33.656969 (+ 388us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:07:33.656978 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:07:33.657328 (+ 350us) client_negotiation.cc:769] Sending connection context
0811 15:07:33.657557 (+ 229us) client_negotiation.cc:240] Negotiation successful
0811 15:07:33.657825 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":285,"thread_start_us":132,"threads_started":1}
I20260811 15:07:33.660068 10011 heartbeater.cc:347] Connected to a master server at 127.19.236.126:37011
I20260811 15:07:33.660341 10011 heartbeater.cc:464] Registering TS with master...
I20260811 15:07:33.660904 10011 heartbeater.cc:511] Master 127.19.236.126:37011 requested a full tablet report, sending...
I20260811 15:07:33.662660 9798 ts_manager.cc:194] Registered new tserver with Master: 009a6eb0d6b0482fb4cd9e2ebb880b15 (127.19.236.65:41177)
I20260811 15:07:33.663816 9798 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.236.65@KRBTEST.COM'} at 127.19.236.65:51989
WARNING: no policy specified for kudu/127.19.236.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.236.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.236.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.66.keytab.
Entry for principal kudu/127.19.236.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.66.keytab.
I20260811 15:07:33.683305 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.66:0
--local_ip_for_outbound_sockets=127.19.236.66
--webserver_interface=127.19.236.66
--webserver_port=0
--tserver_master_addrs=127.19.236.126:37011
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.66.keytab
--principal=kudu/127.19.236.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:37039
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:07:33.796902 10017 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:07:33.797188 10017 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:07:33.797257 10017 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:07:33.801316 10017 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:07:33.801397 10017 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:07:33.801514 10017 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.66
I20260811 15:07:33.807029 10017 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:37039
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.66.keytab
--principal=kudu/127.19.236.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.236.66
--webserver_port=0
--tserver_master_addrs=127.19.236.126:37011
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10017
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.66
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:07:33.808175 10017 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:07:33.809281 10017 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:07:33.819814 10023 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:07:33.819962 10017 server_base.cc:1034] running on GCE node
W20260811 15:07:33.819849 10024 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:07:33.820161 10026 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:07:33.820715 10017 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:07:33.821383 10017 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:07:33.822579 10017 hybrid_clock.cc:648] HybridClock initialized: now 1786460853822542 us; error 53 us; skew 500 ppm
Aug 11 15:07:33 dist-test-slave-8n49 krb5kdc[9747](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460853, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:07:33.825700 10017 init.cc:377] Logged in from keytab as kudu/127.19.236.66@KRBTEST.COM (short username kudu)
I20260811 15:07:33.826694 10017 webserver.cc:460] Webserver started at http://127.19.236.66:36541/ using document root <none> and password file <none>
I20260811 15:07:33.827335 10017 fs_manager.cc:359] Metadata directory not provided
I20260811 15:07:33.827404 10017 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:07:33.827591 10017 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:07:33.829747 10017 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/minicluster-data/ts-1/data/instance:
uuid: "b66fbb161bcd42d7b12790a331b94268"
format_stamp: "Formatted at 2026-08-11 15:07:33 on dist-test-slave-8n49"
server_key: "e9d443d1a9bf0c95db3671d8cb6b2ef5"
server_key_iv: "53b1804b40d501a5df6fae44b8fbecd3"
server_key_version: "encryptionkey@0"
I20260811 15:07:33.830256 10017 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/minicluster-data/ts-1/wal/instance:
uuid: "b66fbb161bcd42d7b12790a331b94268"
format_stamp: "Formatted at 2026-08-11 15:07:33 on dist-test-slave-8n49"
server_key: "e9d443d1a9bf0c95db3671d8cb6b2ef5"
server_key_iv: "53b1804b40d501a5df6fae44b8fbecd3"
server_key_version: "encryptionkey@0"
I20260811 15:07:33.834115 10017 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 15:07:33.836524 10033 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:07:33.837945 10017 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 15:07:33.838100 10017 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/minicluster-data/ts-1/wal
uuid: "b66fbb161bcd42d7b12790a331b94268"
format_stamp: "Formatted at 2026-08-11 15:07:33 on dist-test-slave-8n49"
server_key: "e9d443d1a9bf0c95db3671d8cb6b2ef5"
server_key_iv: "53b1804b40d501a5df6fae44b8fbecd3"
server_key_version: "encryptionkey@0"
I20260811 15:07:33.838222 10017 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:07:33.862509 10017 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:07:33.865918 10017 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:07:33.866143 10017 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:07:33.866786 10017 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:07:33.867673 10017 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:07:33.867744 10017 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:07:33.867815 10017 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:07:33.867856 10017 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:07:33.877298 10017 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.66:36607
I20260811 15:07:33.877324 10163 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.66:36607 every 8 connection(s)
I20260811 15:07:33.878259 10017 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
I20260811 15:07:33.880350 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 10017
I20260811 15:07:33.880524 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/minicluster-data/ts-1/wal/instance
I20260811 15:07:33.880903 20401 external_mini_cluster.cc:1428] Setting key c3fe69fb839526bff11c5bf2e14104df
Aug 11 15:07:33 dist-test-slave-8n49 krb5kdc[9747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460853, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.66@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.19.236.67@KRBTEST.COM; defaulting to no policy
I20260811 15:07:33.893608 9843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:33.880155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.66:40501 (local address 127.19.236.126:37011)
0811 15:07:33.880294 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:33.880298 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:33.881734 (+ 1436us) server_negotiation.cc:407] Connection header received
0811 15:07:33.883205 (+ 1471us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:33.883209 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:33.883263 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:33.883342 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:07:33.884507 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:33.885083 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:33.886229 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:33.886625 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:33.886751 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:33.889436 (+ 2685us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:07:33.889439 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:07:33.889441 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:07:33.889468 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:07:33.891086 (+ 1618us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:07:33.891757 (+ 671us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:07:33.891760 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:07:33.891761 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:07:33.891851 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:07:33.892282 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:07:33.892285 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:07:33.892286 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:07:33.892501 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:07:33.892688 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:33.893346 (+ 658us) server_negotiation.cc:299] Negotiation successful
0811 15:07:33.893471 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 15:07:33.894479 10166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:33.880705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:37011 (local address 127.19.236.66:40501)
0811 15:07:33.881565 (+ 860us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:33.881620 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0811 15:07:33.883000 (+ 1380us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:07:33.883512 (+ 512us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:07:33.883519 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:07:33.883876 (+ 357us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:07:33.884355 (+ 479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:33.884369 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:33.885220 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:33.885224 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:33.886103 (+ 879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:33.886112 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:33.886778 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:33.886781 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:33.886928 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:33.887541 (+ 613us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:07:33.887556 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:07:33.889249 (+ 1693us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:07:33.891222 (+ 1973us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:07:33.891231 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:07:33.891252 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:07:33.891639 (+ 387us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:07:33.891957 (+ 318us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:07:33.891962 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:07:33.891965 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:07:33.892168 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:07:33.892702 (+ 534us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:07:33.892713 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:07:33.893081 (+ 368us) client_negotiation.cc:769] Sending connection context
0811 15:07:33.893269 (+ 188us) client_negotiation.cc:240] Negotiation successful
0811 15:07:33.893541 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":632,"thread_start_us":159,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.236.67@KRBTEST.COM" created.
I20260811 15:07:33.895815 10164 heartbeater.cc:347] Connected to a master server at 127.19.236.126:37011
I20260811 15:07:33.896112 10164 heartbeater.cc:464] Registering TS with master...
I20260811 15:07:33.896742 10164 heartbeater.cc:511] Master 127.19.236.126:37011 requested a full tablet report, sending...
I20260811 15:07:33.898011 9798 ts_manager.cc:194] Registered new tserver with Master: b66fbb161bcd42d7b12790a331b94268 (127.19.236.66:36607)
I20260811 15:07:33.898623 9798 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.236.66@KRBTEST.COM'} at 127.19.236.66:40501
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.236.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.67.keytab.
Entry for principal kudu/127.19.236.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.67.keytab.
I20260811 15:07:33.911834 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.67:0
--local_ip_for_outbound_sockets=127.19.236.67
--webserver_interface=127.19.236.67
--webserver_port=0
--tserver_master_addrs=127.19.236.126:37011
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.67.keytab
--principal=kudu/127.19.236.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:37039
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:07:34.030215 10169 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:07:34.030488 10169 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:07:34.030561 10169 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:07:34.034670 10169 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:07:34.034735 10169 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:07:34.034842 10169 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.67
I20260811 15:07:34.040347 10169 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:37039
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.67.keytab
--principal=kudu/127.19.236.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.236.67
--webserver_port=0
--tserver_master_addrs=127.19.236.126:37011
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10169
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.67
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:07:34.041560 10169 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:07:34.042634 10169 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:07:34.052672 10178 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:07:34.052702 10169 server_base.cc:1034] running on GCE node
W20260811 15:07:34.052621 10176 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:07:34.052834 10175 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:07:34.053231 10169 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:07:34.053903 10169 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:07:34.055094 10169 hybrid_clock.cc:648] HybridClock initialized: now 1786460854055062 us; error 48 us; skew 500 ppm
Aug 11 15:07:34 dist-test-slave-8n49 krb5kdc[9747](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460854, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:07:34.057928 10169 init.cc:377] Logged in from keytab as kudu/127.19.236.67@KRBTEST.COM (short username kudu)
I20260811 15:07:34.058843 10169 webserver.cc:460] Webserver started at http://127.19.236.67:46309/ using document root <none> and password file <none>
I20260811 15:07:34.059408 10169 fs_manager.cc:359] Metadata directory not provided
I20260811 15:07:34.059504 10169 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:07:34.059736 10169 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:07:34.061867 10169 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/minicluster-data/ts-2/data/instance:
uuid: "2f27358a321d45a8ab3e1ea9348e433b"
format_stamp: "Formatted at 2026-08-11 15:07:34 on dist-test-slave-8n49"
server_key: "84c8f506fdf8bf3dffc6e7a903b9329a"
server_key_iv: "21a715442ac77ddd6927d5944434a0f6"
server_key_version: "encryptionkey@0"
I20260811 15:07:34.062474 10169 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/minicluster-data/ts-2/wal/instance:
uuid: "2f27358a321d45a8ab3e1ea9348e433b"
format_stamp: "Formatted at 2026-08-11 15:07:34 on dist-test-slave-8n49"
server_key: "84c8f506fdf8bf3dffc6e7a903b9329a"
server_key_iv: "21a715442ac77ddd6927d5944434a0f6"
server_key_version: "encryptionkey@0"
I20260811 15:07:34.066277 10169 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 15:07:34.068796 10185 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:07:34.070039 10169 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260811 15:07:34.070168 10169 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/minicluster-data/ts-2/wal
uuid: "2f27358a321d45a8ab3e1ea9348e433b"
format_stamp: "Formatted at 2026-08-11 15:07:34 on dist-test-slave-8n49"
server_key: "84c8f506fdf8bf3dffc6e7a903b9329a"
server_key_iv: "21a715442ac77ddd6927d5944434a0f6"
server_key_version: "encryptionkey@0"
I20260811 15:07:34.070278 10169 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:07:34.101223 10169 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:07:34.104111 10169 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:07:34.104321 10169 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:07:34.104995 10169 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:07:34.105854 10169 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:07:34.105922 10169 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:07:34.105994 10169 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:07:34.106040 10169 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:07:34.116344 10169 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.67:32901
I20260811 15:07:34.116366 10312 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.67:32901 every 8 connection(s)
I20260811 15:07:34.117419 10169 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
I20260811 15:07:34.119519 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 10169
I20260811 15:07:34.119673 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/minicluster-data/ts-2/wal/instance
I20260811 15:07:34.119959 20401 external_mini_cluster.cc:1428] Setting key aee2df2cd7d29517d5eccd83299318b0
Aug 11 15:07:34 dist-test-slave-8n49 krb5kdc[9747](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460854, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.67@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
I20260811 15:07:34.131714 9843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:34.119309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.67:41537 (local address 127.19.236.126:37011)
0811 15:07:34.119484 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:34.119490 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:34.120565 (+ 1075us) server_negotiation.cc:407] Connection header received
0811 15:07:34.122056 (+ 1491us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:34.122060 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:34.122115 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:34.122176 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:07:34.123385 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:34.124103 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:34.125369 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:34.125584 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:34.125665 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:34.128195 (+ 2530us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:07:34.128199 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:07:34.128201 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:07:34.128224 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:07:34.129794 (+ 1570us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:07:34.130348 (+ 554us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:07:34.130351 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:07:34.130352 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:07:34.130430 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:07:34.130746 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:07:34.130748 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:07:34.130749 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:07:34.130921 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:07:34.131004 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:34.131490 (+ 486us) server_negotiation.cc:299] Negotiation successful
0811 15:07:34.131587 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260811 15:07:34.132853 10315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:34.119853 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:37011 (local address 127.19.236.67:41537)
0811 15:07:34.120368 (+ 515us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:34.120428 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0811 15:07:34.121842 (+ 1414us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:07:34.122351 (+ 509us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:07:34.122358 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:07:34.122749 (+ 391us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:07:34.123263 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:34.123278 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:34.124213 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:34.124215 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:34.125262 (+ 1047us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:34.125272 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:34.125716 (+ 444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:34.125718 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:34.125866 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:34.126421 (+ 555us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:07:34.126440 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:07:34.128014 (+ 1574us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:07:34.129940 (+ 1926us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:07:34.129946 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:07:34.129959 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:07:34.130240 (+ 281us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:07:34.130514 (+ 274us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:07:34.130517 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:07:34.130518 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:07:34.130661 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:07:34.131019 (+ 358us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:07:34.131024 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:07:34.131270 (+ 246us) client_negotiation.cc:769] Sending connection context
0811 15:07:34.131437 (+ 167us) client_negotiation.cc:240] Negotiation successful
0811 15:07:34.131708 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":295,"thread_start_us":151,"threads_started":1}
I20260811 15:07:34.134137 10313 heartbeater.cc:347] Connected to a master server at 127.19.236.126:37011
I20260811 15:07:34.134410 10313 heartbeater.cc:464] Registering TS with master...
I20260811 15:07:34.134940 10313 heartbeater.cc:511] Master 127.19.236.126:37011 requested a full tablet report, sending...
I20260811 15:07:34.136004 9797 ts_manager.cc:194] Registered new tserver with Master: 2f27358a321d45a8ab3e1ea9348e433b (127.19.236.67:32901)
I20260811 15:07:34.136708 9797 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.236.67@KRBTEST.COM'} at 127.19.236.67:41537
I20260811 15:07:34.145861 20401 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 15:07:34.155333 9843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:34.148075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58486 (local address 127.19.236.126:37011)
0811 15:07:34.148202 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:34.148205 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:34.148379 (+ 174us) server_negotiation.cc:407] Connection header received
0811 15:07:34.148511 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:34.148513 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:34.148600 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:34.148672 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:07:34.149375 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:34.149888 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:34.150751 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:34.151004 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:34.151081 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:34.152410 (+ 1329us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:07:34.152413 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:07:34.152415 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:07:34.152437 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:07:34.153872 (+ 1435us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:07:34.154270 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:07:34.154272 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:07:34.154274 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:07:34.154344 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:07:34.154572 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:07:34.154574 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:07:34.154575 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:07:34.154780 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:07:34.154882 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:34.155116 (+ 234us) server_negotiation.cc:299] Negotiation successful
0811 15:07:34.155213 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 15:07:34.158269 9797 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58486:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 15:07:34.161372 9797 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 15:07:34.175480 10327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:34.169763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53216 (local address 127.19.236.66:36607)
0811 15:07:34.170627 (+ 864us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:34.170641 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:34.170669 (+ 28us) server_negotiation.cc:407] Connection header received
0811 15:07:34.170751 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:34.170757 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:34.170928 (+ 171us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:34.171226 (+ 298us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:07:34.171535 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:34.172586 (+ 1051us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:34.174015 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:34.174695 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:34.174822 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:34.174983 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:34.175216 (+ 233us) server_negotiation.cc:299] Negotiation successful
0811 15:07:34.175316 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":748,"thread_start_us":106,"threads_started":1}
I20260811 15:07:34.175467 10326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:34.169616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.66:36607 (local address 127.0.0.1:53216)
0811 15:07:34.170420 (+ 804us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:34.170478 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0811 15:07:34.170613 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:07:34.171210 (+ 597us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:07:34.171216 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:07:34.171245 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:07:34.171411 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:34.171418 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:34.172728 (+ 1310us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:34.172734 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:34.173866 (+ 1132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:34.173877 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:34.174822 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:34.174825 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:34.174944 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:34.174983 (+ 39us) client_negotiation.cc:769] Sending connection context
0811 15:07:34.175181 (+ 198us) client_negotiation.cc:240] Negotiation successful
0811 15:07:34.175317 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":613,"thread_start_us":75,"threads_started":1}
I20260811 15:07:34.176340 10329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:34.169772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.67:32901 (local address 127.0.0.1:46860)
0811 15:07:34.171144 (+ 1372us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:34.171157 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 15:07:34.171269 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:07:34.171747 (+ 478us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:07:34.171750 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:07:34.171769 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:07:34.171865 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:34.171871 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:34.173376 (+ 1505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:34.173382 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:34.174499 (+ 1117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:34.174510 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:34.175908 (+ 1398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:34.175912 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:34.176011 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:34.176034 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 15:07:34.176126 (+ 92us) client_negotiation.cc:240] Negotiation successful
0811 15:07:34.176193 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1312,"mutex_wait_us":63,"spinlock_wait_cycles":3456,"thread_start_us":95,"threads_started":1}
I20260811 15:07:34.177350 10325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:34.170046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.65:41177 (local address 127.0.0.1:41268)
0811 15:07:34.171450 (+ 1404us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:34.171463 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 15:07:34.171537 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:07:34.172023 (+ 486us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:07:34.172026 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:07:34.172041 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:07:34.172117 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:34.172122 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:34.173452 (+ 1330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:34.173456 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:34.175348 (+ 1892us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:34.175360 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:34.176982 (+ 1622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:34.176986 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:34.177070 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:34.177092 (+ 22us) client_negotiation.cc:769] Sending connection context
0811 15:07:34.177165 (+ 73us) client_negotiation.cc:240] Negotiation successful
0811 15:07:34.177229 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1347,"mutex_wait_us":65,"thread_start_us":95,"threads_started":1}
I20260811 15:07:34.177765 10331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:34.170593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41268 (local address 127.19.236.65:41177)
0811 15:07:34.170999 (+ 406us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:34.171006 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:34.171632 (+ 626us) server_negotiation.cc:407] Connection header received
0811 15:07:34.171717 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:34.171722 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:34.171888 (+ 166us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:34.172060 (+ 172us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:07:34.172207 (+ 147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:34.173288 (+ 1081us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:34.175497 (+ 2209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:34.176679 (+ 1182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:34.176782 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:34.176905 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:34.177531 (+ 626us) server_negotiation.cc:299] Negotiation successful
0811 15:07:34.177632 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":311,"thread_start_us":84,"threads_started":1}
I20260811 15:07:34.176399 10330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:34.170394 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46860 (local address 127.19.236.67:32901)
0811 15:07:34.170829 (+ 435us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:34.170841 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:34.171259 (+ 418us) server_negotiation.cc:407] Connection header received
0811 15:07:34.171386 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:34.171391 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:34.171603 (+ 212us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:34.171752 (+ 149us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:07:34.171985 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:34.173191 (+ 1206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:34.174631 (+ 1440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:34.175557 (+ 926us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:34.175907 (+ 350us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:34.176042 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:34.176156 (+ 114us) server_negotiation.cc:299] Negotiation successful
0811 15:07:34.176241 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":337,"thread_start_us":137,"threads_started":1}
I20260811 15:07:34.179001 10087 tablet_service.cc:1467] Processing CreateTablet for tablet c659a9caa8854a518b3aaddf7eaf766e (DEFAULT_TABLE table=test-table [id=b3c018ce2c0f4254b84a9ab172df5208]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:07:34.180123 10087 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c659a9caa8854a518b3aaddf7eaf766e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:07:34.180471 9936 tablet_service.cc:1467] Processing CreateTablet for tablet c659a9caa8854a518b3aaddf7eaf766e (DEFAULT_TABLE table=test-table [id=b3c018ce2c0f4254b84a9ab172df5208]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:07:34.181516 9936 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c659a9caa8854a518b3aaddf7eaf766e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:07:34.181293 10235 tablet_service.cc:1467] Processing CreateTablet for tablet c659a9caa8854a518b3aaddf7eaf766e (DEFAULT_TABLE table=test-table [id=b3c018ce2c0f4254b84a9ab172df5208]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:07:34.182232 10235 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c659a9caa8854a518b3aaddf7eaf766e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:07:34.186666 10332 tablet_bootstrap.cc:492] T c659a9caa8854a518b3aaddf7eaf766e P b66fbb161bcd42d7b12790a331b94268: Bootstrap starting.
I20260811 15:07:34.188580 10333 tablet_bootstrap.cc:492] T c659a9caa8854a518b3aaddf7eaf766e P 009a6eb0d6b0482fb4cd9e2ebb880b15: Bootstrap starting.
I20260811 15:07:34.189288 10332 tablet_bootstrap.cc:654] T c659a9caa8854a518b3aaddf7eaf766e P b66fbb161bcd42d7b12790a331b94268: Neither blocks nor log segments found. Creating new log.
I20260811 15:07:34.189500 10334 tablet_bootstrap.cc:492] T c659a9caa8854a518b3aaddf7eaf766e P 2f27358a321d45a8ab3e1ea9348e433b: Bootstrap starting.
I20260811 15:07:34.190783 10333 tablet_bootstrap.cc:654] T c659a9caa8854a518b3aaddf7eaf766e P 009a6eb0d6b0482fb4cd9e2ebb880b15: Neither blocks nor log segments found. Creating new log.
I20260811 15:07:34.190759 10332 log.cc:824] T c659a9caa8854a518b3aaddf7eaf766e P b66fbb161bcd42d7b12790a331b94268: Log is configured to *not* fsync() on all Append() calls
I20260811 15:07:34.191232 10334 tablet_bootstrap.cc:654] T c659a9caa8854a518b3aaddf7eaf766e P 2f27358a321d45a8ab3e1ea9348e433b: Neither blocks nor log segments found. Creating new log.
I20260811 15:07:34.191593 10333 log.cc:824] T c659a9caa8854a518b3aaddf7eaf766e P 009a6eb0d6b0482fb4cd9e2ebb880b15: Log is configured to *not* fsync() on all Append() calls
I20260811 15:07:34.192476 10334 log.cc:824] T c659a9caa8854a518b3aaddf7eaf766e P 2f27358a321d45a8ab3e1ea9348e433b: Log is configured to *not* fsync() on all Append() calls
I20260811 15:07:34.193527 10333 tablet_bootstrap.cc:492] T c659a9caa8854a518b3aaddf7eaf766e P 009a6eb0d6b0482fb4cd9e2ebb880b15: No bootstrap required, opened a new log
I20260811 15:07:34.193527 10332 tablet_bootstrap.cc:492] T c659a9caa8854a518b3aaddf7eaf766e P b66fbb161bcd42d7b12790a331b94268: No bootstrap required, opened a new log
I20260811 15:07:34.193727 10332 ts_tablet_manager.cc:1397] T c659a9caa8854a518b3aaddf7eaf766e P b66fbb161bcd42d7b12790a331b94268: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260811 15:07:34.193727 10333 ts_tablet_manager.cc:1397] T c659a9caa8854a518b3aaddf7eaf766e P 009a6eb0d6b0482fb4cd9e2ebb880b15: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260811 15:07:34.194190 10334 tablet_bootstrap.cc:492] T c659a9caa8854a518b3aaddf7eaf766e P 2f27358a321d45a8ab3e1ea9348e433b: No bootstrap required, opened a new log
I20260811 15:07:34.194380 10334 ts_tablet_manager.cc:1397] T c659a9caa8854a518b3aaddf7eaf766e P 2f27358a321d45a8ab3e1ea9348e433b: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260811 15:07:34.197188 10334 raft_consensus.cc:348] T c659a9caa8854a518b3aaddf7eaf766e P 2f27358a321d45a8ab3e1ea9348e433b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b66fbb161bcd42d7b12790a331b94268" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 36607 } } peers { permanent_uuid: "2f27358a321d45a8ab3e1ea9348e433b" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 32901 } } peers { permanent_uuid: "009a6eb0d6b0482fb4cd9e2ebb880b15" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 41177 } }
I20260811 15:07:34.197429 10334 raft_consensus.cc:374] T c659a9caa8854a518b3aaddf7eaf766e P 2f27358a321d45a8ab3e1ea9348e433b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:07:34.197484 10334 raft_consensus.cc:729] T c659a9caa8854a518b3aaddf7eaf766e P 2f27358a321d45a8ab3e1ea9348e433b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f27358a321d45a8ab3e1ea9348e433b, State: Initialized, Role: FOLLOWER
I20260811 15:07:34.197759 10332 raft_consensus.cc:348] T c659a9caa8854a518b3aaddf7eaf766e P b66fbb161bcd42d7b12790a331b94268 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b66fbb161bcd42d7b12790a331b94268" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 36607 } } peers { permanent_uuid: "2f27358a321d45a8ab3e1ea9348e433b" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 32901 } } peers { permanent_uuid: "009a6eb0d6b0482fb4cd9e2ebb880b15" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 41177 } }
I20260811 15:07:34.198009 10332 raft_consensus.cc:374] T c659a9caa8854a518b3aaddf7eaf766e P b66fbb161bcd42d7b12790a331b94268 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:07:34.197953 10334 consensus_queue.cc:260] T c659a9caa8854a518b3aaddf7eaf766e P 2f27358a321d45a8ab3e1ea9348e433b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b66fbb161bcd42d7b12790a331b94268" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 36607 } } peers { permanent_uuid: "2f27358a321d45a8ab3e1ea9348e433b" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 32901 } } peers { permanent_uuid: "009a6eb0d6b0482fb4cd9e2ebb880b15" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 41177 } }
I20260811 15:07:34.198061 10332 raft_consensus.cc:729] T c659a9caa8854a518b3aaddf7eaf766e P b66fbb161bcd42d7b12790a331b94268 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b66fbb161bcd42d7b12790a331b94268, State: Initialized, Role: FOLLOWER
I20260811 15:07:34.198186 10333 raft_consensus.cc:348] T c659a9caa8854a518b3aaddf7eaf766e P 009a6eb0d6b0482fb4cd9e2ebb880b15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b66fbb161bcd42d7b12790a331b94268" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 36607 } } peers { permanent_uuid: "2f27358a321d45a8ab3e1ea9348e433b" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 32901 } } peers { permanent_uuid: "009a6eb0d6b0482fb4cd9e2ebb880b15" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 41177 } }
I20260811 15:07:34.198423 10333 raft_consensus.cc:374] T c659a9caa8854a518b3aaddf7eaf766e P 009a6eb0d6b0482fb4cd9e2ebb880b15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:07:34.198480 10333 raft_consensus.cc:729] T c659a9caa8854a518b3aaddf7eaf766e P 009a6eb0d6b0482fb4cd9e2ebb880b15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 009a6eb0d6b0482fb4cd9e2ebb880b15, State: Initialized, Role: FOLLOWER
I20260811 15:07:34.198521 10332 consensus_queue.cc:260] T c659a9caa8854a518b3aaddf7eaf766e P b66fbb161bcd42d7b12790a331b94268 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b66fbb161bcd42d7b12790a331b94268" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 36607 } } peers { permanent_uuid: "2f27358a321d45a8ab3e1ea9348e433b" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 32901 } } peers { permanent_uuid: "009a6eb0d6b0482fb4cd9e2ebb880b15" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 41177 } }
I20260811 15:07:34.198911 10333 consensus_queue.cc:260] T c659a9caa8854a518b3aaddf7eaf766e P 009a6eb0d6b0482fb4cd9e2ebb880b15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b66fbb161bcd42d7b12790a331b94268" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 36607 } } peers { permanent_uuid: "2f27358a321d45a8ab3e1ea9348e433b" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 32901 } } peers { permanent_uuid: "009a6eb0d6b0482fb4cd9e2ebb880b15" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 41177 } }
I20260811 15:07:34.199030 10334 ts_tablet_manager.cc:1428] T c659a9caa8854a518b3aaddf7eaf766e P 2f27358a321d45a8ab3e1ea9348e433b: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260811 15:07:34.199425 10313 heartbeater.cc:503] Master 127.19.236.126:37011 was elected leader, sending a full tablet report...
I20260811 15:07:34.199584 10011 heartbeater.cc:503] Master 127.19.236.126:37011 was elected leader, sending a full tablet report...
I20260811 15:07:34.199819 10333 ts_tablet_manager.cc:1428] T c659a9caa8854a518b3aaddf7eaf766e P 009a6eb0d6b0482fb4cd9e2ebb880b15: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260811 15:07:34.200533 10332 ts_tablet_manager.cc:1428] T c659a9caa8854a518b3aaddf7eaf766e P b66fbb161bcd42d7b12790a331b94268: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260811 15:07:34.200922 10164 heartbeater.cc:503] Master 127.19.236.126:37011 was elected leader, sending a full tablet report...
W20260811 15:07:34.368467 10314 tablet.cc:2369] T c659a9caa8854a518b3aaddf7eaf766e P 2f27358a321d45a8ab3e1ea9348e433b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 15:07:34.379390 10165 tablet.cc:2369] T c659a9caa8854a518b3aaddf7eaf766e P b66fbb161bcd42d7b12790a331b94268: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 15:07:34.394565 10012 tablet.cc:2369] T c659a9caa8854a518b3aaddf7eaf766e P 009a6eb0d6b0482fb4cd9e2ebb880b15: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 15:07:34.541033 10340 raft_consensus.cc:482] T c659a9caa8854a518b3aaddf7eaf766e P 009a6eb0d6b0482fb4cd9e2ebb880b15 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 15:07:34.541306 10340 raft_consensus.cc:504] T c659a9caa8854a518b3aaddf7eaf766e P 009a6eb0d6b0482fb4cd9e2ebb880b15 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b66fbb161bcd42d7b12790a331b94268" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 36607 } } peers { permanent_uuid: "2f27358a321d45a8ab3e1ea9348e433b" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 32901 } } peers { permanent_uuid: "009a6eb0d6b0482fb4cd9e2ebb880b15" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 41177 } }
I20260811 15:07:34.542552 10340 leader_election.cc:288] T c659a9caa8854a518b3aaddf7eaf766e P 009a6eb0d6b0482fb4cd9e2ebb880b15 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b66fbb161bcd42d7b12790a331b94268 (127.19.236.66:36607), 2f27358a321d45a8ab3e1ea9348e433b (127.19.236.67:32901)
I20260811 15:07:34.546638 10327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:34.542885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.65:49037 (local address 127.19.236.66:36607)
0811 15:07:34.543033 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:34.543039 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:34.543332 (+ 293us) server_negotiation.cc:407] Connection header received
0811 15:07:34.543468 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:34.543472 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:34.543525 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:34.543608 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:07:34.543915 (+ 307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:34.544439 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:34.545595 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:34.546018 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:34.546136 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:34.546194 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:34.546410 (+ 216us) server_negotiation.cc:299] Negotiation successful
0811 15:07:34.546492 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 15:07:34.546666 10330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:34.543014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.65:59447 (local address 127.19.236.67:32901)
0811 15:07:34.543157 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:34.543162 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:34.543373 (+ 211us) server_negotiation.cc:407] Connection header received
0811 15:07:34.543469 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:34.543472 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:34.543522 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:34.543605 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:07:34.543943 (+ 338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:34.544439 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:34.545587 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:34.545989 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:34.546148 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:34.546200 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:34.546465 (+ 265us) server_negotiation.cc:299] Negotiation successful
0811 15:07:34.546543 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 15:07:34.546707 10342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:34.542885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.67:32901 (local address 127.19.236.65:59447)
0811 15:07:34.543234 (+ 349us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:34.543245 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 15:07:34.543372 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:07:34.543623 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:07:34.543626 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:07:34.543659 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:07:34.543824 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:34.543829 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:34.544580 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:34.544583 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:34.545458 (+ 875us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:34.545467 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:34.546158 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:34.546163 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:34.546312 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:34.546330 (+ 18us) client_negotiation.cc:769] Sending connection context
0811 15:07:34.546420 (+ 90us) client_negotiation.cc:240] Negotiation successful
0811 15:07:34.546491 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":288,"mutex_wait_us":48,"spinlock_wait_cycles":3200,"thread_start_us":162,"threads_started":1}
I20260811 15:07:34.546890 10341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:34.542804 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.66:36607 (local address 127.19.236.65:49037)
0811 15:07:34.543230 (+ 426us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:34.543243 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 15:07:34.543345 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:07:34.543621 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:07:34.543624 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:07:34.543651 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:07:34.543802 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:34.543808 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:34.544577 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:34.544581 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:34.545468 (+ 887us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:34.545476 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:34.546130 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:34.546134 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:34.546233 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:34.546281 (+ 48us) client_negotiation.cc:769] Sending connection context
0811 15:07:34.546375 (+ 94us) client_negotiation.cc:240] Negotiation successful
0811 15:07:34.546485 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":340,"mutex_wait_us":39,"spinlock_wait_cycles":2944,"thread_start_us":120,"threads_started":1}
I20260811 15:07:34.547638 10108 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c659a9caa8854a518b3aaddf7eaf766e" candidate_uuid: "009a6eb0d6b0482fb4cd9e2ebb880b15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b66fbb161bcd42d7b12790a331b94268" is_pre_election: true
I20260811 15:07:34.547617 10258 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c659a9caa8854a518b3aaddf7eaf766e" candidate_uuid: "009a6eb0d6b0482fb4cd9e2ebb880b15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f27358a321d45a8ab3e1ea9348e433b" is_pre_election: true
I20260811 15:07:34.547966 10258 raft_consensus.cc:2454] T c659a9caa8854a518b3aaddf7eaf766e P 2f27358a321d45a8ab3e1ea9348e433b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 009a6eb0d6b0482fb4cd9e2ebb880b15 in term 0.
I20260811 15:07:34.547968 10108 raft_consensus.cc:2454] T c659a9caa8854a518b3aaddf7eaf766e P b66fbb161bcd42d7b12790a331b94268 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 009a6eb0d6b0482fb4cd9e2ebb880b15 in term 0.
I20260811 15:07:34.548573 9888 leader_election.cc:302] T c659a9caa8854a518b3aaddf7eaf766e P 009a6eb0d6b0482fb4cd9e2ebb880b15 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 009a6eb0d6b0482fb4cd9e2ebb880b15, 2f27358a321d45a8ab3e1ea9348e433b, b66fbb161bcd42d7b12790a331b94268; no voters:
I20260811 15:07:34.548885 10340 raft_consensus.cc:2781] T c659a9caa8854a518b3aaddf7eaf766e P 009a6eb0d6b0482fb4cd9e2ebb880b15 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 15:07:34.548986 10340 raft_consensus.cc:482] T c659a9caa8854a518b3aaddf7eaf766e P 009a6eb0d6b0482fb4cd9e2ebb880b15 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 15:07:34.549063 10340 raft_consensus.cc:3037] T c659a9caa8854a518b3aaddf7eaf766e P 009a6eb0d6b0482fb4cd9e2ebb880b15 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:07:34.550189 10340 raft_consensus.cc:504] T c659a9caa8854a518b3aaddf7eaf766e P 009a6eb0d6b0482fb4cd9e2ebb880b15 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b66fbb161bcd42d7b12790a331b94268" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 36607 } } peers { permanent_uuid: "2f27358a321d45a8ab3e1ea9348e433b" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 32901 } } peers { permanent_uuid: "009a6eb0d6b0482fb4cd9e2ebb880b15" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 41177 } }
I20260811 15:07:34.550549 10340 leader_election.cc:288] T c659a9caa8854a518b3aaddf7eaf766e P 009a6eb0d6b0482fb4cd9e2ebb880b15 [CANDIDATE]: Term 1 election: Requested vote from peers b66fbb161bcd42d7b12790a331b94268 (127.19.236.66:36607), 2f27358a321d45a8ab3e1ea9348e433b (127.19.236.67:32901)
I20260811 15:07:34.550935 10108 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c659a9caa8854a518b3aaddf7eaf766e" candidate_uuid: "009a6eb0d6b0482fb4cd9e2ebb880b15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b66fbb161bcd42d7b12790a331b94268"
I20260811 15:07:34.551064 10108 raft_consensus.cc:3037] T c659a9caa8854a518b3aaddf7eaf766e P b66fbb161bcd42d7b12790a331b94268 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:07:34.552163 10108 raft_consensus.cc:2454] T c659a9caa8854a518b3aaddf7eaf766e P b66fbb161bcd42d7b12790a331b94268 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 009a6eb0d6b0482fb4cd9e2ebb880b15 in term 1.
I20260811 15:07:34.552500 9888 leader_election.cc:302] T c659a9caa8854a518b3aaddf7eaf766e P 009a6eb0d6b0482fb4cd9e2ebb880b15 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 009a6eb0d6b0482fb4cd9e2ebb880b15, b66fbb161bcd42d7b12790a331b94268; no voters:
I20260811 15:07:34.552475 10258 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c659a9caa8854a518b3aaddf7eaf766e" candidate_uuid: "009a6eb0d6b0482fb4cd9e2ebb880b15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f27358a321d45a8ab3e1ea9348e433b"
I20260811 15:07:34.552647 10258 raft_consensus.cc:3037] T c659a9caa8854a518b3aaddf7eaf766e P 2f27358a321d45a8ab3e1ea9348e433b [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:07:34.552729 10340 raft_consensus.cc:2781] T c659a9caa8854a518b3aaddf7eaf766e P 009a6eb0d6b0482fb4cd9e2ebb880b15 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:07:34.553026 10340 raft_consensus.cc:686] T c659a9caa8854a518b3aaddf7eaf766e P 009a6eb0d6b0482fb4cd9e2ebb880b15 [term 1 LEADER]: Becoming Leader. State: Replica: 009a6eb0d6b0482fb4cd9e2ebb880b15, State: Running, Role: LEADER
I20260811 15:07:34.553409 10340 consensus_queue.cc:237] T c659a9caa8854a518b3aaddf7eaf766e P 009a6eb0d6b0482fb4cd9e2ebb880b15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b66fbb161bcd42d7b12790a331b94268" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 36607 } } peers { permanent_uuid: "2f27358a321d45a8ab3e1ea9348e433b" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 32901 } } peers { permanent_uuid: "009a6eb0d6b0482fb4cd9e2ebb880b15" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 41177 } }
I20260811 15:07:34.553870 10258 raft_consensus.cc:2454] T c659a9caa8854a518b3aaddf7eaf766e P 2f27358a321d45a8ab3e1ea9348e433b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 009a6eb0d6b0482fb4cd9e2ebb880b15 in term 1.
I20260811 15:07:34.556814 9798 catalog_manager.cc:5495] T c659a9caa8854a518b3aaddf7eaf766e P 009a6eb0d6b0482fb4cd9e2ebb880b15 reported cstate change: term changed from 0 to 1, leader changed from <none> to 009a6eb0d6b0482fb4cd9e2ebb880b15 (127.19.236.65). New cstate: current_term: 1 leader_uuid: "009a6eb0d6b0482fb4cd9e2ebb880b15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b66fbb161bcd42d7b12790a331b94268" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 36607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f27358a321d45a8ab3e1ea9348e433b" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 32901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "009a6eb0d6b0482fb4cd9e2ebb880b15" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 41177 } health_report { overall_health: HEALTHY } } }
I20260811 15:07:34.627310 10331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:34.623625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41272 (local address 127.19.236.65:41177)
0811 15:07:34.623768 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:34.623772 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:34.623790 (+ 18us) server_negotiation.cc:407] Connection header received
0811 15:07:34.623933 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:34.623935 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:34.623995 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:34.624092 (+ 97us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 15:07:34.624410 (+ 318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:34.624951 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:34.625775 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:34.626013 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:34.626096 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:34.626430 (+ 334us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 15:07:34.626877 (+ 447us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 15:07:34.626979 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:34.627060 (+ 81us) server_negotiation.cc:299] Negotiation successful
0811 15:07:34.627121 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 15:07:34.633553 10258 raft_consensus.cc:1261] T c659a9caa8854a518b3aaddf7eaf766e P 2f27358a321d45a8ab3e1ea9348e433b [term 1 FOLLOWER]: Refusing update from remote peer 009a6eb0d6b0482fb4cd9e2ebb880b15: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:07:34.633567 10108 raft_consensus.cc:1261] T c659a9caa8854a518b3aaddf7eaf766e P b66fbb161bcd42d7b12790a331b94268 [term 1 FOLLOWER]: Refusing update from remote peer 009a6eb0d6b0482fb4cd9e2ebb880b15: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:07:34.634246 10343 consensus_queue.cc:1035] T c659a9caa8854a518b3aaddf7eaf766e P 009a6eb0d6b0482fb4cd9e2ebb880b15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f27358a321d45a8ab3e1ea9348e433b" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 32901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:07:34.634454 10340 consensus_queue.cc:1035] T c659a9caa8854a518b3aaddf7eaf766e P 009a6eb0d6b0482fb4cd9e2ebb880b15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b66fbb161bcd42d7b12790a331b94268" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 36607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:07:34.648689 10348 mvcc.cc:205] Tried to move back new op lower bound from 7317343660571033600 to 7317343660253687808. Current Snapshot: MvccSnapshot[applied={T|T < 7317343660571033600}]
I20260811 15:07:34.650358 9797 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58486:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 15:07:34.650537 9797 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58486:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 15:07:34.653195 9797 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 87d50ec3196f4361b24cca9aa1d717d1: Sending DeleteTablet for 3 replicas of tablet c659a9caa8854a518b3aaddf7eaf766e
I20260811 15:07:34.654124 10087 tablet_service.cc:1514] Processing DeleteTablet for tablet c659a9caa8854a518b3aaddf7eaf766e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:07:34 UTC) from {username='kudu', principal='kudu/127.19.236.126@KRBTEST.COM'} at 127.0.0.1:53216
I20260811 15:07:34.654117 10235 tablet_service.cc:1514] Processing DeleteTablet for tablet c659a9caa8854a518b3aaddf7eaf766e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:07:34 UTC) from {username='kudu', principal='kudu/127.19.236.126@KRBTEST.COM'} at 127.0.0.1:46860
I20260811 15:07:34.654922 9936 tablet_service.cc:1514] Processing DeleteTablet for tablet c659a9caa8854a518b3aaddf7eaf766e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:07:34 UTC) from {username='kudu', principal='kudu/127.19.236.126@KRBTEST.COM'} at 127.0.0.1:41268
I20260811 15:07:34.655380 10359 tablet_replica.cc:330] T c659a9caa8854a518b3aaddf7eaf766e P 009a6eb0d6b0482fb4cd9e2ebb880b15: stopping tablet replica
I20260811 15:07:34.655723 10359 raft_consensus.cc:2229] T c659a9caa8854a518b3aaddf7eaf766e P 009a6eb0d6b0482fb4cd9e2ebb880b15 [term 1 LEADER]: Raft consensus shutting down.
I20260811 15:07:34.656106 10359 raft_consensus.cc:2258] T c659a9caa8854a518b3aaddf7eaf766e P 009a6eb0d6b0482fb4cd9e2ebb880b15 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:07:34.656200 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 9869
I20260811 15:07:34.657044 10358 tablet_replica.cc:330] T c659a9caa8854a518b3aaddf7eaf766e P b66fbb161bcd42d7b12790a331b94268: stopping tablet replica
I20260811 15:07:34.657311 10358 raft_consensus.cc:2229] T c659a9caa8854a518b3aaddf7eaf766e P b66fbb161bcd42d7b12790a331b94268 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 15:07:34.657608 10358 raft_consensus.cc:2258] T c659a9caa8854a518b3aaddf7eaf766e P b66fbb161bcd42d7b12790a331b94268 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:07:34.658013 10357 tablet_replica.cc:330] T c659a9caa8854a518b3aaddf7eaf766e P 2f27358a321d45a8ab3e1ea9348e433b: stopping tablet replica
I20260811 15:07:34.658306 10357 raft_consensus.cc:2229] T c659a9caa8854a518b3aaddf7eaf766e P 2f27358a321d45a8ab3e1ea9348e433b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 15:07:34.658699 10357 raft_consensus.cc:2258] T c659a9caa8854a518b3aaddf7eaf766e P 2f27358a321d45a8ab3e1ea9348e433b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:07:34.660497 10357 ts_tablet_manager.cc:1905] T c659a9caa8854a518b3aaddf7eaf766e P 2f27358a321d45a8ab3e1ea9348e433b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 15:07:34.660497 10358 ts_tablet_manager.cc:1905] T c659a9caa8854a518b3aaddf7eaf766e P b66fbb161bcd42d7b12790a331b94268: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 15:07:34.663348 10357 ts_tablet_manager.cc:1918] T c659a9caa8854a518b3aaddf7eaf766e P 2f27358a321d45a8ab3e1ea9348e433b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 15:07:34.663342 10358 ts_tablet_manager.cc:1918] T c659a9caa8854a518b3aaddf7eaf766e P b66fbb161bcd42d7b12790a331b94268: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 15:07:34.663450 10358 log.cc:1196] T c659a9caa8854a518b3aaddf7eaf766e P b66fbb161bcd42d7b12790a331b94268: Deleting WAL directory at /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/minicluster-data/ts-1/wal/wals/c659a9caa8854a518b3aaddf7eaf766e
I20260811 15:07:34.663450 10357 log.cc:1196] T c659a9caa8854a518b3aaddf7eaf766e P 2f27358a321d45a8ab3e1ea9348e433b: Deleting WAL directory at /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786460596631409-20401-0/minicluster-data/ts-2/wal/wals/c659a9caa8854a518b3aaddf7eaf766e
I20260811 15:07:34.663789 10358 ts_tablet_manager.cc:1939] T c659a9caa8854a518b3aaddf7eaf766e P b66fbb161bcd42d7b12790a331b94268: Deleting consensus metadata
I20260811 15:07:34.663789 10357 ts_tablet_manager.cc:1939] T c659a9caa8854a518b3aaddf7eaf766e P 2f27358a321d45a8ab3e1ea9348e433b: Deleting consensus metadata
I20260811 15:07:34.665132 9781 catalog_manager.cc:4841] TS 2f27358a321d45a8ab3e1ea9348e433b (127.19.236.67:32901): tablet c659a9caa8854a518b3aaddf7eaf766e (table test-table [id=b3c018ce2c0f4254b84a9ab172df5208]) successfully deleted
I20260811 15:07:34.665220 9783 catalog_manager.cc:4841] TS b66fbb161bcd42d7b12790a331b94268 (127.19.236.66:36607): tablet c659a9caa8854a518b3aaddf7eaf766e (table test-table [id=b3c018ce2c0f4254b84a9ab172df5208]) successfully deleted
W20260811 15:07:34.666422 9780 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.19.236.65:41177 (error 108)
I20260811 15:07:34.667280 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 10017
I20260811 15:07:34.667462 10325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:34.667154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.65:41177 (local address 127.0.0.1:41288)
0811 15:07:34.667272 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:34.667363 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.65:41177: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260811 15:07:34.672796 9780 catalog_manager.cc:4584] TS 009a6eb0d6b0482fb4cd9e2ebb880b15 (127.19.236.65:41177): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c659a9caa8854a518b3aaddf7eaf766e: Network error: Client connection negotiation failed: client connection to 127.19.236.65:41177: connect: Connection refused (error 111)
I20260811 15:07:34.676079 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 10169
I20260811 15:07:34.685158 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 9761
2026-08-11T15:07:34Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2757 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-11T15:07:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T15:07:34Z Disabled control of system clock
I20260811 15:07:34.718650 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460596631409-20401-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460596631409-20401-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460596631409-20401-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:42161
--webserver_interface=127.19.236.126
--webserver_port=0
--builtin_ntp_servers=127.19.236.84:42049
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.236.126:42161
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 15:07:34.832192 10364 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:07:34.832471 10364 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:07:34.832507 10364 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:07:34.836483 10364 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:07:34.836539 10364 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:07:34.836570 10364 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:07:34.836591 10364 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:07:34.836606 10364 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:07:34.841315 10364 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:42049
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460596631409-20401-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460596631409-20401-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.236.126:42161
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:42161
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.236.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10364
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460596631409-20401-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:07:34.842370 10364 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:07:34.843734 10364 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:07:34.852238 10369 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:07:34.852240 10370 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:07:34.852240 10372 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:07:34.852370 10364 server_base.cc:1034] running on GCE node
I20260811 15:07:34.853101 10364 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:07:34.854172 10364 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:07:34.855356 10364 hybrid_clock.cc:648] HybridClock initialized: now 1786460854855328 us; error 39 us; skew 500 ppm
I20260811 15:07:34.861130 10364 webserver.cc:460] Webserver started at http://127.19.236.126:34699/ using document root <none> and password file <none>
I20260811 15:07:34.861754 10364 fs_manager.cc:359] Metadata directory not provided
I20260811 15:07:34.861850 10364 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:07:34.862198 10364 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:07:34.864442 10364 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460596631409-20401-0/minicluster-data/master-0/data/instance:
uuid: "d8b391f501294d2f9b8dc4cf98a6f3ee"
format_stamp: "Formatted at 2026-08-11 15:07:34 on dist-test-slave-8n49"
server_key: "115ae6b15befd7d9ae290dd3a3b75e45"
server_key_iv: "bfaa6f5c00562be437bc7dfb2cff150f"
server_key_version: "encryptionkey@0"
I20260811 15:07:34.865089 10364 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460596631409-20401-0/minicluster-data/master-0/wal/instance:
uuid: "d8b391f501294d2f9b8dc4cf98a6f3ee"
format_stamp: "Formatted at 2026-08-11 15:07:34 on dist-test-slave-8n49"
server_key: "115ae6b15befd7d9ae290dd3a3b75e45"
server_key_iv: "bfaa6f5c00562be437bc7dfb2cff150f"
server_key_version: "encryptionkey@0"
I20260811 15:07:34.868811 10364 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 15:07:34.871207 10378 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:07:34.872545 10364 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 15:07:34.872745 10364 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460596631409-20401-0/minicluster-data/master-0/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460596631409-20401-0/minicluster-data/master-0/wal
uuid: "d8b391f501294d2f9b8dc4cf98a6f3ee"
format_stamp: "Formatted at 2026-08-11 15:07:34 on dist-test-slave-8n49"
server_key: "115ae6b15befd7d9ae290dd3a3b75e45"
server_key_iv: "bfaa6f5c00562be437bc7dfb2cff150f"
server_key_version: "encryptionkey@0"
I20260811 15:07:34.872867 10364 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460596631409-20401-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460596631409-20401-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460596631409-20401-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:07:34.886246 10364 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:07:34.886994 10364 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:07:34.887210 10364 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:07:34.894335 10364 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.126:42161
I20260811 15:07:34.894352 10434 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.126:42161 every 8 connection(s)
I20260811 15:07:34.895381 10364 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
I20260811 15:07:34.898533 10435 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:07:34.904115 10435 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d8b391f501294d2f9b8dc4cf98a6f3ee: Bootstrap starting.
I20260811 15:07:34.904711 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 10364
I20260811 15:07:34.904847 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460596631409-20401-0/minicluster-data/master-0/wal/instance
I20260811 15:07:34.905154 20401 external_mini_cluster.cc:1428] Setting key 3b70cc9b71c5fdf3840327f9899d746f
I20260811 15:07:34.907164 10435 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d8b391f501294d2f9b8dc4cf98a6f3ee: Neither blocks nor log segments found. Creating new log.
I20260811 15:07:34.907907 10435 log.cc:824] T 00000000000000000000000000000000 P d8b391f501294d2f9b8dc4cf98a6f3ee: Log is configured to *not* fsync() on all Append() calls
I20260811 15:07:34.909966 10435 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d8b391f501294d2f9b8dc4cf98a6f3ee: No bootstrap required, opened a new log
I20260811 15:07:34.913748 10435 raft_consensus.cc:348] T 00000000000000000000000000000000 P d8b391f501294d2f9b8dc4cf98a6f3ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8b391f501294d2f9b8dc4cf98a6f3ee" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 42161 } }
I20260811 15:07:34.914031 10435 raft_consensus.cc:374] T 00000000000000000000000000000000 P d8b391f501294d2f9b8dc4cf98a6f3ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:07:34.914124 10435 raft_consensus.cc:729] T 00000000000000000000000000000000 P d8b391f501294d2f9b8dc4cf98a6f3ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8b391f501294d2f9b8dc4cf98a6f3ee, State: Initialized, Role: FOLLOWER
I20260811 15:07:34.914582 10435 consensus_queue.cc:260] T 00000000000000000000000000000000 P d8b391f501294d2f9b8dc4cf98a6f3ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8b391f501294d2f9b8dc4cf98a6f3ee" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 42161 } }
I20260811 15:07:34.914738 10435 raft_consensus.cc:388] T 00000000000000000000000000000000 P d8b391f501294d2f9b8dc4cf98a6f3ee [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 15:07:34.914825 10435 raft_consensus.cc:482] T 00000000000000000000000000000000 P d8b391f501294d2f9b8dc4cf98a6f3ee [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 15:07:34.914940 10435 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d8b391f501294d2f9b8dc4cf98a6f3ee [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:07:34.915052 10438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:34.906615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42120 (local address 127.19.236.126:42161)
0811 15:07:34.907316 (+ 701us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:34.907337 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:34.907374 (+ 37us) server_negotiation.cc:407] Connection header received
0811 15:07:34.908024 (+ 650us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:34.908052 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:34.908532 (+ 480us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:34.908945 (+ 413us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:07:34.909376 (+ 431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:34.910426 (+ 1050us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:34.911302 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:34.911783 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:34.911951 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:34.913056 (+ 1105us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:07:34.913061 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:07:34.913074 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:07:34.913456 (+ 382us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:07:34.913516 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:07:34.913537 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:07:34.913646 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:34.913792 (+ 146us) server_negotiation.cc:299] Negotiation successful
0811 15:07:34.914086 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":301,"thread_start_us":139,"threads_started":1}
I20260811 15:07:34.916131 10435 raft_consensus.cc:504] T 00000000000000000000000000000000 P d8b391f501294d2f9b8dc4cf98a6f3ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8b391f501294d2f9b8dc4cf98a6f3ee" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 42161 } }
I20260811 15:07:34.916486 10435 leader_election.cc:302] T 00000000000000000000000000000000 P d8b391f501294d2f9b8dc4cf98a6f3ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d8b391f501294d2f9b8dc4cf98a6f3ee; no voters:
I20260811 15:07:34.917380 10435 leader_election.cc:288] T 00000000000000000000000000000000 P d8b391f501294d2f9b8dc4cf98a6f3ee [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 15:07:34.917589 10440 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d8b391f501294d2f9b8dc4cf98a6f3ee [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:07:34.917826 10440 raft_consensus.cc:686] T 00000000000000000000000000000000 P d8b391f501294d2f9b8dc4cf98a6f3ee [term 1 LEADER]: Becoming Leader. State: Replica: d8b391f501294d2f9b8dc4cf98a6f3ee, State: Running, Role: LEADER
I20260811 15:07:34.918138 10440 consensus_queue.cc:237] T 00000000000000000000000000000000 P d8b391f501294d2f9b8dc4cf98a6f3ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8b391f501294d2f9b8dc4cf98a6f3ee" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 42161 } }
I20260811 15:07:34.918638 10435 sys_catalog.cc:564] T 00000000000000000000000000000000 P d8b391f501294d2f9b8dc4cf98a6f3ee [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:07:34.919845 10441 sys_catalog.cc:455] T 00000000000000000000000000000000 P d8b391f501294d2f9b8dc4cf98a6f3ee [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d8b391f501294d2f9b8dc4cf98a6f3ee" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8b391f501294d2f9b8dc4cf98a6f3ee" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 42161 } } }
I20260811 15:07:34.919878 10442 sys_catalog.cc:455] T 00000000000000000000000000000000 P d8b391f501294d2f9b8dc4cf98a6f3ee [sys.catalog]: SysCatalogTable state changed. Reason: New leader d8b391f501294d2f9b8dc4cf98a6f3ee. Latest consensus state: current_term: 1 leader_uuid: "d8b391f501294d2f9b8dc4cf98a6f3ee" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8b391f501294d2f9b8dc4cf98a6f3ee" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 42161 } } }
I20260811 15:07:34.920089 10442 sys_catalog.cc:458] T 00000000000000000000000000000000 P d8b391f501294d2f9b8dc4cf98a6f3ee [sys.catalog]: This master's current role is: LEADER
I20260811 15:07:34.920037 10441 sys_catalog.cc:458] T 00000000000000000000000000000000 P d8b391f501294d2f9b8dc4cf98a6f3ee [sys.catalog]: This master's current role is: LEADER
I20260811 15:07:34.920545 10452 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:07:34.923432 10452 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:07:34.928506 10452 catalog_manager.cc:1347] Generated new cluster ID: 46f08d5a1eb4462d99678ec2d90167ef
I20260811 15:07:34.928635 10452 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:07:34.946038 10452 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 15:07:34.947014 10452 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:07:34.955690 10452 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d8b391f501294d2f9b8dc4cf98a6f3ee: Generated new TSK 0
I20260811 15:07:34.956413 10452 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 15:07:34.969653 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460596631409-20401-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460596631409-20401-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460596631409-20401-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.65:0
--local_ip_for_outbound_sockets=127.19.236.65
--webserver_interface=127.19.236.65
--webserver_port=0
--tserver_master_addrs=127.19.236.126:42161
--builtin_ntp_servers=127.19.236.84:42049
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 15:07:35.085911 10463 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:07:35.086207 10463 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:07:35.086247 10463 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:07:35.090401 10463 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:07:35.090466 10463 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:07:35.090567 10463 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.65
I20260811 15:07:35.095427 10463 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:42049
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460596631409-20401-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460596631409-20401-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.236.65
--webserver_port=0
--tserver_master_addrs=127.19.236.126:42161
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10463
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.65
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460596631409-20401-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:07:35.096735 10463 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:07:35.098179 10463 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:07:35.108028 10469 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:07:35.108044 10468 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:07:35.108052 10474 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:07:35.108349 10463 server_base.cc:1034] running on GCE node
I20260811 15:07:35.108809 10463 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:07:35.109463 10463 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:07:35.110656 10463 hybrid_clock.cc:648] HybridClock initialized: now 1786460855110642 us; error 34 us; skew 500 ppm
I20260811 15:07:35.112471 10463 webserver.cc:460] Webserver started at http://127.19.236.65:42707/ using document root <none> and password file <none>
I20260811 15:07:35.113085 10463 fs_manager.cc:359] Metadata directory not provided
I20260811 15:07:35.113176 10463 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:07:35.113387 10463 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:07:35.115504 10463 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460596631409-20401-0/minicluster-data/ts-0/data/instance:
uuid: "6afe7c542d0f488788886155850fa96b"
format_stamp: "Formatted at 2026-08-11 15:07:35 on dist-test-slave-8n49"
server_key: "feb516188d4f6339985521c9fb95966b"
server_key_iv: "c8c3533649661cfe3bb9cbf5b09afa76"
server_key_version: "encryptionkey@0"
I20260811 15:07:35.116086 10463 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460596631409-20401-0/minicluster-data/ts-0/wal/instance:
uuid: "6afe7c542d0f488788886155850fa96b"
format_stamp: "Formatted at 2026-08-11 15:07:35 on dist-test-slave-8n49"
server_key: "feb516188d4f6339985521c9fb95966b"
server_key_iv: "c8c3533649661cfe3bb9cbf5b09afa76"
server_key_version: "encryptionkey@0"
I20260811 15:07:35.120219 10463 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260811 15:07:35.122833 10480 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:07:35.124099 10463 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 15:07:35.124243 10463 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460596631409-20401-0/minicluster-data/ts-0/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460596631409-20401-0/minicluster-data/ts-0/wal
uuid: "6afe7c542d0f488788886155850fa96b"
format_stamp: "Formatted at 2026-08-11 15:07:35 on dist-test-slave-8n49"
server_key: "feb516188d4f6339985521c9fb95966b"
server_key_iv: "c8c3533649661cfe3bb9cbf5b09afa76"
server_key_version: "encryptionkey@0"
I20260811 15:07:35.124361 10463 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460596631409-20401-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460596631409-20401-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460596631409-20401-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:07:35.157305 10463 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:07:35.158033 10463 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:07:35.158231 10463 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:07:35.158849 10463 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:07:35.159940 10463 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:07:35.160008 10463 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:07:35.160079 10463 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:07:35.160123 10463 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:07:35.169060 10463 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.65:37347
I20260811 15:07:35.169081 10605 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.65:37347 every 8 connection(s)
I20260811 15:07:35.169981 10463 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460596631409-20401-0/minicluster-data/ts-0/data/info.pb
I20260811 15:07:35.177529 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 10463
I20260811 15:07:35.177688 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460596631409-20401-0/minicluster-data/ts-0/wal/instance
I20260811 15:07:35.177982 20401 external_mini_cluster.cc:1428] Setting key d49f3c32a7654913b27f0be3d1bfbc41
I20260811 15:07:35.179807 10438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:35.171817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.65:35119 (local address 127.19.236.126:42161)
0811 15:07:35.171964 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:35.171969 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:35.173001 (+ 1032us) server_negotiation.cc:407] Connection header received
0811 15:07:35.174439 (+ 1438us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:35.174442 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:35.174504 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:35.174602 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:07:35.175477 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:35.176078 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:35.177354 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:35.177699 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:35.177829 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:35.179234 (+ 1405us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:07:35.179238 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:07:35.179240 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:07:35.179252 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:07:35.179273 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:07:35.179310 (+ 37us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:07:35.179402 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:35.179600 (+ 198us) server_negotiation.cc:299] Negotiation successful
0811 15:07:35.179661 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 15:07:35.180251 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460596631409-20401-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460596631409-20401-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460596631409-20401-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.66:0
--local_ip_for_outbound_sockets=127.19.236.66
--webserver_interface=127.19.236.66
--webserver_port=0
--tserver_master_addrs=127.19.236.126:42161
--builtin_ntp_servers=127.19.236.84:42049
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 15:07:35.180799 10608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:35.172131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42161 (local address 127.19.236.65:35119)
0811 15:07:35.172850 (+ 719us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:35.172892 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 15:07:35.174202 (+ 1310us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:07:35.174768 (+ 566us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:07:35.174775 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:07:35.174854 (+ 79us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:07:35.175332 (+ 478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:35.175344 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:35.176208 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:35.176212 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:35.177226 (+ 1014us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:35.177242 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:35.177986 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:35.177989 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:35.178193 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:35.178932 (+ 739us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 15:07:35.178934 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:07:35.178985 (+ 51us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 15:07:35.179063 (+ 78us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:07:35.179425 (+ 362us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:07:35.179437 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:07:35.179444 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 15:07:35.179587 (+ 143us) client_negotiation.cc:240] Negotiation successful
0811 15:07:35.179834 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":295,"thread_start_us":119,"threads_started":1}
I20260811 15:07:35.182003 10606 heartbeater.cc:347] Connected to a master server at 127.19.236.126:42161
I20260811 15:07:35.182236 10606 heartbeater.cc:464] Registering TS with master...
I20260811 15:07:35.182754 10606 heartbeater.cc:511] Master 127.19.236.126:42161 requested a full tablet report, sending...
I20260811 15:07:35.184211 10397 ts_manager.cc:194] Registered new tserver with Master: 6afe7c542d0f488788886155850fa96b (127.19.236.65:37347)
I20260811 15:07:35.185420 10397 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.19.236.65:35119
W20260811 15:07:35.294317 10609 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:07:35.294595 10609 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:07:35.294633 10609 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:07:35.298772 10609 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:07:35.298835 10609 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:07:35.298890 10609 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.66
I20260811 15:07:35.304778 10609 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:42049
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460596631409-20401-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460596631409-20401-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.236.66
--webserver_port=0
--tserver_master_addrs=127.19.236.126:42161
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10609
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.66
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460596631409-20401-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:07:35.305884 10609 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:07:35.307375 10609 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:07:35.317286 10617 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:07:35.317437 10609 server_base.cc:1034] running on GCE node
W20260811 15:07:35.317287 10615 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:07:35.317287 10614 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:07:35.318064 10609 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:07:35.318728 10609 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:07:35.319968 10609 hybrid_clock.cc:648] HybridClock initialized: now 1786460855319934 us; error 43 us; skew 500 ppm
I20260811 15:07:35.322069 10609 webserver.cc:460] Webserver started at http://127.19.236.66:44835/ using document root <none> and password file <none>
I20260811 15:07:35.322688 10609 fs_manager.cc:359] Metadata directory not provided
I20260811 15:07:35.322783 10609 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:07:35.323021 10609 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:07:35.325192 10609 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460596631409-20401-0/minicluster-data/ts-1/data/instance:
uuid: "bfb372f04f614d008525d3895c719f63"
format_stamp: "Formatted at 2026-08-11 15:07:35 on dist-test-slave-8n49"
server_key: "b3312e83fcdffece93d387a6472b114e"
server_key_iv: "383d45e5851a2ab0057bffc01c405339"
server_key_version: "encryptionkey@0"
I20260811 15:07:35.325769 10609 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460596631409-20401-0/minicluster-data/ts-1/wal/instance:
uuid: "bfb372f04f614d008525d3895c719f63"
format_stamp: "Formatted at 2026-08-11 15:07:35 on dist-test-slave-8n49"
server_key: "b3312e83fcdffece93d387a6472b114e"
server_key_iv: "383d45e5851a2ab0057bffc01c405339"
server_key_version: "encryptionkey@0"
I20260811 15:07:35.329563 10609 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260811 15:07:35.332146 10623 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:07:35.333554 10609 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 15:07:35.333693 10609 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460596631409-20401-0/minicluster-data/ts-1/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460596631409-20401-0/minicluster-data/ts-1/wal
uuid: "bfb372f04f614d008525d3895c719f63"
format_stamp: "Formatted at 2026-08-11 15:07:35 on dist-test-slave-8n49"
server_key: "b3312e83fcdffece93d387a6472b114e"
server_key_iv: "383d45e5851a2ab0057bffc01c405339"
server_key_version: "encryptionkey@0"
I20260811 15:07:35.333814 10609 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460596631409-20401-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460596631409-20401-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460596631409-20401-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:07:35.346418 10609 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:07:35.347142 10609 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:07:35.347345 10609 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:07:35.347958 10609 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:07:35.349004 10609 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:07:35.349072 10609 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:07:35.349143 10609 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:07:35.349190 10609 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:07:35.358247 10609 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.66:36945
I20260811 15:07:35.358268 10745 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.66:36945 every 8 connection(s)
I20260811 15:07:35.359189 10609 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460596631409-20401-0/minicluster-data/ts-1/data/info.pb
I20260811 15:07:35.367754 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 10609
I20260811 15:07:35.367909 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460596631409-20401-0/minicluster-data/ts-1/wal/instance
I20260811 15:07:35.368289 20401 external_mini_cluster.cc:1428] Setting key 991b04a9d6f5d4e4b9f9ad8c6d013b64
I20260811 15:07:35.368502 10438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:35.361183 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.66:53755 (local address 127.19.236.126:42161)
0811 15:07:35.361340 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:35.361346 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:35.362444 (+ 1098us) server_negotiation.cc:407] Connection header received
0811 15:07:35.363774 (+ 1330us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:35.363777 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:35.363825 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:35.363901 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:07:35.364883 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:35.365405 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:35.366517 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:35.366721 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:35.366800 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:35.367926 (+ 1126us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:07:35.367930 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:07:35.367932 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:07:35.367958 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:07:35.367984 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:07:35.367996 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:07:35.368064 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:35.368254 (+ 190us) server_negotiation.cc:299] Negotiation successful
0811 15:07:35.368308 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 15:07:35.369601 10748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:35.361644 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42161 (local address 127.19.236.66:53755)
0811 15:07:35.362290 (+ 646us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:35.362331 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 15:07:35.363595 (+ 1264us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:07:35.364068 (+ 473us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:07:35.364074 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:07:35.364154 (+ 80us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:07:35.364743 (+ 589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:35.364761 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:35.365513 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:35.365516 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:35.366402 (+ 886us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:35.366411 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:35.366856 (+ 445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:35.366858 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:35.367006 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:35.367592 (+ 586us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 15:07:35.367595 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:07:35.367651 (+ 56us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 15:07:35.367739 (+ 88us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:07:35.368081 (+ 342us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:07:35.368093 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:07:35.368101 (+ 8us) client_negotiation.cc:769] Sending connection context
0811 15:07:35.368237 (+ 136us) client_negotiation.cc:240] Negotiation successful
0811 15:07:35.368527 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":268,"thread_start_us":116,"threads_started":1}
I20260811 15:07:35.370868 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460596631409-20401-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460596631409-20401-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460596631409-20401-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.236.67:0
--local_ip_for_outbound_sockets=127.19.236.67
--webserver_interface=127.19.236.67
--webserver_port=0
--tserver_master_addrs=127.19.236.126:42161
--builtin_ntp_servers=127.19.236.84:42049
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 15:07:35.373617 10746 heartbeater.cc:347] Connected to a master server at 127.19.236.126:42161
I20260811 15:07:35.373893 10746 heartbeater.cc:464] Registering TS with master...
I20260811 15:07:35.374511 10746 heartbeater.cc:511] Master 127.19.236.126:42161 requested a full tablet report, sending...
I20260811 15:07:35.375722 10397 ts_manager.cc:194] Registered new tserver with Master: bfb372f04f614d008525d3895c719f63 (127.19.236.66:36945)
I20260811 15:07:35.376642 10397 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.19.236.66:53755
W20260811 15:07:35.486392 10749 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:07:35.486660 10749 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:07:35.486698 10749 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:07:35.490617 10749 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:07:35.490661 10749 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:07:35.490716 10749 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.236.67
I20260811 15:07:35.495324 10749 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:42049
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460596631409-20401-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460596631409-20401-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.236.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.236.67
--webserver_port=0
--tserver_master_addrs=127.19.236.126:42161
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10749
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.236.67
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460596631409-20401-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:07:35.496343 10749 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:07:35.497713 10749 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:07:35.507426 10754 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:07:35.507427 10755 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:07:35.507422 10758 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:07:35.507565 10749 server_base.cc:1034] running on GCE node
I20260811 15:07:35.508145 10749 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:07:35.508899 10749 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:07:35.510082 10749 hybrid_clock.cc:648] HybridClock initialized: now 1786460855510059 us; error 34 us; skew 500 ppm
I20260811 15:07:35.511948 10749 webserver.cc:460] Webserver started at http://127.19.236.67:44427/ using document root <none> and password file <none>
I20260811 15:07:35.512615 10749 fs_manager.cc:359] Metadata directory not provided
I20260811 15:07:35.512707 10749 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:07:35.512946 10749 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:07:35.515036 10749 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460596631409-20401-0/minicluster-data/ts-2/data/instance:
uuid: "0e2b2bc06f394f23998cd5a637ec3097"
format_stamp: "Formatted at 2026-08-11 15:07:35 on dist-test-slave-8n49"
server_key: "a09b4a8f1e5f598b69ae3a18878b07cd"
server_key_iv: "28ed5f78fe737b4aee44edbca6b45fb4"
server_key_version: "encryptionkey@0"
I20260811 15:07:35.515607 10749 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460596631409-20401-0/minicluster-data/ts-2/wal/instance:
uuid: "0e2b2bc06f394f23998cd5a637ec3097"
format_stamp: "Formatted at 2026-08-11 15:07:35 on dist-test-slave-8n49"
server_key: "a09b4a8f1e5f598b69ae3a18878b07cd"
server_key_iv: "28ed5f78fe737b4aee44edbca6b45fb4"
server_key_version: "encryptionkey@0"
I20260811 15:07:35.519418 10749 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260811 15:07:35.522032 10764 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:07:35.523176 10749 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 15:07:35.523317 10749 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460596631409-20401-0/minicluster-data/ts-2/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460596631409-20401-0/minicluster-data/ts-2/wal
uuid: "0e2b2bc06f394f23998cd5a637ec3097"
format_stamp: "Formatted at 2026-08-11 15:07:35 on dist-test-slave-8n49"
server_key: "a09b4a8f1e5f598b69ae3a18878b07cd"
server_key_iv: "28ed5f78fe737b4aee44edbca6b45fb4"
server_key_version: "encryptionkey@0"
I20260811 15:07:35.523429 10749 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460596631409-20401-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460596631409-20401-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460596631409-20401-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:07:35.538460 10749 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:07:35.539127 10749 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:07:35.539316 10749 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:07:35.539933 10749 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 15:07:35.540910 10749 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 15:07:35.540978 10749 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 15:07:35.541043 10749 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 15:07:35.541083 10749 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 15:07:35.550129 10749 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.67:33519
I20260811 15:07:35.550156 10897 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.67:33519 every 8 connection(s)
I20260811 15:07:35.551011 10749 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460596631409-20401-0/minicluster-data/ts-2/data/info.pb
I20260811 15:07:35.559906 10438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:35.552900 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.67:40145 (local address 127.19.236.126:42161)
0811 15:07:35.553051 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:35.553056 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:35.554121 (+ 1065us) server_negotiation.cc:407] Connection header received
0811 15:07:35.555472 (+ 1351us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:35.555474 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:35.555534 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:35.555610 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:07:35.556433 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:35.556976 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:35.558066 (+ 1090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:35.558272 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:35.558345 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:35.559456 (+ 1111us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:07:35.559460 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:07:35.559462 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:07:35.559473 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:07:35.559502 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:07:35.559510 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:07:35.559563 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:35.559733 (+ 170us) server_negotiation.cc:299] Negotiation successful
0811 15:07:35.559783 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 15:07:35.560001 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 10749
I20260811 15:07:35.560111 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460596631409-20401-0/minicluster-data/ts-2/wal/instance
I20260811 15:07:35.560523 20401 external_mini_cluster.cc:1428] Setting key 8ab160a5347573a143841032ada12de7
I20260811 15:07:35.561128 10900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:35.553345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:42161 (local address 127.19.236.67:40145)
0811 15:07:35.553974 (+ 629us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:35.554015 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 15:07:35.555274 (+ 1259us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:07:35.555764 (+ 490us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:07:35.555770 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:07:35.555847 (+ 77us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:07:35.556306 (+ 459us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:35.556317 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:35.557087 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:35.557089 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:35.557964 (+ 875us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:35.557972 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:35.558442 (+ 470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:35.558445 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:35.558609 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:35.559179 (+ 570us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 15:07:35.559181 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:07:35.559236 (+ 55us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 15:07:35.559298 (+ 62us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:07:35.559579 (+ 281us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:07:35.559586 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:07:35.559590 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 15:07:35.559739 (+ 149us) client_negotiation.cc:240] Negotiation successful
0811 15:07:35.560027 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":261,"thread_start_us":114,"threads_started":1}
I20260811 15:07:35.562356 10898 heartbeater.cc:347] Connected to a master server at 127.19.236.126:42161
I20260811 15:07:35.562614 10898 heartbeater.cc:464] Registering TS with master...
I20260811 15:07:35.563170 10898 heartbeater.cc:511] Master 127.19.236.126:42161 requested a full tablet report, sending...
I20260811 15:07:35.564167 10397 ts_manager.cc:194] Registered new tserver with Master: 0e2b2bc06f394f23998cd5a637ec3097 (127.19.236.67:33519)
I20260811 15:07:35.564787 10397 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.19.236.67:40145
I20260811 15:07:35.574352 20401 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 15:07:35.579804 10438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:35.576307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42128 (local address 127.19.236.126:42161)
0811 15:07:35.576423 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:35.576427 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:35.576675 (+ 248us) server_negotiation.cc:407] Connection header received
0811 15:07:35.576764 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:35.576767 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:35.576807 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:35.576873 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:07:35.577096 (+ 223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:35.577677 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:35.578462 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:35.578673 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:35.578747 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:35.579442 (+ 695us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:07:35.579445 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:07:35.579447 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:07:35.579458 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:07:35.579474 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:07:35.579482 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:07:35.579549 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:35.579647 (+ 98us) server_negotiation.cc:299] Negotiation successful
0811 15:07:35.579695 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 15:07:35.582383 10397 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42128:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 15:07:35.585423 10397 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 15:07:35.599788 10915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:35.594552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33396 (local address 127.19.236.67:33519)
0811 15:07:35.594973 (+ 421us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:35.594986 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:35.595020 (+ 34us) server_negotiation.cc:407] Connection header received
0811 15:07:35.595084 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:35.595088 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:35.595284 (+ 196us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:35.595442 (+ 158us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:07:35.595754 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:35.597015 (+ 1261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:35.598573 (+ 1558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:35.599096 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:35.599223 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:35.599433 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:35.599536 (+ 103us) server_negotiation.cc:299] Negotiation successful
0811 15:07:35.599632 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":321,"thread_start_us":124,"threads_started":1}
I20260811 15:07:35.599784 10911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:35.594030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.67:33519 (local address 127.0.0.1:33396)
0811 15:07:35.594775 (+ 745us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:35.594789 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 15:07:35.594877 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:07:35.595443 (+ 566us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:07:35.595449 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:07:35.595472 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:07:35.595611 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:35.595622 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:35.597138 (+ 1516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:35.597141 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:35.598416 (+ 1275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:35.598422 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:35.599226 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:35.599230 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:35.599337 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:35.599374 (+ 37us) client_negotiation.cc:769] Sending connection context
0811 15:07:35.599488 (+ 114us) client_negotiation.cc:240] Negotiation successful
0811 15:07:35.599617 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":683,"mutex_wait_us":109,"thread_start_us":85,"threads_started":1}
I20260811 15:07:35.599977 10914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:35.593710 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.65:37347 (local address 127.0.0.1:52052)
0811 15:07:35.594643 (+ 933us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:35.594697 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 15:07:35.594835 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:07:35.595613 (+ 778us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:07:35.595616 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:07:35.595651 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:07:35.595821 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:35.595830 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:35.597228 (+ 1398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:35.597231 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:35.598236 (+ 1005us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:35.598246 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:35.599531 (+ 1285us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:35.599535 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:35.599641 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:35.599664 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 15:07:35.599736 (+ 72us) client_negotiation.cc:240] Negotiation successful
0811 15:07:35.599826 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":746,"mutex_wait_us":34,"thread_start_us":86,"threads_started":1}
I20260811 15:07:35.600131 10910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:35.593894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55906 (local address 127.19.236.66:36945)
0811 15:07:35.594639 (+ 745us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:35.594651 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:35.595197 (+ 546us) server_negotiation.cc:407] Connection header received
0811 15:07:35.595318 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:35.595322 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:35.595541 (+ 219us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:35.595702 (+ 161us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:07:35.596013 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:35.596812 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:35.598539 (+ 1727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:35.599295 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:35.599389 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:35.599554 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:35.599859 (+ 305us) server_negotiation.cc:299] Negotiation successful
0811 15:07:35.599952 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":637,"thread_start_us":155,"threads_started":1}
I20260811 15:07:35.600457 10913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:35.593993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52052 (local address 127.19.236.65:37347)
0811 15:07:35.594427 (+ 434us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:35.594441 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:35.594987 (+ 546us) server_negotiation.cc:407] Connection header received
0811 15:07:35.595078 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:35.595084 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:35.595284 (+ 200us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:35.595442 (+ 158us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:07:35.595950 (+ 508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:35.597103 (+ 1153us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:35.598360 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:35.599160 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:35.599272 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:35.599463 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:35.600166 (+ 703us) server_negotiation.cc:299] Negotiation successful
0811 15:07:35.600271 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":332,"thread_start_us":142,"threads_started":1}
I20260811 15:07:35.600543 10909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:35.593710 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.66:36945 (local address 127.0.0.1:55906)
0811 15:07:35.595096 (+ 1386us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:35.595107 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 15:07:35.595206 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:07:35.595682 (+ 476us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:07:35.595685 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:07:35.595697 (+ 12us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:07:35.595843 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:35.595850 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:35.596926 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:35.596930 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:35.598407 (+ 1477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:35.598419 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:35.599608 (+ 1189us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:35.599613 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:35.599704 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:35.599736 (+ 32us) client_negotiation.cc:769] Sending connection context
0811 15:07:35.600319 (+ 583us) client_negotiation.cc:240] Negotiation successful
0811 15:07:35.600409 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1311,"mutex_wait_us":588,"thread_start_us":90,"threads_started":1}
I20260811 15:07:35.603112 10531 tablet_service.cc:1467] Processing CreateTablet for tablet 80d91ad90c94437caae19045f0eda5a9 (DEFAULT_TABLE table=test-table [id=35b3a8b698914901becbb8a94e5fa534]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:07:35.603257 10821 tablet_service.cc:1467] Processing CreateTablet for tablet 80d91ad90c94437caae19045f0eda5a9 (DEFAULT_TABLE table=test-table [id=35b3a8b698914901becbb8a94e5fa534]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:07:35.603257 10675 tablet_service.cc:1467] Processing CreateTablet for tablet 80d91ad90c94437caae19045f0eda5a9 (DEFAULT_TABLE table=test-table [id=35b3a8b698914901becbb8a94e5fa534]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 15:07:35.604034 10531 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 80d91ad90c94437caae19045f0eda5a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:07:35.604259 10821 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 80d91ad90c94437caae19045f0eda5a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:07:35.604259 10675 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 80d91ad90c94437caae19045f0eda5a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:07:35.610677 10916 tablet_bootstrap.cc:492] T 80d91ad90c94437caae19045f0eda5a9 P 6afe7c542d0f488788886155850fa96b: Bootstrap starting.
I20260811 15:07:35.612106 10917 tablet_bootstrap.cc:492] T 80d91ad90c94437caae19045f0eda5a9 P 0e2b2bc06f394f23998cd5a637ec3097: Bootstrap starting.
I20260811 15:07:35.612905 10919 tablet_bootstrap.cc:492] T 80d91ad90c94437caae19045f0eda5a9 P bfb372f04f614d008525d3895c719f63: Bootstrap starting.
I20260811 15:07:35.613349 10916 tablet_bootstrap.cc:654] T 80d91ad90c94437caae19045f0eda5a9 P 6afe7c542d0f488788886155850fa96b: Neither blocks nor log segments found. Creating new log.
I20260811 15:07:35.614085 10916 log.cc:824] T 80d91ad90c94437caae19045f0eda5a9 P 6afe7c542d0f488788886155850fa96b: Log is configured to *not* fsync() on all Append() calls
I20260811 15:07:35.614279 10917 tablet_bootstrap.cc:654] T 80d91ad90c94437caae19045f0eda5a9 P 0e2b2bc06f394f23998cd5a637ec3097: Neither blocks nor log segments found. Creating new log.
I20260811 15:07:35.614953 10919 tablet_bootstrap.cc:654] T 80d91ad90c94437caae19045f0eda5a9 P bfb372f04f614d008525d3895c719f63: Neither blocks nor log segments found. Creating new log.
I20260811 15:07:35.615123 10917 log.cc:824] T 80d91ad90c94437caae19045f0eda5a9 P 0e2b2bc06f394f23998cd5a637ec3097: Log is configured to *not* fsync() on all Append() calls
I20260811 15:07:35.615770 10919 log.cc:824] T 80d91ad90c94437caae19045f0eda5a9 P bfb372f04f614d008525d3895c719f63: Log is configured to *not* fsync() on all Append() calls
I20260811 15:07:35.616876 10916 tablet_bootstrap.cc:492] T 80d91ad90c94437caae19045f0eda5a9 P 6afe7c542d0f488788886155850fa96b: No bootstrap required, opened a new log
I20260811 15:07:35.617074 10917 tablet_bootstrap.cc:492] T 80d91ad90c94437caae19045f0eda5a9 P 0e2b2bc06f394f23998cd5a637ec3097: No bootstrap required, opened a new log
I20260811 15:07:35.617089 10916 ts_tablet_manager.cc:1397] T 80d91ad90c94437caae19045f0eda5a9 P 6afe7c542d0f488788886155850fa96b: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.002s
I20260811 15:07:35.617264 10917 ts_tablet_manager.cc:1397] T 80d91ad90c94437caae19045f0eda5a9 P 0e2b2bc06f394f23998cd5a637ec3097: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260811 15:07:35.617865 10919 tablet_bootstrap.cc:492] T 80d91ad90c94437caae19045f0eda5a9 P bfb372f04f614d008525d3895c719f63: No bootstrap required, opened a new log
I20260811 15:07:35.618060 10919 ts_tablet_manager.cc:1397] T 80d91ad90c94437caae19045f0eda5a9 P bfb372f04f614d008525d3895c719f63: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260811 15:07:35.620802 10916 raft_consensus.cc:348] T 80d91ad90c94437caae19045f0eda5a9 P 6afe7c542d0f488788886155850fa96b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfb372f04f614d008525d3895c719f63" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 36945 } } peers { permanent_uuid: "6afe7c542d0f488788886155850fa96b" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 37347 } } peers { permanent_uuid: "0e2b2bc06f394f23998cd5a637ec3097" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 33519 } }
I20260811 15:07:35.621181 10916 raft_consensus.cc:374] T 80d91ad90c94437caae19045f0eda5a9 P 6afe7c542d0f488788886155850fa96b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:07:35.621245 10916 raft_consensus.cc:729] T 80d91ad90c94437caae19045f0eda5a9 P 6afe7c542d0f488788886155850fa96b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6afe7c542d0f488788886155850fa96b, State: Initialized, Role: FOLLOWER
I20260811 15:07:35.621728 10916 consensus_queue.cc:260] T 80d91ad90c94437caae19045f0eda5a9 P 6afe7c542d0f488788886155850fa96b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfb372f04f614d008525d3895c719f63" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 36945 } } peers { permanent_uuid: "6afe7c542d0f488788886155850fa96b" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 37347 } } peers { permanent_uuid: "0e2b2bc06f394f23998cd5a637ec3097" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 33519 } }
I20260811 15:07:35.621832 10917 raft_consensus.cc:348] T 80d91ad90c94437caae19045f0eda5a9 P 0e2b2bc06f394f23998cd5a637ec3097 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfb372f04f614d008525d3895c719f63" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 36945 } } peers { permanent_uuid: "6afe7c542d0f488788886155850fa96b" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 37347 } } peers { permanent_uuid: "0e2b2bc06f394f23998cd5a637ec3097" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 33519 } }
I20260811 15:07:35.622097 10917 raft_consensus.cc:374] T 80d91ad90c94437caae19045f0eda5a9 P 0e2b2bc06f394f23998cd5a637ec3097 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:07:35.622160 10917 raft_consensus.cc:729] T 80d91ad90c94437caae19045f0eda5a9 P 0e2b2bc06f394f23998cd5a637ec3097 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e2b2bc06f394f23998cd5a637ec3097, State: Initialized, Role: FOLLOWER
I20260811 15:07:35.622469 10919 raft_consensus.cc:348] T 80d91ad90c94437caae19045f0eda5a9 P bfb372f04f614d008525d3895c719f63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfb372f04f614d008525d3895c719f63" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 36945 } } peers { permanent_uuid: "6afe7c542d0f488788886155850fa96b" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 37347 } } peers { permanent_uuid: "0e2b2bc06f394f23998cd5a637ec3097" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 33519 } }
I20260811 15:07:35.622710 10919 raft_consensus.cc:374] T 80d91ad90c94437caae19045f0eda5a9 P bfb372f04f614d008525d3895c719f63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:07:35.622759 10919 raft_consensus.cc:729] T 80d91ad90c94437caae19045f0eda5a9 P bfb372f04f614d008525d3895c719f63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfb372f04f614d008525d3895c719f63, State: Initialized, Role: FOLLOWER
I20260811 15:07:35.622807 10916 ts_tablet_manager.cc:1428] T 80d91ad90c94437caae19045f0eda5a9 P 6afe7c542d0f488788886155850fa96b: Time spent starting tablet: real 0.006s user 0.004s sys 0.002s
I20260811 15:07:35.622819 10917 consensus_queue.cc:260] T 80d91ad90c94437caae19045f0eda5a9 P 0e2b2bc06f394f23998cd5a637ec3097 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfb372f04f614d008525d3895c719f63" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 36945 } } peers { permanent_uuid: "6afe7c542d0f488788886155850fa96b" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 37347 } } peers { permanent_uuid: "0e2b2bc06f394f23998cd5a637ec3097" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 33519 } }
I20260811 15:07:35.623179 10606 heartbeater.cc:503] Master 127.19.236.126:42161 was elected leader, sending a full tablet report...
I20260811 15:07:35.623162 10919 consensus_queue.cc:260] T 80d91ad90c94437caae19045f0eda5a9 P bfb372f04f614d008525d3895c719f63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfb372f04f614d008525d3895c719f63" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 36945 } } peers { permanent_uuid: "6afe7c542d0f488788886155850fa96b" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 37347 } } peers { permanent_uuid: "0e2b2bc06f394f23998cd5a637ec3097" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 33519 } }
I20260811 15:07:35.623796 10746 heartbeater.cc:503] Master 127.19.236.126:42161 was elected leader, sending a full tablet report...
I20260811 15:07:35.623834 10917 ts_tablet_manager.cc:1428] T 80d91ad90c94437caae19045f0eda5a9 P 0e2b2bc06f394f23998cd5a637ec3097: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260811 15:07:35.624166 10898 heartbeater.cc:503] Master 127.19.236.126:42161 was elected leader, sending a full tablet report...
I20260811 15:07:35.624914 10919 ts_tablet_manager.cc:1428] T 80d91ad90c94437caae19045f0eda5a9 P bfb372f04f614d008525d3895c719f63: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
W20260811 15:07:35.671097 10607 tablet.cc:2369] T 80d91ad90c94437caae19045f0eda5a9 P 6afe7c542d0f488788886155850fa96b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 15:07:35.712324 10924 raft_consensus.cc:482] T 80d91ad90c94437caae19045f0eda5a9 P 0e2b2bc06f394f23998cd5a637ec3097 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 15:07:35.712602 10924 raft_consensus.cc:504] T 80d91ad90c94437caae19045f0eda5a9 P 0e2b2bc06f394f23998cd5a637ec3097 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfb372f04f614d008525d3895c719f63" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 36945 } } peers { permanent_uuid: "6afe7c542d0f488788886155850fa96b" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 37347 } } peers { permanent_uuid: "0e2b2bc06f394f23998cd5a637ec3097" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 33519 } }
I20260811 15:07:35.714399 10924 leader_election.cc:288] T 80d91ad90c94437caae19045f0eda5a9 P 0e2b2bc06f394f23998cd5a637ec3097 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfb372f04f614d008525d3895c719f63 (127.19.236.66:36945), 6afe7c542d0f488788886155850fa96b (127.19.236.65:37347)
I20260811 15:07:35.719182 10913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:35.714232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.67:49607 (local address 127.19.236.65:37347)
0811 15:07:35.714359 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:35.714364 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:35.714769 (+ 405us) server_negotiation.cc:407] Connection header received
0811 15:07:35.714882 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:35.714886 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:35.714940 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:35.715015 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:07:35.715301 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:35.716028 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:35.717788 (+ 1760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:35.718399 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:35.718509 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:35.718560 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:35.718966 (+ 406us) server_negotiation.cc:299] Negotiation successful
0811 15:07:35.719072 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 15:07:35.719182 10910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:35.714475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.236.67:47175 (local address 127.19.236.66:36945)
0811 15:07:35.714630 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:35.714633 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:35.714646 (+ 13us) server_negotiation.cc:407] Connection header received
0811 15:07:35.714690 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:35.714692 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:35.714755 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:35.714838 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 15:07:35.715181 (+ 343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:35.715984 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:35.717788 (+ 1804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:35.718389 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:35.718517 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:35.718560 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:35.718966 (+ 406us) server_negotiation.cc:299] Negotiation successful
0811 15:07:35.719047 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 15:07:35.719231 10900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:35.714062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.66:36945 (local address 127.19.236.67:47175)
0811 15:07:35.714279 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:35.714297 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 15:07:35.714391 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:07:35.714878 (+ 487us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:07:35.714883 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:07:35.714905 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:07:35.715049 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:35.715056 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:35.716118 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:35.716121 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:35.717648 (+ 1527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:35.717659 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:35.718523 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:35.718527 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:35.718762 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:35.718837 (+ 75us) client_negotiation.cc:769] Sending connection context
0811 15:07:35.718914 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 15:07:35.719048 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"mutex_wait_us":269}
I20260811 15:07:35.719278 10926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:35.714079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.65:37347 (local address 127.19.236.67:49607)
0811 15:07:35.714673 (+ 594us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:35.714685 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 15:07:35.714774 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:07:35.715049 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:07:35.715052 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:07:35.715066 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 15:07:35.715197 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:35.715202 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:35.716127 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:35.716130 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:35.717652 (+ 1522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:07:35.717659 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:07:35.718523 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:07:35.718527 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:07:35.718760 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:35.718854 (+ 94us) client_negotiation.cc:769] Sending connection context
0811 15:07:35.718914 (+ 60us) client_negotiation.cc:240] Negotiation successful
0811 15:07:35.719048 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":527,"mutex_wait_us":290,"thread_start_us":153,"threads_started":1}
I20260811 15:07:35.719991 10551 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "80d91ad90c94437caae19045f0eda5a9" candidate_uuid: "0e2b2bc06f394f23998cd5a637ec3097" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6afe7c542d0f488788886155850fa96b" is_pre_election: true
I20260811 15:07:35.720359 10551 raft_consensus.cc:2454] T 80d91ad90c94437caae19045f0eda5a9 P 6afe7c542d0f488788886155850fa96b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e2b2bc06f394f23998cd5a637ec3097 in term 0.
I20260811 15:07:35.720336 10696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "80d91ad90c94437caae19045f0eda5a9" candidate_uuid: "0e2b2bc06f394f23998cd5a637ec3097" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfb372f04f614d008525d3895c719f63" is_pre_election: true
I20260811 15:07:35.720659 10696 raft_consensus.cc:2454] T 80d91ad90c94437caae19045f0eda5a9 P bfb372f04f614d008525d3895c719f63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e2b2bc06f394f23998cd5a637ec3097 in term 0.
I20260811 15:07:35.721015 10768 leader_election.cc:302] T 80d91ad90c94437caae19045f0eda5a9 P 0e2b2bc06f394f23998cd5a637ec3097 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e2b2bc06f394f23998cd5a637ec3097, 6afe7c542d0f488788886155850fa96b; no voters:
I20260811 15:07:35.721331 10924 raft_consensus.cc:2781] T 80d91ad90c94437caae19045f0eda5a9 P 0e2b2bc06f394f23998cd5a637ec3097 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 15:07:35.721414 10924 raft_consensus.cc:482] T 80d91ad90c94437caae19045f0eda5a9 P 0e2b2bc06f394f23998cd5a637ec3097 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 15:07:35.721464 10924 raft_consensus.cc:3037] T 80d91ad90c94437caae19045f0eda5a9 P 0e2b2bc06f394f23998cd5a637ec3097 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:07:35.722517 10924 raft_consensus.cc:504] T 80d91ad90c94437caae19045f0eda5a9 P 0e2b2bc06f394f23998cd5a637ec3097 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfb372f04f614d008525d3895c719f63" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 36945 } } peers { permanent_uuid: "6afe7c542d0f488788886155850fa96b" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 37347 } } peers { permanent_uuid: "0e2b2bc06f394f23998cd5a637ec3097" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 33519 } }
I20260811 15:07:35.722904 10924 leader_election.cc:288] T 80d91ad90c94437caae19045f0eda5a9 P 0e2b2bc06f394f23998cd5a637ec3097 [CANDIDATE]: Term 1 election: Requested vote from peers bfb372f04f614d008525d3895c719f63 (127.19.236.66:36945), 6afe7c542d0f488788886155850fa96b (127.19.236.65:37347)
I20260811 15:07:35.723248 10696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "80d91ad90c94437caae19045f0eda5a9" candidate_uuid: "0e2b2bc06f394f23998cd5a637ec3097" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfb372f04f614d008525d3895c719f63"
I20260811 15:07:35.723286 10551 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "80d91ad90c94437caae19045f0eda5a9" candidate_uuid: "0e2b2bc06f394f23998cd5a637ec3097" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6afe7c542d0f488788886155850fa96b"
I20260811 15:07:35.723394 10696 raft_consensus.cc:3037] T 80d91ad90c94437caae19045f0eda5a9 P bfb372f04f614d008525d3895c719f63 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:07:35.723430 10551 raft_consensus.cc:3037] T 80d91ad90c94437caae19045f0eda5a9 P 6afe7c542d0f488788886155850fa96b [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:07:35.724421 10696 raft_consensus.cc:2454] T 80d91ad90c94437caae19045f0eda5a9 P bfb372f04f614d008525d3895c719f63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e2b2bc06f394f23998cd5a637ec3097 in term 1.
I20260811 15:07:35.724475 10551 raft_consensus.cc:2454] T 80d91ad90c94437caae19045f0eda5a9 P 6afe7c542d0f488788886155850fa96b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e2b2bc06f394f23998cd5a637ec3097 in term 1.
I20260811 15:07:35.724764 10765 leader_election.cc:302] T 80d91ad90c94437caae19045f0eda5a9 P 0e2b2bc06f394f23998cd5a637ec3097 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e2b2bc06f394f23998cd5a637ec3097, bfb372f04f614d008525d3895c719f63; no voters:
I20260811 15:07:35.724947 10924 raft_consensus.cc:2781] T 80d91ad90c94437caae19045f0eda5a9 P 0e2b2bc06f394f23998cd5a637ec3097 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:07:35.725199 10924 raft_consensus.cc:686] T 80d91ad90c94437caae19045f0eda5a9 P 0e2b2bc06f394f23998cd5a637ec3097 [term 1 LEADER]: Becoming Leader. State: Replica: 0e2b2bc06f394f23998cd5a637ec3097, State: Running, Role: LEADER
I20260811 15:07:35.725521 10924 consensus_queue.cc:237] T 80d91ad90c94437caae19045f0eda5a9 P 0e2b2bc06f394f23998cd5a637ec3097 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfb372f04f614d008525d3895c719f63" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 36945 } } peers { permanent_uuid: "6afe7c542d0f488788886155850fa96b" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 37347 } } peers { permanent_uuid: "0e2b2bc06f394f23998cd5a637ec3097" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 33519 } }
I20260811 15:07:35.728863 10396 catalog_manager.cc:5495] T 80d91ad90c94437caae19045f0eda5a9 P 0e2b2bc06f394f23998cd5a637ec3097 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0e2b2bc06f394f23998cd5a637ec3097 (127.19.236.67). New cstate: current_term: 1 leader_uuid: "0e2b2bc06f394f23998cd5a637ec3097" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfb372f04f614d008525d3895c719f63" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 36945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6afe7c542d0f488788886155850fa96b" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 37347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e2b2bc06f394f23998cd5a637ec3097" member_type: VOTER last_known_addr { host: "127.19.236.67" port: 33519 } health_report { overall_health: HEALTHY } } }
I20260811 15:07:35.752257 10915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:35.748802 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33406 (local address 127.19.236.67:33519)
0811 15:07:35.748956 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:35.748962 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:35.748978 (+ 16us) server_negotiation.cc:407] Connection header received
0811 15:07:35.749064 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:35.749067 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:35.749153 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:35.749266 (+ 113us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 15:07:35.749534 (+ 268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:35.750035 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:35.750890 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:35.751103 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:35.751177 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:35.751427 (+ 250us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 15:07:35.751834 (+ 407us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 15:07:35.751924 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:35.752015 (+ 91us) server_negotiation.cc:299] Negotiation successful
0811 15:07:35.752058 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 15:07:35.758003 10551 raft_consensus.cc:1261] T 80d91ad90c94437caae19045f0eda5a9 P 6afe7c542d0f488788886155850fa96b [term 1 FOLLOWER]: Refusing update from remote peer 0e2b2bc06f394f23998cd5a637ec3097: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:07:35.758003 10696 raft_consensus.cc:1261] T 80d91ad90c94437caae19045f0eda5a9 P bfb372f04f614d008525d3895c719f63 [term 1 FOLLOWER]: Refusing update from remote peer 0e2b2bc06f394f23998cd5a637ec3097: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:07:35.758666 10924 consensus_queue.cc:1035] T 80d91ad90c94437caae19045f0eda5a9 P 0e2b2bc06f394f23998cd5a637ec3097 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6afe7c542d0f488788886155850fa96b" member_type: VOTER last_known_addr { host: "127.19.236.65" port: 37347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:07:35.758872 10927 consensus_queue.cc:1035] T 80d91ad90c94437caae19045f0eda5a9 P 0e2b2bc06f394f23998cd5a637ec3097 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfb372f04f614d008525d3895c719f63" member_type: VOTER last_known_addr { host: "127.19.236.66" port: 36945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:07:35.767675 10932 mvcc.cc:205] Tried to move back new op lower bound from 7317343665177702400 to 7317343665054650368. Current Snapshot: MvccSnapshot[applied={T|T < 7317343665177702400}]
I20260811 15:07:35.767844 10933 mvcc.cc:205] Tried to move back new op lower bound from 7317343665177702400 to 7317343665054650368. Current Snapshot: MvccSnapshot[applied={T|T < 7317343665177702400}]
I20260811 15:07:35.777215 10396 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42128:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 15:07:35.777372 10396 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42128:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 15:07:35.779845 10396 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d8b391f501294d2f9b8dc4cf98a6f3ee: Sending DeleteTablet for 3 replicas of tablet 80d91ad90c94437caae19045f0eda5a9
I20260811 15:07:35.780702 10675 tablet_service.cc:1514] Processing DeleteTablet for tablet 80d91ad90c94437caae19045f0eda5a9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:07:35 UTC) from {username='slave'} at 127.0.0.1:55906
I20260811 15:07:35.780702 10531 tablet_service.cc:1514] Processing DeleteTablet for tablet 80d91ad90c94437caae19045f0eda5a9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:07:35 UTC) from {username='slave'} at 127.0.0.1:52052
I20260811 15:07:35.780903 10821 tablet_service.cc:1514] Processing DeleteTablet for tablet 80d91ad90c94437caae19045f0eda5a9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 15:07:35 UTC) from {username='slave'} at 127.0.0.1:33396
I20260811 15:07:35.781255 10944 tablet_replica.cc:330] T 80d91ad90c94437caae19045f0eda5a9 P 6afe7c542d0f488788886155850fa96b: stopping tablet replica
I20260811 15:07:35.781623 10944 raft_consensus.cc:2229] T 80d91ad90c94437caae19045f0eda5a9 P 6afe7c542d0f488788886155850fa96b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 15:07:35.781957 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 10463
I20260811 15:07:35.781973 10944 raft_consensus.cc:2258] T 80d91ad90c94437caae19045f0eda5a9 P 6afe7c542d0f488788886155850fa96b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:07:35.783371 10945 tablet_replica.cc:330] T 80d91ad90c94437caae19045f0eda5a9 P 0e2b2bc06f394f23998cd5a637ec3097: stopping tablet replica
I20260811 15:07:35.783778 10945 raft_consensus.cc:2229] T 80d91ad90c94437caae19045f0eda5a9 P 0e2b2bc06f394f23998cd5a637ec3097 [term 1 LEADER]: Raft consensus shutting down.
I20260811 15:07:35.784309 10945 raft_consensus.cc:2258] T 80d91ad90c94437caae19045f0eda5a9 P 0e2b2bc06f394f23998cd5a637ec3097 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:07:35.787357 10943 tablet_replica.cc:330] T 80d91ad90c94437caae19045f0eda5a9 P bfb372f04f614d008525d3895c719f63: stopping tablet replica
I20260811 15:07:35.787784 10943 raft_consensus.cc:2229] T 80d91ad90c94437caae19045f0eda5a9 P bfb372f04f614d008525d3895c719f63 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 15:07:35.788177 10943 raft_consensus.cc:2258] T 80d91ad90c94437caae19045f0eda5a9 P bfb372f04f614d008525d3895c719f63 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 15:07:35.789949 10945 ts_tablet_manager.cc:1905] T 80d91ad90c94437caae19045f0eda5a9 P 0e2b2bc06f394f23998cd5a637ec3097: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 15:07:35.789968 10943 ts_tablet_manager.cc:1905] T 80d91ad90c94437caae19045f0eda5a9 P bfb372f04f614d008525d3895c719f63: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 15:07:35.792887 10945 ts_tablet_manager.cc:1918] T 80d91ad90c94437caae19045f0eda5a9 P 0e2b2bc06f394f23998cd5a637ec3097: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 15:07:35.793058 10945 log.cc:1196] T 80d91ad90c94437caae19045f0eda5a9 P 0e2b2bc06f394f23998cd5a637ec3097: Deleting WAL directory at /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460596631409-20401-0/minicluster-data/ts-2/wal/wals/80d91ad90c94437caae19045f0eda5a9
I20260811 15:07:35.793455 10945 ts_tablet_manager.cc:1939] T 80d91ad90c94437caae19045f0eda5a9 P 0e2b2bc06f394f23998cd5a637ec3097: Deleting consensus metadata
I20260811 15:07:35.793468 10943 ts_tablet_manager.cc:1918] T 80d91ad90c94437caae19045f0eda5a9 P bfb372f04f614d008525d3895c719f63: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 15:07:35.793576 10943 log.cc:1196] T 80d91ad90c94437caae19045f0eda5a9 P bfb372f04f614d008525d3895c719f63: Deleting WAL directory at /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786460596631409-20401-0/minicluster-data/ts-1/wal/wals/80d91ad90c94437caae19045f0eda5a9
I20260811 15:07:35.793906 10943 ts_tablet_manager.cc:1939] T 80d91ad90c94437caae19045f0eda5a9 P bfb372f04f614d008525d3895c719f63: Deleting consensus metadata
W20260811 15:07:35.793977 10382 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.19.236.65:37347 (error 108)
I20260811 15:07:35.794915 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 10609
I20260811 15:07:35.794955 10380 catalog_manager.cc:4841] TS 0e2b2bc06f394f23998cd5a637ec3097 (127.19.236.67:33519): tablet 80d91ad90c94437caae19045f0eda5a9 (table test-table [id=35b3a8b698914901becbb8a94e5fa534]) successfully deleted
I20260811 15:07:35.799407 10909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:35.799070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.65:37347 (local address 127.0.0.1:52056)
0811 15:07:35.799228 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:35.799313 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.65:37347: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260811 15:07:35.799603 10382 catalog_manager.cc:4584] TS 6afe7c542d0f488788886155850fa96b (127.19.236.65:37347): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 80d91ad90c94437caae19045f0eda5a9: Network error: Client connection negotiation failed: client connection to 127.19.236.65:37347: connect: Connection refused (error 111)
I20260811 15:07:35.804359 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 10749
I20260811 15:07:35.805970 10909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:35.804526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.66:36945 (local address 127.0.0.1:55918)
0811 15:07:35.805823 (+ 1297us) negotiation.cc:107] Waiting for socket to connect
0811 15:07:35.805882 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.66:36945: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1204}
I20260811 15:07:35.813346 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 10364
2026-08-11T15:07:35Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (1127 ms)
[----------] 6 tests from EncryptionPolicyTest (11406 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786460596631409-20401-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 15:07:35 dist-test-slave-8n49 krb5kdc[10950](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 15:07:35 dist-test-slave-8n49 krb5kdc[10950](info): set up 2 sockets
Aug 11 15:07:35 dist-test-slave-8n49 krb5kdc[10950](info): commencing operation
krb5kdc: starting...
W20260811 15:07:36.919565 20401 mini_kdc.cc:121] Time spent starting KDC: real 1.083s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786460596631409-20401-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786460596631409-20401-0/krb5kdc/test-user.keytab.
Aug 11 15:07:37 dist-test-slave-8n49 krb5kdc[10950](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460857, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T15:07:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T15:07:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786460596631409-20401-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786460596631409-20401-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 15:07:37.047932 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786460596631409-20401-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786460596631409-20401-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786460596631409-20401-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33345
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786460596631409-20401-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43291
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33345
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:07:37.162050 10965 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:07:37.162357 10965 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:07:37.162434 10965 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:07:37.166787 10965 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:07:37.166877 10965 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:07:37.166913 10965 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:07:37.166967 10965 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:07:37.167022 10965 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:07:37.172405 10965 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43291
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786460596631409-20401-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786460596631409-20401-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33345
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786460596631409-20401-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33345
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10965
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786460596631409-20401-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:07:37.173664 10965 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:07:37.174764 10965 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 15:07:37.183543 10965 server_base.cc:1034] running on GCE node
W20260811 15:07:37.183574 10972 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:07:37.183557 10974 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:07:37.183593 10976 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:07:37.184403 10965 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:07:37.185542 10965 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:07:37.186703 10965 hybrid_clock.cc:648] HybridClock initialized: now 1786460857186686 us; error 31 us; skew 500 ppm
Aug 11 15:07:37 dist-test-slave-8n49 krb5kdc[10950](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460857, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:07:37.189436 10965 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 15:07:37.190307 10965 webserver.cc:460] Webserver started at http://127.0.0.1:40775/ using document root <none> and password file <none>
I20260811 15:07:37.190869 10965 fs_manager.cc:359] Metadata directory not provided
I20260811 15:07:37.190959 10965 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:07:37.191205 10965 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:07:37.193346 10965 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786460596631409-20401-0/minicluster-data/master-0/data/instance:
uuid: "e82fbdd4032e47199ca6ff4a4f37cec0"
format_stamp: "Formatted at 2026-08-11 15:07:37 on dist-test-slave-8n49"
server_key: "2234e527ae6397993cc2a099fcce353d"
server_key_iv: "2fdffc9ce809515a5ad3fa17cbdcdf2e"
server_key_version: "encryptionkey@0"
I20260811 15:07:37.193902 10965 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786460596631409-20401-0/minicluster-data/master-0/wal/instance:
uuid: "e82fbdd4032e47199ca6ff4a4f37cec0"
format_stamp: "Formatted at 2026-08-11 15:07:37 on dist-test-slave-8n49"
server_key: "2234e527ae6397993cc2a099fcce353d"
server_key_iv: "2fdffc9ce809515a5ad3fa17cbdcdf2e"
server_key_version: "encryptionkey@0"
I20260811 15:07:37.197629 10965 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 15:07:37.200034 10984 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:07:37.201244 10965 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 15:07:37.201390 10965 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786460596631409-20401-0/minicluster-data/master-0/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786460596631409-20401-0/minicluster-data/master-0/wal
uuid: "e82fbdd4032e47199ca6ff4a4f37cec0"
format_stamp: "Formatted at 2026-08-11 15:07:37 on dist-test-slave-8n49"
server_key: "2234e527ae6397993cc2a099fcce353d"
server_key_iv: "2fdffc9ce809515a5ad3fa17cbdcdf2e"
server_key_version: "encryptionkey@0"
I20260811 15:07:37.201507 10965 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786460596631409-20401-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786460596631409-20401-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786460596631409-20401-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:07:37.233258 10965 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:07:37.236325 10965 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:07:37.236537 10965 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:07:37.244002 10965 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33345
I20260811 15:07:37.244029 11041 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33345 every 8 connection(s)
I20260811 15:07:37.245138 10965 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
I20260811 15:07:37.247973 11042 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:07:37.253847 11042 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e82fbdd4032e47199ca6ff4a4f37cec0: Bootstrap starting.
I20260811 15:07:37.255270 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 10965
I20260811 15:07:37.255446 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786460596631409-20401-0/minicluster-data/master-0/wal/instance
I20260811 15:07:37.255730 20401 external_mini_cluster.cc:1428] Setting key 081ecf0d8449bdb316e88ab3d6e41f17
I20260811 15:07:37.256417 11042 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e82fbdd4032e47199ca6ff4a4f37cec0: Neither blocks nor log segments found. Creating new log.
I20260811 15:07:37.257375 11042 log.cc:824] T 00000000000000000000000000000000 P e82fbdd4032e47199ca6ff4a4f37cec0: Log is configured to *not* fsync() on all Append() calls
I20260811 15:07:37.259265 11042 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e82fbdd4032e47199ca6ff4a4f37cec0: No bootstrap required, opened a new log
I20260811 15:07:37.262789 11042 raft_consensus.cc:348] T 00000000000000000000000000000000 P e82fbdd4032e47199ca6ff4a4f37cec0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e82fbdd4032e47199ca6ff4a4f37cec0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33345 } }
I20260811 15:07:37.263038 11042 raft_consensus.cc:374] T 00000000000000000000000000000000 P e82fbdd4032e47199ca6ff4a4f37cec0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:07:37.263126 11042 raft_consensus.cc:729] T 00000000000000000000000000000000 P e82fbdd4032e47199ca6ff4a4f37cec0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e82fbdd4032e47199ca6ff4a4f37cec0, State: Initialized, Role: FOLLOWER
I20260811 15:07:37.263563 11042 consensus_queue.cc:260] T 00000000000000000000000000000000 P e82fbdd4032e47199ca6ff4a4f37cec0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e82fbdd4032e47199ca6ff4a4f37cec0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33345 } }
I20260811 15:07:37.263715 11042 raft_consensus.cc:388] T 00000000000000000000000000000000 P e82fbdd4032e47199ca6ff4a4f37cec0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 15:07:37.263799 11042 raft_consensus.cc:482] T 00000000000000000000000000000000 P e82fbdd4032e47199ca6ff4a4f37cec0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 15:07:37.263916 11042 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e82fbdd4032e47199ca6ff4a4f37cec0 [term 0 FOLLOWER]: Advancing to term 1
Aug 11 15:07:37 dist-test-slave-8n49 krb5kdc[10950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460857, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 15:07:37.265028 11042 raft_consensus.cc:504] T 00000000000000000000000000000000 P e82fbdd4032e47199ca6ff4a4f37cec0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e82fbdd4032e47199ca6ff4a4f37cec0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33345 } }
I20260811 15:07:37.265374 11042 leader_election.cc:302] T 00000000000000000000000000000000 P e82fbdd4032e47199ca6ff4a4f37cec0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e82fbdd4032e47199ca6ff4a4f37cec0; no voters:
I20260811 15:07:37.265772 11042 leader_election.cc:288] T 00000000000000000000000000000000 P e82fbdd4032e47199ca6ff4a4f37cec0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 15:07:37.265852 11048 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e82fbdd4032e47199ca6ff4a4f37cec0 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:07:37.266072 11048 raft_consensus.cc:686] T 00000000000000000000000000000000 P e82fbdd4032e47199ca6ff4a4f37cec0 [term 1 LEADER]: Becoming Leader. State: Replica: e82fbdd4032e47199ca6ff4a4f37cec0, State: Running, Role: LEADER
I20260811 15:07:37.266362 11048 consensus_queue.cc:237] T 00000000000000000000000000000000 P e82fbdd4032e47199ca6ff4a4f37cec0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e82fbdd4032e47199ca6ff4a4f37cec0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33345 } }
I20260811 15:07:37.267135 11042 sys_catalog.cc:564] T 00000000000000000000000000000000 P e82fbdd4032e47199ca6ff4a4f37cec0 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:07:37.269274 11049 sys_catalog.cc:455] T 00000000000000000000000000000000 P e82fbdd4032e47199ca6ff4a4f37cec0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e82fbdd4032e47199ca6ff4a4f37cec0. Latest consensus state: current_term: 1 leader_uuid: "e82fbdd4032e47199ca6ff4a4f37cec0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e82fbdd4032e47199ca6ff4a4f37cec0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33345 } } }
I20260811 15:07:37.269420 11049 sys_catalog.cc:458] T 00000000000000000000000000000000 P e82fbdd4032e47199ca6ff4a4f37cec0 [sys.catalog]: This master's current role is: LEADER
I20260811 15:07:37.269248 11050 sys_catalog.cc:455] T 00000000000000000000000000000000 P e82fbdd4032e47199ca6ff4a4f37cec0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e82fbdd4032e47199ca6ff4a4f37cec0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e82fbdd4032e47199ca6ff4a4f37cec0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33345 } } }
I20260811 15:07:37.269675 11050 sys_catalog.cc:458] T 00000000000000000000000000000000 P e82fbdd4032e47199ca6ff4a4f37cec0 [sys.catalog]: This master's current role is: LEADER
I20260811 15:07:37.269990 11057 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:07:37.271059 11046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:37.256916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44589 (local address 127.0.0.1:33345)
0811 15:07:37.257363 (+ 447us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:37.257379 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:37.257414 (+ 35us) server_negotiation.cc:407] Connection header received
0811 15:07:37.258105 (+ 691us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:37.258130 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:37.258466 (+ 336us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:37.258798 (+ 332us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:07:37.259637 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:37.260679 (+ 1042us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:37.261530 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:37.262026 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:37.262197 (+ 171us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:37.265093 (+ 2896us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:07:37.265099 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:07:37.265112 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:07:37.265140 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:07:37.267082 (+ 1942us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:07:37.267683 (+ 601us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:07:37.267689 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:07:37.267706 (+ 17us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:07:37.267858 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:07:37.268337 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:07:37.268341 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:07:37.268343 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:07:37.268904 (+ 561us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:07:37.269133 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:37.269805 (+ 672us) server_negotiation.cc:299] Negotiation successful
0811 15:07:37.270068 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":294,"thread_start_us":128,"threads_started":1}
I20260811 15:07:37.273173 11057 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:07:37.274358 20401 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 15:07:37.279237 11057 catalog_manager.cc:1347] Generated new cluster ID: 060dc9e4964b4808b7d6bed773d80146
I20260811 15:07:37.279309 11057 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:07:37.284950 11046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:37.276468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39679 (local address 127.0.0.1:33345)
0811 15:07:37.276594 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:37.276598 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:37.276889 (+ 291us) server_negotiation.cc:407] Connection header received
0811 15:07:37.277023 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:37.277026 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:37.277075 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:37.277165 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:07:37.277974 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:37.278510 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:37.279452 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:37.279696 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:37.279805 (+ 109us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:37.281413 (+ 1608us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:07:37.281417 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:07:37.281420 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:07:37.281445 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:07:37.283036 (+ 1591us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:07:37.283606 (+ 570us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:07:37.283609 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:07:37.283611 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:07:37.283696 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:07:37.284055 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:07:37.284058 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:07:37.284059 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:07:37.284242 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:07:37.284385 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:37.284693 (+ 308us) server_negotiation.cc:299] Negotiation successful
0811 15:07:37.284784 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 15:07:37.310778 11057 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 15:07:37.312114 11057 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:07:37.321465 11057 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e82fbdd4032e47199ca6ff4a4f37cec0: Generated new TSK 0
I20260811 15:07:37.322209 11057 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 15:07:37.333158 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 10965
W20260811 15:07:37.343338 10948 connection.cc:535] client connection to 127.0.0.1:33345 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:33345): Connection reset by peer (error 104)
2026-08-11T15:07:37Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1521 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786460596631409-20401-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 15:07:37 dist-test-slave-8n49 krb5kdc[11075](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 15:07:37 dist-test-slave-8n49 krb5kdc[11075](info): set up 2 sockets
Aug 11 15:07:37 dist-test-slave-8n49 krb5kdc[11075](info): commencing operation
krb5kdc: starting...
W20260811 15:07:38.469482 20401 mini_kdc.cc:121] Time spent starting KDC: real 1.111s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786460596631409-20401-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786460596631409-20401-0/krb5kdc/test-user.keytab.
Aug 11 15:07:38 dist-test-slave-8n49 krb5kdc[11075](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460858, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T15:07:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T15:07:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786460596631409-20401-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786460596631409-20401-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 15:07:38.595772 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786460596631409-20401-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786460596631409-20401-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786460596631409-20401-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39797
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786460596631409-20401-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37395
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39797
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:07:38.709184 11089 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:07:38.709504 11089 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:07:38.709589 11089 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:07:38.713666 11089 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:07:38.713745 11089 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:07:38.713783 11089 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:07:38.713835 11089 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:07:38.713874 11089 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:07:38.719137 11089 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37395
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786460596631409-20401-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786460596631409-20401-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39797
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786460596631409-20401-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39797
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11089
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786460596631409-20401-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:07:38.720264 11089 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:07:38.721551 11089 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:07:38.730499 11096 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:07:38.730681 11089 server_base.cc:1034] running on GCE node
W20260811 15:07:38.730535 11095 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:07:38.730491 11100 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:07:38.731562 11089 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:07:38.732750 11089 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:07:38.733959 11089 hybrid_clock.cc:648] HybridClock initialized: now 1786460858733939 us; error 32 us; skew 500 ppm
Aug 11 15:07:38 dist-test-slave-8n49 krb5kdc[11075](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460858, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:07:38.736804 11089 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 15:07:38.737736 11089 webserver.cc:460] Webserver started at http://127.0.0.1:36407/ using document root <none> and password file <none>
I20260811 15:07:38.738315 11089 fs_manager.cc:359] Metadata directory not provided
I20260811 15:07:38.738405 11089 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:07:38.738641 11089 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:07:38.740794 11089 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786460596631409-20401-0/minicluster-data/master-0/data/instance:
uuid: "f108a19893854fe29825d428480c5feb"
format_stamp: "Formatted at 2026-08-11 15:07:38 on dist-test-slave-8n49"
server_key: "47d9c5e3a48e6cf9df598fd45a3814cf"
server_key_iv: "706fbb0dc2d69ea9949902a3ce46e736"
server_key_version: "encryptionkey@0"
I20260811 15:07:38.741367 11089 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786460596631409-20401-0/minicluster-data/master-0/wal/instance:
uuid: "f108a19893854fe29825d428480c5feb"
format_stamp: "Formatted at 2026-08-11 15:07:38 on dist-test-slave-8n49"
server_key: "47d9c5e3a48e6cf9df598fd45a3814cf"
server_key_iv: "706fbb0dc2d69ea9949902a3ce46e736"
server_key_version: "encryptionkey@0"
I20260811 15:07:38.745141 11089 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 15:07:38.747615 11109 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:07:38.749012 11089 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 15:07:38.749161 11089 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786460596631409-20401-0/minicluster-data/master-0/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786460596631409-20401-0/minicluster-data/master-0/wal
uuid: "f108a19893854fe29825d428480c5feb"
format_stamp: "Formatted at 2026-08-11 15:07:38 on dist-test-slave-8n49"
server_key: "47d9c5e3a48e6cf9df598fd45a3814cf"
server_key_iv: "706fbb0dc2d69ea9949902a3ce46e736"
server_key_version: "encryptionkey@0"
I20260811 15:07:38.749279 11089 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786460596631409-20401-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786460596631409-20401-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786460596631409-20401-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:07:38.779290 11089 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:07:38.782388 11089 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:07:38.782608 11089 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:07:38.790105 11089 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39797
I20260811 15:07:38.790133 11165 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39797 every 8 connection(s)
I20260811 15:07:38.791144 11089 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
I20260811 15:07:38.792771 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 11089
I20260811 15:07:38.792881 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786460596631409-20401-0/minicluster-data/master-0/wal/instance
I20260811 15:07:38.793212 20401 external_mini_cluster.cc:1428] Setting key 6df3efc98ea446d3f573a5fe70123ee5
I20260811 15:07:38.794682 11166 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:07:38.802610 11166 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f108a19893854fe29825d428480c5feb: Bootstrap starting.
I20260811 15:07:38.804450 11169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:38.794706 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38605 (local address 127.0.0.1:39797)
0811 15:07:38.795229 (+ 523us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:38.795251 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:38.795297 (+ 46us) server_negotiation.cc:407] Connection header received
0811 15:07:38.796229 (+ 932us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:38.796256 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:38.796779 (+ 523us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:38.797178 (+ 399us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:07:38.797644 (+ 466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:38.799327 (+ 1683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:38.800296 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:38.801116 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:38.801312 (+ 196us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:38.802230 (+ 918us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:07:38.802237 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:07:38.802255 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:07:38.802815 (+ 560us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:07:38.802900 (+ 85us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:07:38.802934 (+ 34us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:07:38.803087 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:38.803264 (+ 177us) server_negotiation.cc:299] Negotiation successful
0811 15:07:38.803411 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":357,"thread_start_us":158,"threads_started":1}
I20260811 15:07:38.805729 11166 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f108a19893854fe29825d428480c5feb: Neither blocks nor log segments found. Creating new log.
I20260811 15:07:38.806663 11166 log.cc:824] T 00000000000000000000000000000000 P f108a19893854fe29825d428480c5feb: Log is configured to *not* fsync() on all Append() calls
I20260811 15:07:38.807762 20401 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 15:07:38.809078 11166 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f108a19893854fe29825d428480c5feb: No bootstrap required, opened a new log
I20260811 15:07:38.812466 11166 raft_consensus.cc:348] T 00000000000000000000000000000000 P f108a19893854fe29825d428480c5feb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f108a19893854fe29825d428480c5feb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39797 } }
I20260811 15:07:38.812819 11166 raft_consensus.cc:374] T 00000000000000000000000000000000 P f108a19893854fe29825d428480c5feb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:07:38.812902 11166 raft_consensus.cc:729] T 00000000000000000000000000000000 P f108a19893854fe29825d428480c5feb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f108a19893854fe29825d428480c5feb, State: Initialized, Role: FOLLOWER
I20260811 15:07:38.813452 11166 consensus_queue.cc:260] T 00000000000000000000000000000000 P f108a19893854fe29825d428480c5feb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f108a19893854fe29825d428480c5feb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39797 } }
I20260811 15:07:38.813661 11166 raft_consensus.cc:388] T 00000000000000000000000000000000 P f108a19893854fe29825d428480c5feb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 15:07:38.813748 11166 raft_consensus.cc:482] T 00000000000000000000000000000000 P f108a19893854fe29825d428480c5feb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 15:07:38.813884 11166 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f108a19893854fe29825d428480c5feb [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:07:38.814450 11169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:38.809885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50119 (local address 127.0.0.1:39797)
0811 15:07:38.810017 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:38.810022 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:38.810230 (+ 208us) server_negotiation.cc:407] Connection header received
0811 15:07:38.810353 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:38.810356 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:38.810402 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:38.810491 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:07:38.810754 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:38.811638 (+ 884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:38.812491 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:38.812784 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:38.812901 (+ 117us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:38.813868 (+ 967us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:07:38.813872 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:07:38.813875 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:07:38.813888 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:07:38.813919 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:07:38.813937 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:07:38.814040 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:38.814252 (+ 212us) server_negotiation.cc:299] Negotiation successful
0811 15:07:38.814289 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 15:07:38.815249 11166 raft_consensus.cc:504] T 00000000000000000000000000000000 P f108a19893854fe29825d428480c5feb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f108a19893854fe29825d428480c5feb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39797 } }
I20260811 15:07:38.815627 11166 leader_election.cc:302] T 00000000000000000000000000000000 P f108a19893854fe29825d428480c5feb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f108a19893854fe29825d428480c5feb; no voters:
I20260811 15:07:38.815970 11166 leader_election.cc:288] T 00000000000000000000000000000000 P f108a19893854fe29825d428480c5feb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 15:07:38.816088 11176 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f108a19893854fe29825d428480c5feb [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:07:38.816340 11176 raft_consensus.cc:686] T 00000000000000000000000000000000 P f108a19893854fe29825d428480c5feb [term 1 LEADER]: Becoming Leader. State: Replica: f108a19893854fe29825d428480c5feb, State: Running, Role: LEADER
I20260811 15:07:38.816705 11176 consensus_queue.cc:237] T 00000000000000000000000000000000 P f108a19893854fe29825d428480c5feb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f108a19893854fe29825d428480c5feb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39797 } }
I20260811 15:07:38.817395 11166 sys_catalog.cc:564] T 00000000000000000000000000000000 P f108a19893854fe29825d428480c5feb [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:07:38.818518 11178 sys_catalog.cc:455] T 00000000000000000000000000000000 P f108a19893854fe29825d428480c5feb [sys.catalog]: SysCatalogTable state changed. Reason: New leader f108a19893854fe29825d428480c5feb. Latest consensus state: current_term: 1 leader_uuid: "f108a19893854fe29825d428480c5feb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f108a19893854fe29825d428480c5feb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39797 } } }
I20260811 15:07:38.818522 11177 sys_catalog.cc:455] T 00000000000000000000000000000000 P f108a19893854fe29825d428480c5feb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f108a19893854fe29825d428480c5feb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f108a19893854fe29825d428480c5feb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39797 } } }
I20260811 15:07:38.818727 11177 sys_catalog.cc:458] T 00000000000000000000000000000000 P f108a19893854fe29825d428480c5feb [sys.catalog]: This master's current role is: LEADER
I20260811 15:07:38.819015 11178 sys_catalog.cc:458] T 00000000000000000000000000000000 P f108a19893854fe29825d428480c5feb [sys.catalog]: This master's current role is: LEADER
I20260811 15:07:38.819573 11186 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:07:38.822414 11186 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:07:38.827832 11186 catalog_manager.cc:1347] Generated new cluster ID: d0caf5e0bb9a472f89b569f629ce8928
I20260811 15:07:38.827915 11186 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:07:38.832597 11186 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 15:07:38.833784 11186 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:07:38.843063 11186 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f108a19893854fe29825d428480c5feb: Generated new TSK 0
I20260811 15:07:38.843873 11186 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 15:07:38.850870 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 11089
W20260811 15:07:38.860783 11073 connection.cc:535] client connection to 127.0.0.1:39797 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:39797): Connection reset by peer (error 104)
2026-08-11T15:07:38Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1517 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786460596631409-20401-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 15:07:38 dist-test-slave-8n49 krb5kdc[11198](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 15:07:38 dist-test-slave-8n49 krb5kdc[11198](info): set up 2 sockets
Aug 11 15:07:38 dist-test-slave-8n49 krb5kdc[11198](info): commencing operation
krb5kdc: starting...
W20260811 15:07:39.959280 20401 mini_kdc.cc:121] Time spent starting KDC: real 1.084s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786460596631409-20401-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786460596631409-20401-0/krb5kdc/test-user.keytab.
Aug 11 15:07:40 dist-test-slave-8n49 krb5kdc[11198](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460860, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T15:07:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T15:07:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786460596631409-20401-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786460596631409-20401-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 15:07:40.087929 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786460596631409-20401-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786460596631409-20401-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786460596631409-20401-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36077
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786460596631409-20401-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43535
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36077
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:07:40.200611 11213 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:07:40.200920 11213 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:07:40.201007 11213 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:07:40.204993 11213 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:07:40.205080 11213 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:07:40.205117 11213 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:07:40.205152 11213 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:07:40.205183 11213 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:07:40.210389 11213 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43535
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786460596631409-20401-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786460596631409-20401-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36077
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786460596631409-20401-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36077
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11213
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786460596631409-20401-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:07:40.211481 11213 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:07:40.212532 11213 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:07:40.221182 11221 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:07:40.221189 11218 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:07:40.221300 11213 server_base.cc:1034] running on GCE node
W20260811 15:07:40.221201 11219 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:07:40.222141 11213 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:07:40.223232 11213 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:07:40.224426 11213 hybrid_clock.cc:648] HybridClock initialized: now 1786460860224403 us; error 39 us; skew 500 ppm
Aug 11 15:07:40 dist-test-slave-8n49 krb5kdc[11198](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460860, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:07:40.236688 11213 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 15:07:40.237778 11213 webserver.cc:460] Webserver started at http://127.0.0.1:36587/ using document root <none> and password file <none>
I20260811 15:07:40.238400 11213 fs_manager.cc:359] Metadata directory not provided
I20260811 15:07:40.238466 11213 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:07:40.238706 11213 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:07:40.241026 11213 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786460596631409-20401-0/minicluster-data/master-0/data/instance:
uuid: "d8c89b309cc247ffac6f0768c46a4bcd"
format_stamp: "Formatted at 2026-08-11 15:07:40 on dist-test-slave-8n49"
server_key: "7537f91cd0bc546943b12ae0ebba99e4"
server_key_iv: "6a940359d69257ab76b50a4334a07aae"
server_key_version: "encryptionkey@0"
I20260811 15:07:40.241626 11213 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786460596631409-20401-0/minicluster-data/master-0/wal/instance:
uuid: "d8c89b309cc247ffac6f0768c46a4bcd"
format_stamp: "Formatted at 2026-08-11 15:07:40 on dist-test-slave-8n49"
server_key: "7537f91cd0bc546943b12ae0ebba99e4"
server_key_iv: "6a940359d69257ab76b50a4334a07aae"
server_key_version: "encryptionkey@0"
I20260811 15:07:40.245549 11213 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 15:07:40.248397 11228 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:07:40.249696 11213 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.001s
I20260811 15:07:40.249831 11213 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786460596631409-20401-0/minicluster-data/master-0/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786460596631409-20401-0/minicluster-data/master-0/wal
uuid: "d8c89b309cc247ffac6f0768c46a4bcd"
format_stamp: "Formatted at 2026-08-11 15:07:40 on dist-test-slave-8n49"
server_key: "7537f91cd0bc546943b12ae0ebba99e4"
server_key_iv: "6a940359d69257ab76b50a4334a07aae"
server_key_version: "encryptionkey@0"
I20260811 15:07:40.249959 11213 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786460596631409-20401-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786460596631409-20401-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786460596631409-20401-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:07:40.255112 11213 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:07:40.258270 11213 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:07:40.258477 11213 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:07:40.265843 11213 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36077
I20260811 15:07:40.265872 11286 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36077 every 8 connection(s)
I20260811 15:07:40.266781 11213 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
I20260811 15:07:40.269605 11287 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:07:40.274633 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 11213
I20260811 15:07:40.274792 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786460596631409-20401-0/minicluster-data/master-0/wal/instance
I20260811 15:07:40.275126 20401 external_mini_cluster.cc:1428] Setting key 5f1dd336fa967e43699b00cac190b3ce
I20260811 15:07:40.275604 11287 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d8c89b309cc247ffac6f0768c46a4bcd: Bootstrap starting.
I20260811 15:07:40.278069 11287 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d8c89b309cc247ffac6f0768c46a4bcd: Neither blocks nor log segments found. Creating new log.
I20260811 15:07:40.278998 11287 log.cc:824] T 00000000000000000000000000000000 P d8c89b309cc247ffac6f0768c46a4bcd: Log is configured to *not* fsync() on all Append() calls
I20260811 15:07:40.280407 11291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:40.276600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57005 (local address 127.0.0.1:36077)
0811 15:07:40.277062 (+ 462us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:40.277078 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:40.277120 (+ 42us) server_negotiation.cc:407] Connection header received
0811 15:07:40.277746 (+ 626us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:40.277762 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:40.278031 (+ 269us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:40.278353 (+ 322us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:07:40.279193 (+ 840us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:07:40.279198 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:07:40.279209 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:07:40.279219 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:07:40.279275 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:07:40.279295 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:07:40.279408 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:40.279533 (+ 125us) server_negotiation.cc:299] Negotiation successful
0811 15:07:40.279691 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":291,"thread_start_us":143,"threads_started":1}
I20260811 15:07:40.281116 11287 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d8c89b309cc247ffac6f0768c46a4bcd: No bootstrap required, opened a new log
I20260811 15:07:40.283372 20401 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 15:07:40.285785 11287 raft_consensus.cc:348] T 00000000000000000000000000000000 P d8c89b309cc247ffac6f0768c46a4bcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8c89b309cc247ffac6f0768c46a4bcd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36077 } }
I20260811 15:07:40.286070 11287 raft_consensus.cc:374] T 00000000000000000000000000000000 P d8c89b309cc247ffac6f0768c46a4bcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:07:40.286141 11287 raft_consensus.cc:729] T 00000000000000000000000000000000 P d8c89b309cc247ffac6f0768c46a4bcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8c89b309cc247ffac6f0768c46a4bcd, State: Initialized, Role: FOLLOWER
I20260811 15:07:40.286558 11287 consensus_queue.cc:260] T 00000000000000000000000000000000 P d8c89b309cc247ffac6f0768c46a4bcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8c89b309cc247ffac6f0768c46a4bcd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36077 } }
I20260811 15:07:40.286679 11287 raft_consensus.cc:388] T 00000000000000000000000000000000 P d8c89b309cc247ffac6f0768c46a4bcd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 15:07:40.286761 11287 raft_consensus.cc:482] T 00000000000000000000000000000000 P d8c89b309cc247ffac6f0768c46a4bcd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 15:07:40.286849 11287 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d8c89b309cc247ffac6f0768c46a4bcd [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:07:40.287623 11291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:40.285801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36193 (local address 127.0.0.1:36077)
0811 15:07:40.285936 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:40.285940 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:40.286140 (+ 200us) server_negotiation.cc:407] Connection header received
0811 15:07:40.286329 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:40.286347 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:40.286390 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:40.286465 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:07:40.287226 (+ 761us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:07:40.287230 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:07:40.287232 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:07:40.287243 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:07:40.287271 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:07:40.287287 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:07:40.287374 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:40.287456 (+ 82us) server_negotiation.cc:299] Negotiation successful
0811 15:07:40.287496 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 15:07:40.287865 11287 raft_consensus.cc:504] T 00000000000000000000000000000000 P d8c89b309cc247ffac6f0768c46a4bcd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8c89b309cc247ffac6f0768c46a4bcd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36077 } }
I20260811 15:07:40.288229 11287 leader_election.cc:302] T 00000000000000000000000000000000 P d8c89b309cc247ffac6f0768c46a4bcd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d8c89b309cc247ffac6f0768c46a4bcd; no voters:
I20260811 15:07:40.288638 11287 leader_election.cc:288] T 00000000000000000000000000000000 P d8c89b309cc247ffac6f0768c46a4bcd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 15:07:40.288723 11298 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d8c89b309cc247ffac6f0768c46a4bcd [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:07:40.288961 11298 raft_consensus.cc:686] T 00000000000000000000000000000000 P d8c89b309cc247ffac6f0768c46a4bcd [term 1 LEADER]: Becoming Leader. State: Replica: d8c89b309cc247ffac6f0768c46a4bcd, State: Running, Role: LEADER
I20260811 15:07:40.289269 11298 consensus_queue.cc:237] T 00000000000000000000000000000000 P d8c89b309cc247ffac6f0768c46a4bcd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8c89b309cc247ffac6f0768c46a4bcd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36077 } }
I20260811 15:07:40.289878 11287 sys_catalog.cc:564] T 00000000000000000000000000000000 P d8c89b309cc247ffac6f0768c46a4bcd [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:07:40.290934 11299 sys_catalog.cc:455] T 00000000000000000000000000000000 P d8c89b309cc247ffac6f0768c46a4bcd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d8c89b309cc247ffac6f0768c46a4bcd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8c89b309cc247ffac6f0768c46a4bcd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36077 } } }
I20260811 15:07:40.291064 11299 sys_catalog.cc:458] T 00000000000000000000000000000000 P d8c89b309cc247ffac6f0768c46a4bcd [sys.catalog]: This master's current role is: LEADER
I20260811 15:07:40.291358 11300 sys_catalog.cc:455] T 00000000000000000000000000000000 P d8c89b309cc247ffac6f0768c46a4bcd [sys.catalog]: SysCatalogTable state changed. Reason: New leader d8c89b309cc247ffac6f0768c46a4bcd. Latest consensus state: current_term: 1 leader_uuid: "d8c89b309cc247ffac6f0768c46a4bcd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8c89b309cc247ffac6f0768c46a4bcd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36077 } } }
I20260811 15:07:40.291458 11300 sys_catalog.cc:458] T 00000000000000000000000000000000 P d8c89b309cc247ffac6f0768c46a4bcd [sys.catalog]: This master's current role is: LEADER
I20260811 15:07:40.291549 11308 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:07:40.294952 11308 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:07:40.301124 11308 catalog_manager.cc:1347] Generated new cluster ID: 95ba8bdae24b4589913fa44aaf1e5b3a
I20260811 15:07:40.301206 11308 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:07:40.319357 11308 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 15:07:40.319765 11308 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:07:40.325778 11308 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d8c89b309cc247ffac6f0768c46a4bcd: Generated new TSK 0
I20260811 15:07:40.326524 11308 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 15:07:40.334486 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 11213
2026-08-11T15:07:40Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1481 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786460596631409-20401-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 15:07:40 dist-test-slave-8n49 krb5kdc[11320](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 15:07:40 dist-test-slave-8n49 krb5kdc[11320](info): set up 2 sockets
Aug 11 15:07:40 dist-test-slave-8n49 krb5kdc[11320](info): commencing operation
krb5kdc: starting...
W20260811 15:07:41.453272 20401 mini_kdc.cc:121] Time spent starting KDC: real 1.096s user 0.006s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786460596631409-20401-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786460596631409-20401-0/krb5kdc/test-user.keytab.
Aug 11 15:07:41 dist-test-slave-8n49 krb5kdc[11320](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460861, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T15:07:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T15:07:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786460596631409-20401-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786460596631409-20401-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 15:07:41.581163 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786460596631409-20401-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786460596631409-20401-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786460596631409-20401-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40469
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786460596631409-20401-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45111
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40469
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:07:41.696621 11333 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:07:41.696897 11333 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:07:41.696943 11333 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:07:41.700911 11333 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:07:41.700968 11333 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:07:41.700987 11333 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:07:41.701004 11333 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:07:41.701020 11333 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:07:41.706293 11333 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45111
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786460596631409-20401-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786460596631409-20401-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40469
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786460596631409-20401-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40469
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11333
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786460596631409-20401-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:07:41.707405 11333 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:07:41.708429 11333 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:07:41.717299 11341 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:07:41.717305 11339 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:07:41.717374 11338 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:07:41.717576 11333 server_base.cc:1034] running on GCE node
I20260811 15:07:41.718182 11333 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:07:41.719350 11333 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:07:41.720542 11333 hybrid_clock.cc:648] HybridClock initialized: now 1786460861720529 us; error 32 us; skew 500 ppm
Aug 11 15:07:41 dist-test-slave-8n49 krb5kdc[11320](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460861, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:07:41.723462 11333 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 15:07:41.724423 11333 webserver.cc:460] Webserver started at http://127.0.0.1:42647/ using document root <none> and password file <none>
I20260811 15:07:41.725054 11333 fs_manager.cc:359] Metadata directory not provided
I20260811 15:07:41.725154 11333 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:07:41.725394 11333 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:07:41.727499 11333 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786460596631409-20401-0/minicluster-data/master-0/data/instance:
uuid: "b3a42bd2f959483cb179e130ba4ba1e3"
format_stamp: "Formatted at 2026-08-11 15:07:41 on dist-test-slave-8n49"
server_key: "fd2ace216da31c57470aa66a957beb14"
server_key_iv: "5be46940692aa9a893868429a6a40d42"
server_key_version: "encryptionkey@0"
I20260811 15:07:41.728086 11333 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786460596631409-20401-0/minicluster-data/master-0/wal/instance:
uuid: "b3a42bd2f959483cb179e130ba4ba1e3"
format_stamp: "Formatted at 2026-08-11 15:07:41 on dist-test-slave-8n49"
server_key: "fd2ace216da31c57470aa66a957beb14"
server_key_iv: "5be46940692aa9a893868429a6a40d42"
server_key_version: "encryptionkey@0"
I20260811 15:07:41.731964 11333 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260811 15:07:41.734508 11350 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:07:41.735879 11333 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 15:07:41.736023 11333 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786460596631409-20401-0/minicluster-data/master-0/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786460596631409-20401-0/minicluster-data/master-0/wal
uuid: "b3a42bd2f959483cb179e130ba4ba1e3"
format_stamp: "Formatted at 2026-08-11 15:07:41 on dist-test-slave-8n49"
server_key: "fd2ace216da31c57470aa66a957beb14"
server_key_iv: "5be46940692aa9a893868429a6a40d42"
server_key_version: "encryptionkey@0"
I20260811 15:07:41.736148 11333 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786460596631409-20401-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786460596631409-20401-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786460596631409-20401-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:07:41.750942 11333 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:07:41.754436 11333 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:07:41.754645 11333 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:07:41.761973 11333 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40469
I20260811 15:07:41.762002 11410 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40469 every 8 connection(s)
I20260811 15:07:41.762925 11333 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
I20260811 15:07:41.765753 11411 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:07:41.768494 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 11333
I20260811 15:07:41.768708 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786460596631409-20401-0/minicluster-data/master-0/wal/instance
I20260811 15:07:41.769096 20401 external_mini_cluster.cc:1428] Setting key d700e40b4789367d6d208c40bf51c13e
I20260811 15:07:41.772635 11411 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b3a42bd2f959483cb179e130ba4ba1e3: Bootstrap starting.
I20260811 15:07:41.775197 11411 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b3a42bd2f959483cb179e130ba4ba1e3: Neither blocks nor log segments found. Creating new log.
I20260811 15:07:41.775995 11411 log.cc:824] T 00000000000000000000000000000000 P b3a42bd2f959483cb179e130ba4ba1e3: Log is configured to *not* fsync() on all Append() calls
I20260811 15:07:41.777984 11411 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b3a42bd2f959483cb179e130ba4ba1e3: No bootstrap required, opened a new log
Aug 11 15:07:41 dist-test-slave-8n49 krb5kdc[11320](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460861, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 15:07:41.781210 11411 raft_consensus.cc:348] T 00000000000000000000000000000000 P b3a42bd2f959483cb179e130ba4ba1e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3a42bd2f959483cb179e130ba4ba1e3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40469 } }
I20260811 15:07:41.781463 11411 raft_consensus.cc:374] T 00000000000000000000000000000000 P b3a42bd2f959483cb179e130ba4ba1e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:07:41.781527 11411 raft_consensus.cc:729] T 00000000000000000000000000000000 P b3a42bd2f959483cb179e130ba4ba1e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3a42bd2f959483cb179e130ba4ba1e3, State: Initialized, Role: FOLLOWER
I20260811 15:07:41.781966 11411 consensus_queue.cc:260] T 00000000000000000000000000000000 P b3a42bd2f959483cb179e130ba4ba1e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3a42bd2f959483cb179e130ba4ba1e3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40469 } }
I20260811 15:07:41.782124 11411 raft_consensus.cc:388] T 00000000000000000000000000000000 P b3a42bd2f959483cb179e130ba4ba1e3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 15:07:41.782203 11411 raft_consensus.cc:482] T 00000000000000000000000000000000 P b3a42bd2f959483cb179e130ba4ba1e3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 15:07:41.782321 11411 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b3a42bd2f959483cb179e130ba4ba1e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:07:41.783214 11411 raft_consensus.cc:504] T 00000000000000000000000000000000 P b3a42bd2f959483cb179e130ba4ba1e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3a42bd2f959483cb179e130ba4ba1e3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40469 } }
I20260811 15:07:41.783568 11411 leader_election.cc:302] T 00000000000000000000000000000000 P b3a42bd2f959483cb179e130ba4ba1e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b3a42bd2f959483cb179e130ba4ba1e3; no voters:
I20260811 15:07:41.783931 11411 leader_election.cc:288] T 00000000000000000000000000000000 P b3a42bd2f959483cb179e130ba4ba1e3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 15:07:41.783979 11416 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b3a42bd2f959483cb179e130ba4ba1e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:07:41.784273 11416 raft_consensus.cc:686] T 00000000000000000000000000000000 P b3a42bd2f959483cb179e130ba4ba1e3 [term 1 LEADER]: Becoming Leader. State: Replica: b3a42bd2f959483cb179e130ba4ba1e3, State: Running, Role: LEADER
I20260811 15:07:41.784646 11416 consensus_queue.cc:237] T 00000000000000000000000000000000 P b3a42bd2f959483cb179e130ba4ba1e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3a42bd2f959483cb179e130ba4ba1e3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40469 } }
I20260811 15:07:41.785315 11411 sys_catalog.cc:564] T 00000000000000000000000000000000 P b3a42bd2f959483cb179e130ba4ba1e3 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:07:41.785673 11414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:41.770599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36321 (local address 127.0.0.1:40469)
0811 15:07:41.771062 (+ 463us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:41.771078 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:41.771116 (+ 38us) server_negotiation.cc:407] Connection header received
0811 15:07:41.771751 (+ 635us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:41.771769 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:41.772223 (+ 454us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:41.773734 (+ 1511us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:07:41.774280 (+ 546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:41.775313 (+ 1033us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:41.776286 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:41.777019 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:41.777195 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:41.779922 (+ 2727us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:07:41.779929 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:07:41.779951 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:07:41.779978 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:07:41.782474 (+ 2496us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:07:41.782914 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:07:41.782920 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:07:41.782926 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:07:41.783043 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:07:41.783322 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:07:41.783325 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:07:41.783327 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:07:41.783766 (+ 439us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:07:41.783967 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:41.784276 (+ 309us) server_negotiation.cc:299] Negotiation successful
0811 15:07:41.784792 (+ 516us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":307,"thread_start_us":127,"threads_started":1}
I20260811 15:07:41.787506 11418 sys_catalog.cc:455] T 00000000000000000000000000000000 P b3a42bd2f959483cb179e130ba4ba1e3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b3a42bd2f959483cb179e130ba4ba1e3. Latest consensus state: current_term: 1 leader_uuid: "b3a42bd2f959483cb179e130ba4ba1e3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3a42bd2f959483cb179e130ba4ba1e3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40469 } } }
I20260811 15:07:41.787513 11417 sys_catalog.cc:455] T 00000000000000000000000000000000 P b3a42bd2f959483cb179e130ba4ba1e3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b3a42bd2f959483cb179e130ba4ba1e3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3a42bd2f959483cb179e130ba4ba1e3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40469 } } }
I20260811 15:07:41.787655 11418 sys_catalog.cc:458] T 00000000000000000000000000000000 P b3a42bd2f959483cb179e130ba4ba1e3 [sys.catalog]: This master's current role is: LEADER
I20260811 15:07:41.787654 11417 sys_catalog.cc:458] T 00000000000000000000000000000000 P b3a42bd2f959483cb179e130ba4ba1e3 [sys.catalog]: This master's current role is: LEADER
I20260811 15:07:41.789026 20401 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260811 15:07:41.790663 11430 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b3a42bd2f959483cb179e130ba4ba1e3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 15:07:41.790716 11430 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 15:07:41.790794 11431 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:07:41.792168 11431 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:07:41.797945 11431 catalog_manager.cc:1347] Generated new cluster ID: c16643d0413c4907a38d26895e72d7cf
I20260811 15:07:41.798022 11431 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:07:41.800185 11414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:41.791248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56645 (local address 127.0.0.1:40469)
0811 15:07:41.791370 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:41.791374 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:41.791523 (+ 149us) server_negotiation.cc:407] Connection header received
0811 15:07:41.791636 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:41.791640 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:41.791685 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:41.791777 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:07:41.792647 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:41.793426 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:41.794655 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:41.794988 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:41.795105 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:41.796728 (+ 1623us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:07:41.796732 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:07:41.796735 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:07:41.796759 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:07:41.798478 (+ 1719us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:07:41.798981 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:07:41.798984 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:07:41.798986 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:07:41.799067 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:07:41.799363 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:07:41.799366 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:07:41.799368 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:07:41.799559 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:07:41.799669 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:41.799929 (+ 260us) server_negotiation.cc:299] Negotiation successful
0811 15:07:41.800037 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 15:07:41.806875 11431 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 15:07:41.807760 11431 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:07:41.815838 11431 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b3a42bd2f959483cb179e130ba4ba1e3: Generated new TSK 0
I20260811 15:07:41.816730 11431 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 15:07:41.829281 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 11333
2026-08-11T15:07:41Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1495 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786460596631409-20401-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 15:07:41 dist-test-slave-8n49 krb5kdc[11443](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 15:07:41 dist-test-slave-8n49 krb5kdc[11443](info): set up 2 sockets
Aug 11 15:07:41 dist-test-slave-8n49 krb5kdc[11443](info): commencing operation
krb5kdc: starting...
W20260811 15:07:42.944103 20401 mini_kdc.cc:121] Time spent starting KDC: real 1.091s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786460596631409-20401-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786460596631409-20401-0/krb5kdc/test-user.keytab.
Aug 11 15:07:43 dist-test-slave-8n49 krb5kdc[11443](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460863, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T15:07:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T15:07:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786460596631409-20401-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786460596631409-20401-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 15:07:43.071403 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786460596631409-20401-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786460596631409-20401-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786460596631409-20401-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36353
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786460596631409-20401-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36353
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:07:43.185148 11460 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:07:43.185463 11460 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:07:43.185561 11460 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:07:43.189651 11460 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:07:43.189735 11460 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:07:43.189810 11460 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:07:43.189864 11460 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:07:43.189901 11460 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:07:43.195317 11460 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786460596631409-20401-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786460596631409-20401-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36353
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786460596631409-20401-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36353
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11460
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786460596631409-20401-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:07:43.196421 11460 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:07:43.197530 11460 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:07:43.206245 11466 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:07:43.206250 11467 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:07:43.206403 11460 server_base.cc:1034] running on GCE node
W20260811 15:07:43.206599 11469 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:07:43.207221 11460 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:07:43.208381 11460 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:07:43.209569 11460 hybrid_clock.cc:648] HybridClock initialized: now 1786460863209551 us; error 31 us; skew 500 ppm
Aug 11 15:07:43 dist-test-slave-8n49 krb5kdc[11443](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460863, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:07:43.212419 11460 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 15:07:43.213408 11460 webserver.cc:460] Webserver started at http://127.0.0.1:36305/ using document root <none> and password file <none>
I20260811 15:07:43.213981 11460 fs_manager.cc:359] Metadata directory not provided
I20260811 15:07:43.214078 11460 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:07:43.214318 11460 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:07:43.216423 11460 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786460596631409-20401-0/minicluster-data/master-0/data/instance:
uuid: "4e0af4de50504870984efe44f6909f3c"
format_stamp: "Formatted at 2026-08-11 15:07:43 on dist-test-slave-8n49"
server_key: "4f5604055a9fef665104467f8f3e6ef2"
server_key_iv: "f7781855de2d4eb75619e4b49e911788"
server_key_version: "encryptionkey@0"
I20260811 15:07:43.217077 11460 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786460596631409-20401-0/minicluster-data/master-0/wal/instance:
uuid: "4e0af4de50504870984efe44f6909f3c"
format_stamp: "Formatted at 2026-08-11 15:07:43 on dist-test-slave-8n49"
server_key: "4f5604055a9fef665104467f8f3e6ef2"
server_key_iv: "f7781855de2d4eb75619e4b49e911788"
server_key_version: "encryptionkey@0"
I20260811 15:07:43.220784 11460 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 15:07:43.223313 11476 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:07:43.224666 11460 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 15:07:43.224800 11460 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786460596631409-20401-0/minicluster-data/master-0/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786460596631409-20401-0/minicluster-data/master-0/wal
uuid: "4e0af4de50504870984efe44f6909f3c"
format_stamp: "Formatted at 2026-08-11 15:07:43 on dist-test-slave-8n49"
server_key: "4f5604055a9fef665104467f8f3e6ef2"
server_key_iv: "f7781855de2d4eb75619e4b49e911788"
server_key_version: "encryptionkey@0"
I20260811 15:07:43.224920 11460 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786460596631409-20401-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786460596631409-20401-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786460596631409-20401-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:07:43.241312 11460 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:07:43.244738 11460 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:07:43.244952 11460 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:07:43.252317 11460 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36353
I20260811 15:07:43.252345 11534 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36353 every 8 connection(s)
I20260811 15:07:43.253325 11460 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
I20260811 15:07:43.256079 11535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:07:43.258419 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 11460
I20260811 15:07:43.258576 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786460596631409-20401-0/minicluster-data/master-0/wal/instance
I20260811 15:07:43.258898 20401 external_mini_cluster.cc:1428] Setting key 657c2e2f70b5c54c7b2e6c55a51444d8
I20260811 15:07:43.262499 11535 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4e0af4de50504870984efe44f6909f3c: Bootstrap starting.
I20260811 15:07:43.264807 11535 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4e0af4de50504870984efe44f6909f3c: Neither blocks nor log segments found. Creating new log.
I20260811 15:07:43.265558 11535 log.cc:824] T 00000000000000000000000000000000 P 4e0af4de50504870984efe44f6909f3c: Log is configured to *not* fsync() on all Append() calls
I20260811 15:07:43.267746 11535 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4e0af4de50504870984efe44f6909f3c: No bootstrap required, opened a new log
I20260811 15:07:43.268052 11539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:43.260371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52379 (local address 127.0.0.1:36353)
0811 15:07:43.260833 (+ 462us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:43.260848 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:43.260883 (+ 35us) server_negotiation.cc:407] Connection header received
0811 15:07:43.261623 (+ 740us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:43.261642 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:43.261971 (+ 329us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:43.262313 (+ 342us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:07:43.262750 (+ 437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:43.263715 (+ 965us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:43.264627 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:43.265171 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:43.265348 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:43.266245 (+ 897us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:07:43.266253 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:07:43.266274 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:07:43.266701 (+ 427us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:07:43.266753 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:07:43.266776 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:07:43.266855 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:43.267051 (+ 196us) server_negotiation.cc:299] Negotiation successful
0811 15:07:43.267285 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":315,"thread_start_us":159,"threads_started":1}
I20260811 15:07:43.271049 20401 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 15:07:43.271879 11535 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4e0af4de50504870984efe44f6909f3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e0af4de50504870984efe44f6909f3c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36353 } }
I20260811 15:07:43.272140 11535 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4e0af4de50504870984efe44f6909f3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:07:43.272199 11535 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4e0af4de50504870984efe44f6909f3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e0af4de50504870984efe44f6909f3c, State: Initialized, Role: FOLLOWER
I20260811 15:07:43.272761 11535 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4e0af4de50504870984efe44f6909f3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e0af4de50504870984efe44f6909f3c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36353 } }
I20260811 15:07:43.272933 11535 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4e0af4de50504870984efe44f6909f3c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 15:07:43.273015 11535 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4e0af4de50504870984efe44f6909f3c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 15:07:43.273128 11535 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4e0af4de50504870984efe44f6909f3c [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:07:43.274106 11535 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4e0af4de50504870984efe44f6909f3c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e0af4de50504870984efe44f6909f3c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36353 } }
I20260811 15:07:43.274454 11535 leader_election.cc:302] T 00000000000000000000000000000000 P 4e0af4de50504870984efe44f6909f3c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4e0af4de50504870984efe44f6909f3c; no voters:
I20260811 15:07:43.274791 11535 leader_election.cc:288] T 00000000000000000000000000000000 P 4e0af4de50504870984efe44f6909f3c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 15:07:43.274904 11549 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4e0af4de50504870984efe44f6909f3c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:07:43.275095 11549 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4e0af4de50504870984efe44f6909f3c [term 1 LEADER]: Becoming Leader. State: Replica: 4e0af4de50504870984efe44f6909f3c, State: Running, Role: LEADER
I20260811 15:07:43.275396 11549 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4e0af4de50504870984efe44f6909f3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e0af4de50504870984efe44f6909f3c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36353 } }
I20260811 15:07:43.276130 11535 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4e0af4de50504870984efe44f6909f3c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:07:43.276587 11549 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4e0af4de50504870984efe44f6909f3c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4e0af4de50504870984efe44f6909f3c. Latest consensus state: current_term: 1 leader_uuid: "4e0af4de50504870984efe44f6909f3c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e0af4de50504870984efe44f6909f3c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36353 } } }
I20260811 15:07:43.276700 11549 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4e0af4de50504870984efe44f6909f3c [sys.catalog]: This master's current role is: LEADER
I20260811 15:07:43.277438 11551 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4e0af4de50504870984efe44f6909f3c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4e0af4de50504870984efe44f6909f3c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e0af4de50504870984efe44f6909f3c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36353 } } }
I20260811 15:07:43.277544 11551 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4e0af4de50504870984efe44f6909f3c [sys.catalog]: This master's current role is: LEADER
I20260811 15:07:43.277815 11554 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:07:43.277858 11539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:43.273179 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56375 (local address 127.0.0.1:36353)
0811 15:07:43.273342 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:43.273346 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:43.273522 (+ 176us) server_negotiation.cc:407] Connection header received
0811 15:07:43.273686 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:43.273689 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:43.273738 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:43.273818 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:07:43.274083 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:43.274715 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:43.275761 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:43.276000 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:43.276141 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:43.277304 (+ 1163us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:07:43.277308 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:07:43.277311 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:07:43.277323 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:07:43.277351 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:07:43.277364 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:07:43.277411 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:43.277668 (+ 257us) server_negotiation.cc:299] Negotiation successful
0811 15:07:43.277729 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 15:07:43.281605 11554 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:07:43.287719 11554 catalog_manager.cc:1347] Generated new cluster ID: 0fdf55501cf849218eb2888c7f8bab7d
I20260811 15:07:43.287796 11554 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:07:43.299556 11554 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 15:07:43.300869 11554 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:07:43.308123 11554 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4e0af4de50504870984efe44f6909f3c: Generated new TSK 0
I20260811 15:07:43.308950 11554 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 15:07:43.317689 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 11460
2026-08-11T15:07:43Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1487 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786460596631409-20401-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 15:07:43 dist-test-slave-8n49 krb5kdc[11572](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 15:07:43 dist-test-slave-8n49 krb5kdc[11572](info): set up 2 sockets
Aug 11 15:07:43 dist-test-slave-8n49 krb5kdc[11572](info): commencing operation
krb5kdc: starting...
W20260811 15:07:44.436718 20401 mini_kdc.cc:121] Time spent starting KDC: real 1.096s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786460596631409-20401-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786460596631409-20401-0/krb5kdc/test-user.keytab.
Aug 11 15:07:44 dist-test-slave-8n49 krb5kdc[11572](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460864, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T15:07:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T15:07:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786460596631409-20401-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786460596631409-20401-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 15:07:44.571305 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786460596631409-20401-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786460596631409-20401-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786460596631409-20401-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44707
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786460596631409-20401-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44707
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:07:44.685638 11588 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:07:44.685945 11588 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:07:44.686022 11588 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:07:44.690012 11588 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:07:44.690109 11588 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:07:44.690150 11588 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:07:44.690210 11588 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:07:44.690250 11588 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:07:44.695590 11588 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786460596631409-20401-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786460596631409-20401-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44707
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786460596631409-20401-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44707
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11588
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786460596631409-20401-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:07:44.696761 11588 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:07:44.697858 11588 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:07:44.706686 11594 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:07:44.706727 11595 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:07:44.706777 11588 server_base.cc:1034] running on GCE node
W20260811 15:07:44.706722 11597 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:07:44.707436 11588 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:07:44.708658 11588 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:07:44.709843 11588 hybrid_clock.cc:648] HybridClock initialized: now 1786460864709836 us; error 31 us; skew 500 ppm
Aug 11 15:07:44 dist-test-slave-8n49 krb5kdc[11572](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460864, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:07:44.712625 11588 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 15:07:44.713495 11588 webserver.cc:460] Webserver started at http://127.0.0.1:38603/ using document root <none> and password file <none>
I20260811 15:07:44.714074 11588 fs_manager.cc:359] Metadata directory not provided
I20260811 15:07:44.714169 11588 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:07:44.714408 11588 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:07:44.716488 11588 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786460596631409-20401-0/minicluster-data/master-0/data/instance:
uuid: "74ea0cada4bf479dbdddbc9ff05d08e6"
format_stamp: "Formatted at 2026-08-11 15:07:44 on dist-test-slave-8n49"
server_key: "86b074ac77a5e835ce5a36bdde5f1890"
server_key_iv: "fb8462137aef27cbfd624eb01ef61471"
server_key_version: "encryptionkey@0"
I20260811 15:07:44.717141 11588 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786460596631409-20401-0/minicluster-data/master-0/wal/instance:
uuid: "74ea0cada4bf479dbdddbc9ff05d08e6"
format_stamp: "Formatted at 2026-08-11 15:07:44 on dist-test-slave-8n49"
server_key: "86b074ac77a5e835ce5a36bdde5f1890"
server_key_iv: "fb8462137aef27cbfd624eb01ef61471"
server_key_version: "encryptionkey@0"
I20260811 15:07:44.720906 11588 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260811 15:07:44.723258 11604 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:07:44.724479 11588 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 15:07:44.724653 11588 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786460596631409-20401-0/minicluster-data/master-0/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786460596631409-20401-0/minicluster-data/master-0/wal
uuid: "74ea0cada4bf479dbdddbc9ff05d08e6"
format_stamp: "Formatted at 2026-08-11 15:07:44 on dist-test-slave-8n49"
server_key: "86b074ac77a5e835ce5a36bdde5f1890"
server_key_iv: "fb8462137aef27cbfd624eb01ef61471"
server_key_version: "encryptionkey@0"
I20260811 15:07:44.724771 11588 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786460596631409-20401-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786460596631409-20401-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786460596631409-20401-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:07:44.729393 11588 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:07:44.732210 11588 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:07:44.732439 11588 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:07:44.740095 11588 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44707
I20260811 15:07:44.740363 11659 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44707 every 8 connection(s)
I20260811 15:07:44.741123 11588 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
I20260811 15:07:44.743980 11660 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:07:44.748482 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 11588
I20260811 15:07:44.748678 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786460596631409-20401-0/minicluster-data/master-0/wal/instance
I20260811 15:07:44.748993 20401 external_mini_cluster.cc:1428] Setting key ac9a5e865d8fc21fe4701c97f47532ba
I20260811 15:07:44.749936 11660 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 74ea0cada4bf479dbdddbc9ff05d08e6: Bootstrap starting.
I20260811 15:07:44.752648 11660 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 74ea0cada4bf479dbdddbc9ff05d08e6: Neither blocks nor log segments found. Creating new log.
I20260811 15:07:44.753607 11660 log.cc:824] T 00000000000000000000000000000000 P 74ea0cada4bf479dbdddbc9ff05d08e6: Log is configured to *not* fsync() on all Append() calls
I20260811 15:07:44.754822 11664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:44.750489 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33761 (local address 127.0.0.1:44707)
0811 15:07:44.750946 (+ 457us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:44.750967 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:44.751016 (+ 49us) server_negotiation.cc:407] Connection header received
0811 15:07:44.751828 (+ 812us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:44.751851 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:44.752212 (+ 361us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:44.752649 (+ 437us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:07:44.753419 (+ 770us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:07:44.753425 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:07:44.753440 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:07:44.753454 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:07:44.753523 (+ 69us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:07:44.753551 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:07:44.753658 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:44.753800 (+ 142us) server_negotiation.cc:299] Negotiation successful
0811 15:07:44.753967 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":278,"thread_start_us":113,"threads_started":1}
I20260811 15:07:44.755826 11660 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 74ea0cada4bf479dbdddbc9ff05d08e6: No bootstrap required, opened a new log
I20260811 15:07:44.757572 20401 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 15:07:44.759533 11660 raft_consensus.cc:348] T 00000000000000000000000000000000 P 74ea0cada4bf479dbdddbc9ff05d08e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74ea0cada4bf479dbdddbc9ff05d08e6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44707 } }
I20260811 15:07:44.759825 11660 raft_consensus.cc:374] T 00000000000000000000000000000000 P 74ea0cada4bf479dbdddbc9ff05d08e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:07:44.759891 11660 raft_consensus.cc:729] T 00000000000000000000000000000000 P 74ea0cada4bf479dbdddbc9ff05d08e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74ea0cada4bf479dbdddbc9ff05d08e6, State: Initialized, Role: FOLLOWER
I20260811 15:07:44.760372 11660 consensus_queue.cc:260] T 00000000000000000000000000000000 P 74ea0cada4bf479dbdddbc9ff05d08e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74ea0cada4bf479dbdddbc9ff05d08e6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44707 } }
I20260811 15:07:44.760540 11660 raft_consensus.cc:388] T 00000000000000000000000000000000 P 74ea0cada4bf479dbdddbc9ff05d08e6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 15:07:44.760630 11660 raft_consensus.cc:482] T 00000000000000000000000000000000 P 74ea0cada4bf479dbdddbc9ff05d08e6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 15:07:44.760746 11660 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 74ea0cada4bf479dbdddbc9ff05d08e6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:07:44.761348 11664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:44.759686 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60585 (local address 127.0.0.1:44707)
0811 15:07:44.759815 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:44.759819 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:44.760126 (+ 307us) server_negotiation.cc:407] Connection header received
0811 15:07:44.760165 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:44.760167 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:44.760198 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:44.760267 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:07:44.761001 (+ 734us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:07:44.761005 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:07:44.761008 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:07:44.761019 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:07:44.761047 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:07:44.761060 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:07:44.761153 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:44.761202 (+ 49us) server_negotiation.cc:299] Negotiation successful
0811 15:07:44.761236 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 15:07:44.761855 11660 raft_consensus.cc:504] T 00000000000000000000000000000000 P 74ea0cada4bf479dbdddbc9ff05d08e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74ea0cada4bf479dbdddbc9ff05d08e6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44707 } }
I20260811 15:07:44.762207 11660 leader_election.cc:302] T 00000000000000000000000000000000 P 74ea0cada4bf479dbdddbc9ff05d08e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 74ea0cada4bf479dbdddbc9ff05d08e6; no voters:
I20260811 15:07:44.762573 11660 leader_election.cc:288] T 00000000000000000000000000000000 P 74ea0cada4bf479dbdddbc9ff05d08e6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 15:07:44.762676 11674 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 74ea0cada4bf479dbdddbc9ff05d08e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:07:44.762923 11674 raft_consensus.cc:686] T 00000000000000000000000000000000 P 74ea0cada4bf479dbdddbc9ff05d08e6 [term 1 LEADER]: Becoming Leader. State: Replica: 74ea0cada4bf479dbdddbc9ff05d08e6, State: Running, Role: LEADER
I20260811 15:07:44.763226 11674 consensus_queue.cc:237] T 00000000000000000000000000000000 P 74ea0cada4bf479dbdddbc9ff05d08e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74ea0cada4bf479dbdddbc9ff05d08e6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44707 } }
I20260811 15:07:44.763880 11660 sys_catalog.cc:564] T 00000000000000000000000000000000 P 74ea0cada4bf479dbdddbc9ff05d08e6 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:07:44.764951 11676 sys_catalog.cc:455] T 00000000000000000000000000000000 P 74ea0cada4bf479dbdddbc9ff05d08e6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 74ea0cada4bf479dbdddbc9ff05d08e6. Latest consensus state: current_term: 1 leader_uuid: "74ea0cada4bf479dbdddbc9ff05d08e6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74ea0cada4bf479dbdddbc9ff05d08e6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44707 } } }
I20260811 15:07:44.765089 11676 sys_catalog.cc:458] T 00000000000000000000000000000000 P 74ea0cada4bf479dbdddbc9ff05d08e6 [sys.catalog]: This master's current role is: LEADER
I20260811 15:07:44.765376 11675 sys_catalog.cc:455] T 00000000000000000000000000000000 P 74ea0cada4bf479dbdddbc9ff05d08e6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "74ea0cada4bf479dbdddbc9ff05d08e6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74ea0cada4bf479dbdddbc9ff05d08e6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44707 } } }
I20260811 15:07:44.765467 11675 sys_catalog.cc:458] T 00000000000000000000000000000000 P 74ea0cada4bf479dbdddbc9ff05d08e6 [sys.catalog]: This master's current role is: LEADER
I20260811 15:07:44.765559 11686 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:07:44.768357 11686 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:07:44.774084 11686 catalog_manager.cc:1347] Generated new cluster ID: 8a730a0247f24def9ebd32c0ad81b054
I20260811 15:07:44.774168 11686 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:07:44.783219 11686 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 15:07:44.783535 11686 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:07:44.789263 11686 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 74ea0cada4bf479dbdddbc9ff05d08e6: Generated new TSK 0
I20260811 15:07:44.789889 11686 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 15:07:44.794837 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 11588
2026-08-11T15:07:44Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1477 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786460596631409-20401-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 15:07:44 dist-test-slave-8n49 krb5kdc[11700](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 15:07:44 dist-test-slave-8n49 krb5kdc[11700](info): set up 2 sockets
Aug 11 15:07:44 dist-test-slave-8n49 krb5kdc[11700](info): commencing operation
krb5kdc: starting...
W20260811 15:07:45.903738 20401 mini_kdc.cc:121] Time spent starting KDC: real 1.085s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786460596631409-20401-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786460596631409-20401-0/krb5kdc/test-user.keytab.
Aug 11 15:07:45 dist-test-slave-8n49 krb5kdc[11700](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460865, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T15:07:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T15:07:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786460596631409-20401-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786460596631409-20401-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 15:07:46.033718 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786460596631409-20401-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786460596631409-20401-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786460596631409-20401-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40093
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786460596631409-20401-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41025
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40093
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:07:46.148379 11714 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:07:46.148684 11714 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:07:46.148726 11714 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:07:46.152805 11714 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:07:46.152868 11714 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:07:46.152887 11714 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:07:46.152904 11714 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:07:46.152920 11714 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:07:46.158213 11714 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41025
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786460596631409-20401-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786460596631409-20401-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40093
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786460596631409-20401-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40093
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11714
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786460596631409-20401-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:07:46.159307 11714 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:07:46.160420 11714 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:07:46.169427 11720 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:07:46.169458 11724 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:07:46.169427 11721 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:07:46.169745 11714 server_base.cc:1034] running on GCE node
I20260811 15:07:46.170385 11714 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:07:46.171496 11714 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:07:46.172691 11714 hybrid_clock.cc:648] HybridClock initialized: now 1786460866172671 us; error 35 us; skew 500 ppm
Aug 11 15:07:46 dist-test-slave-8n49 krb5kdc[11700](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460866, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:07:46.181465 11714 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 15:07:46.182542 11714 webserver.cc:460] Webserver started at http://127.0.0.1:36919/ using document root <none> and password file <none>
I20260811 15:07:46.183147 11714 fs_manager.cc:359] Metadata directory not provided
I20260811 15:07:46.183243 11714 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:07:46.183504 11714 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:07:46.185761 11714 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786460596631409-20401-0/minicluster-data/master-0/data/instance:
uuid: "193460065309422590a9bfb3814cbc5d"
format_stamp: "Formatted at 2026-08-11 15:07:46 on dist-test-slave-8n49"
server_key: "31359042613011765bec044570fd0932"
server_key_iv: "29b4fb92b76dbd5c919a6eca18bec8a5"
server_key_version: "encryptionkey@0"
I20260811 15:07:46.186375 11714 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786460596631409-20401-0/minicluster-data/master-0/wal/instance:
uuid: "193460065309422590a9bfb3814cbc5d"
format_stamp: "Formatted at 2026-08-11 15:07:46 on dist-test-slave-8n49"
server_key: "31359042613011765bec044570fd0932"
server_key_iv: "29b4fb92b76dbd5c919a6eca18bec8a5"
server_key_version: "encryptionkey@0"
I20260811 15:07:46.190346 11714 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 15:07:46.192898 11732 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:07:46.194149 11714 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260811 15:07:46.194299 11714 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786460596631409-20401-0/minicluster-data/master-0/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786460596631409-20401-0/minicluster-data/master-0/wal
uuid: "193460065309422590a9bfb3814cbc5d"
format_stamp: "Formatted at 2026-08-11 15:07:46 on dist-test-slave-8n49"
server_key: "31359042613011765bec044570fd0932"
server_key_iv: "29b4fb92b76dbd5c919a6eca18bec8a5"
server_key_version: "encryptionkey@0"
I20260811 15:07:46.194422 11714 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786460596631409-20401-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786460596631409-20401-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786460596631409-20401-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:07:46.212289 11714 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:07:46.215523 11714 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:07:46.215739 11714 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:07:46.223279 11714 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40093
I20260811 15:07:46.223299 11788 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40093 every 8 connection(s)
I20260811 15:07:46.224315 11714 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
I20260811 15:07:46.227223 11789 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:07:46.231185 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 11714
I20260811 15:07:46.231308 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786460596631409-20401-0/minicluster-data/master-0/wal/instance
I20260811 15:07:46.231617 20401 external_mini_cluster.cc:1428] Setting key 1b1fba684b1a3b5c71c62e6f5ad72318
I20260811 15:07:46.233495 11789 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 193460065309422590a9bfb3814cbc5d: Bootstrap starting.
I20260811 15:07:46.236347 11789 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 193460065309422590a9bfb3814cbc5d: Neither blocks nor log segments found. Creating new log.
I20260811 15:07:46.237171 11789 log.cc:824] T 00000000000000000000000000000000 P 193460065309422590a9bfb3814cbc5d: Log is configured to *not* fsync() on all Append() calls
I20260811 15:07:46.239427 11789 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 193460065309422590a9bfb3814cbc5d: No bootstrap required, opened a new log
Aug 11 15:07:46 dist-test-slave-8n49 krb5kdc[11700](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460865, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 15:07:46.243415 11789 raft_consensus.cc:348] T 00000000000000000000000000000000 P 193460065309422590a9bfb3814cbc5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "193460065309422590a9bfb3814cbc5d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40093 } }
I20260811 15:07:46.243676 11789 raft_consensus.cc:374] T 00000000000000000000000000000000 P 193460065309422590a9bfb3814cbc5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:07:46.243757 11789 raft_consensus.cc:729] T 00000000000000000000000000000000 P 193460065309422590a9bfb3814cbc5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 193460065309422590a9bfb3814cbc5d, State: Initialized, Role: FOLLOWER
I20260811 15:07:46.244256 11789 consensus_queue.cc:260] T 00000000000000000000000000000000 P 193460065309422590a9bfb3814cbc5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "193460065309422590a9bfb3814cbc5d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40093 } }
I20260811 15:07:46.244408 11789 raft_consensus.cc:388] T 00000000000000000000000000000000 P 193460065309422590a9bfb3814cbc5d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 15:07:46.244500 11789 raft_consensus.cc:482] T 00000000000000000000000000000000 P 193460065309422590a9bfb3814cbc5d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 15:07:46.244630 11789 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 193460065309422590a9bfb3814cbc5d [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:07:46.245549 11789 raft_consensus.cc:504] T 00000000000000000000000000000000 P 193460065309422590a9bfb3814cbc5d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "193460065309422590a9bfb3814cbc5d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40093 } }
I20260811 15:07:46.245934 11789 leader_election.cc:302] T 00000000000000000000000000000000 P 193460065309422590a9bfb3814cbc5d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 193460065309422590a9bfb3814cbc5d; no voters:
I20260811 15:07:46.246274 11789 leader_election.cc:288] T 00000000000000000000000000000000 P 193460065309422590a9bfb3814cbc5d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 15:07:46.246381 11794 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 193460065309422590a9bfb3814cbc5d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:07:46.246658 11794 raft_consensus.cc:686] T 00000000000000000000000000000000 P 193460065309422590a9bfb3814cbc5d [term 1 LEADER]: Becoming Leader. State: Replica: 193460065309422590a9bfb3814cbc5d, State: Running, Role: LEADER
I20260811 15:07:46.247007 11794 consensus_queue.cc:237] T 00000000000000000000000000000000 P 193460065309422590a9bfb3814cbc5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "193460065309422590a9bfb3814cbc5d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40093 } }
I20260811 15:07:46.247172 11792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:46.233344 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.25:57295 (local address 127.0.0.1:40093)
0811 15:07:46.233780 (+ 436us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:46.233797 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:46.233834 (+ 37us) server_negotiation.cc:407] Connection header received
0811 15:07:46.234481 (+ 647us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:46.234498 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:46.234834 (+ 336us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:46.235111 (+ 277us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:07:46.236150 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:46.237332 (+ 1182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:46.238408 (+ 1076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:46.238869 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:46.238996 (+ 127us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:46.242008 (+ 3012us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:07:46.242014 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:07:46.242027 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:07:46.242055 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:07:46.243881 (+ 1826us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:07:46.244408 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:07:46.244415 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:07:46.244421 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:07:46.244596 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:07:46.244968 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:07:46.244972 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:07:46.244973 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:07:46.245367 (+ 394us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:07:46.245609 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:46.245902 (+ 293us) server_negotiation.cc:299] Negotiation successful
0811 15:07:46.246150 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":286,"thread_start_us":141,"threads_started":1}
I20260811 15:07:46.247584 11789 sys_catalog.cc:564] T 00000000000000000000000000000000 P 193460065309422590a9bfb3814cbc5d [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:07:46.248304 11795 sys_catalog.cc:455] T 00000000000000000000000000000000 P 193460065309422590a9bfb3814cbc5d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 193460065309422590a9bfb3814cbc5d. Latest consensus state: current_term: 1 leader_uuid: "193460065309422590a9bfb3814cbc5d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "193460065309422590a9bfb3814cbc5d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40093 } } }
I20260811 15:07:46.248440 11795 sys_catalog.cc:458] T 00000000000000000000000000000000 P 193460065309422590a9bfb3814cbc5d [sys.catalog]: This master's current role is: LEADER
I20260811 15:07:46.248814 11796 sys_catalog.cc:455] T 00000000000000000000000000000000 P 193460065309422590a9bfb3814cbc5d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "193460065309422590a9bfb3814cbc5d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "193460065309422590a9bfb3814cbc5d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40093 } } }
I20260811 15:07:46.248910 11796 sys_catalog.cc:458] T 00000000000000000000000000000000 P 193460065309422590a9bfb3814cbc5d [sys.catalog]: This master's current role is: LEADER
I20260811 15:07:46.250752 11803 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:07:46.250882 20401 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 15:07:46.253813 11803 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:07:46.259135 11803 catalog_manager.cc:1347] Generated new cluster ID: 4b7c0b2f4dfb4d3194c9057791432cd6
I20260811 15:07:46.259196 11803 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:07:46.266186 11792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:46.252916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.25:36963 (local address 127.0.0.1:40093)
0811 15:07:46.253075 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:46.253079 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:46.256897 (+ 3818us) server_negotiation.cc:407] Connection header received
0811 15:07:46.257359 (+ 462us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:46.257361 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:46.257403 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:46.257518 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:07:46.258353 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:46.259177 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:46.260383 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:46.260770 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:46.260868 (+ 98us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:46.262603 (+ 1735us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:07:46.262607 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:07:46.262610 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:07:46.262635 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:07:46.264254 (+ 1619us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:07:46.264904 (+ 650us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:07:46.264907 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:07:46.264909 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:07:46.264988 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:07:46.265337 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:07:46.265340 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:07:46.265342 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:07:46.265529 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:07:46.265659 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:46.265937 (+ 278us) server_negotiation.cc:299] Negotiation successful
0811 15:07:46.266029 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 15:07:46.274708 11803 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 15:07:46.276687 11803 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:07:46.282855 11803 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 193460065309422590a9bfb3814cbc5d: Generated new TSK 0
I20260811 15:07:46.283660 11803 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 15:07:46.290342 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 11714
W20260811 15:07:46.299629 11698 connection.cc:535] client connection to 127.0.0.1:40093 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:40093): Connection reset by peer (error 104)
2026-08-11T15:07:46Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1496 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786460596631409-20401-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 15:07:46 dist-test-slave-8n49 krb5kdc[11824](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 15:07:46 dist-test-slave-8n49 krb5kdc[11824](info): set up 2 sockets
Aug 11 15:07:46 dist-test-slave-8n49 krb5kdc[11824](info): commencing operation
krb5kdc: starting...
W20260811 15:07:47.408120 20401 mini_kdc.cc:121] Time spent starting KDC: real 1.094s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786460596631409-20401-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786460596631409-20401-0/krb5kdc/test-user.keytab.
Aug 11 15:07:47 dist-test-slave-8n49 krb5kdc[11824](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460867, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T15:07:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T15:07:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786460596631409-20401-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786460596631409-20401-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 15:07:47.535607 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786460596631409-20401-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786460596631409-20401-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786460596631409-20401-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45687
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786460596631409-20401-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37839
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45687
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:07:47.649183 11839 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:07:47.649504 11839 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:07:47.649590 11839 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:07:47.653693 11839 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:07:47.653779 11839 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:07:47.653818 11839 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:07:47.653877 11839 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:07:47.653918 11839 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:07:47.659248 11839 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37839
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786460596631409-20401-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786460596631409-20401-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45687
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786460596631409-20401-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45687
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11839
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786460596631409-20401-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:07:47.660363 11839 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:07:47.661522 11839 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:07:47.670337 11849 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:07:47.670385 11839 server_base.cc:1034] running on GCE node
W20260811 15:07:47.670347 11847 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:07:47.670344 11846 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:07:47.671183 11839 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:07:47.672333 11839 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:07:47.673533 11839 hybrid_clock.cc:648] HybridClock initialized: now 1786460867673510 us; error 46 us; skew 500 ppm
Aug 11 15:07:47 dist-test-slave-8n49 krb5kdc[11824](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460867, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:07:47.676313 11839 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 15:07:47.677280 11839 webserver.cc:460] Webserver started at http://127.0.0.1:42915/ using document root <none> and password file <none>
I20260811 15:07:47.677860 11839 fs_manager.cc:359] Metadata directory not provided
I20260811 15:07:47.677966 11839 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:07:47.678231 11839 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:07:47.680666 11839 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786460596631409-20401-0/minicluster-data/master-0/data/instance:
uuid: "d8b9536c4202488f917b852bcfc17c73"
format_stamp: "Formatted at 2026-08-11 15:07:47 on dist-test-slave-8n49"
server_key: "a35f6ced7dfef10f0b2bf5c851006b2a"
server_key_iv: "bcfe7320f80d20ca093f589b7cc7b52b"
server_key_version: "encryptionkey@0"
I20260811 15:07:47.681277 11839 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786460596631409-20401-0/minicluster-data/master-0/wal/instance:
uuid: "d8b9536c4202488f917b852bcfc17c73"
format_stamp: "Formatted at 2026-08-11 15:07:47 on dist-test-slave-8n49"
server_key: "a35f6ced7dfef10f0b2bf5c851006b2a"
server_key_iv: "bcfe7320f80d20ca093f589b7cc7b52b"
server_key_version: "encryptionkey@0"
I20260811 15:07:47.685132 11839 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.004s
I20260811 15:07:47.687556 11858 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:07:47.688846 11839 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 15:07:47.688988 11839 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786460596631409-20401-0/minicluster-data/master-0/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786460596631409-20401-0/minicluster-data/master-0/wal
uuid: "d8b9536c4202488f917b852bcfc17c73"
format_stamp: "Formatted at 2026-08-11 15:07:47 on dist-test-slave-8n49"
server_key: "a35f6ced7dfef10f0b2bf5c851006b2a"
server_key_iv: "bcfe7320f80d20ca093f589b7cc7b52b"
server_key_version: "encryptionkey@0"
I20260811 15:07:47.689088 11839 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786460596631409-20401-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786460596631409-20401-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786460596631409-20401-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:07:47.709081 11839 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:07:47.712153 11839 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:07:47.712411 11839 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:07:47.719861 11839 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45687
I20260811 15:07:47.719889 11919 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45687 every 8 connection(s)
I20260811 15:07:47.720867 11839 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
I20260811 15:07:47.722085 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 11839
I20260811 15:07:47.722240 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786460596631409-20401-0/minicluster-data/master-0/wal/instance
I20260811 15:07:47.722563 20401 external_mini_cluster.cc:1428] Setting key 897546c757d4db252101dfe27b2a4100
I20260811 15:07:47.724049 11920 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:07:47.731217 11920 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d8b9536c4202488f917b852bcfc17c73: Bootstrap starting.
I20260811 15:07:47.732995 11923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:47.724013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.25:41275 (local address 127.0.0.1:45687)
0811 15:07:47.724484 (+ 471us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:47.724505 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:47.724576 (+ 71us) server_negotiation.cc:407] Connection header received
0811 15:07:47.725416 (+ 840us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:47.725438 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:47.725874 (+ 436us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:47.726240 (+ 366us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:07:47.726655 (+ 415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:47.728160 (+ 1505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:47.729169 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:47.729872 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:47.730053 (+ 181us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:47.730937 (+ 884us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:07:47.730944 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:07:47.730959 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:07:47.731454 (+ 495us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:07:47.731539 (+ 85us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:07:47.731571 (+ 32us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:07:47.731702 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:47.731874 (+ 172us) server_negotiation.cc:299] Negotiation successful
0811 15:07:47.732006 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":314,"thread_start_us":164,"threads_started":1}
I20260811 15:07:47.734061 11920 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d8b9536c4202488f917b852bcfc17c73: Neither blocks nor log segments found. Creating new log.
I20260811 15:07:47.734834 11920 log.cc:824] T 00000000000000000000000000000000 P d8b9536c4202488f917b852bcfc17c73: Log is configured to *not* fsync() on all Append() calls
I20260811 15:07:47.736181 20401 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 15:07:47.737318 11920 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d8b9536c4202488f917b852bcfc17c73: No bootstrap required, opened a new log
I20260811 15:07:47.741171 11920 raft_consensus.cc:348] T 00000000000000000000000000000000 P d8b9536c4202488f917b852bcfc17c73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8b9536c4202488f917b852bcfc17c73" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45687 } }
I20260811 15:07:47.741456 11920 raft_consensus.cc:374] T 00000000000000000000000000000000 P d8b9536c4202488f917b852bcfc17c73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:07:47.741539 11920 raft_consensus.cc:729] T 00000000000000000000000000000000 P d8b9536c4202488f917b852bcfc17c73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8b9536c4202488f917b852bcfc17c73, State: Initialized, Role: FOLLOWER
I20260811 15:07:47.742058 11920 consensus_queue.cc:260] T 00000000000000000000000000000000 P d8b9536c4202488f917b852bcfc17c73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8b9536c4202488f917b852bcfc17c73" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45687 } }
I20260811 15:07:47.742236 11920 raft_consensus.cc:388] T 00000000000000000000000000000000 P d8b9536c4202488f917b852bcfc17c73 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 15:07:47.742305 11920 raft_consensus.cc:482] T 00000000000000000000000000000000 P d8b9536c4202488f917b852bcfc17c73 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 15:07:47.742414 11920 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d8b9536c4202488f917b852bcfc17c73 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:07:47.743173 11923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:47.738457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.25:51217 (local address 127.0.0.1:45687)
0811 15:07:47.738602 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:47.738606 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:47.738798 (+ 192us) server_negotiation.cc:407] Connection header received
0811 15:07:47.738914 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:47.738916 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:47.738952 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:47.739022 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:07:47.739317 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:47.740182 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:47.741331 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:47.741702 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:47.741816 (+ 114us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:47.742698 (+ 882us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:07:47.742702 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:07:47.742704 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:07:47.742716 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:07:47.742741 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:07:47.742752 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:07:47.742823 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:47.742975 (+ 152us) server_negotiation.cc:299] Negotiation successful
0811 15:07:47.743008 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 15:07:47.743664 11920 raft_consensus.cc:504] T 00000000000000000000000000000000 P d8b9536c4202488f917b852bcfc17c73 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8b9536c4202488f917b852bcfc17c73" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45687 } }
I20260811 15:07:47.744032 11920 leader_election.cc:302] T 00000000000000000000000000000000 P d8b9536c4202488f917b852bcfc17c73 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d8b9536c4202488f917b852bcfc17c73; no voters:
I20260811 15:07:47.744352 11920 leader_election.cc:288] T 00000000000000000000000000000000 P d8b9536c4202488f917b852bcfc17c73 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 15:07:47.744488 11931 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d8b9536c4202488f917b852bcfc17c73 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:07:47.744757 11931 raft_consensus.cc:686] T 00000000000000000000000000000000 P d8b9536c4202488f917b852bcfc17c73 [term 1 LEADER]: Becoming Leader. State: Replica: d8b9536c4202488f917b852bcfc17c73, State: Running, Role: LEADER
I20260811 15:07:47.745105 11931 consensus_queue.cc:237] T 00000000000000000000000000000000 P d8b9536c4202488f917b852bcfc17c73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8b9536c4202488f917b852bcfc17c73" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45687 } }
I20260811 15:07:47.745652 11920 sys_catalog.cc:564] T 00000000000000000000000000000000 P d8b9536c4202488f917b852bcfc17c73 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:07:47.746780 11932 sys_catalog.cc:455] T 00000000000000000000000000000000 P d8b9536c4202488f917b852bcfc17c73 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d8b9536c4202488f917b852bcfc17c73" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8b9536c4202488f917b852bcfc17c73" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45687 } } }
I20260811 15:07:47.746917 11932 sys_catalog.cc:458] T 00000000000000000000000000000000 P d8b9536c4202488f917b852bcfc17c73 [sys.catalog]: This master's current role is: LEADER
I20260811 15:07:47.747205 11933 sys_catalog.cc:455] T 00000000000000000000000000000000 P d8b9536c4202488f917b852bcfc17c73 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d8b9536c4202488f917b852bcfc17c73. Latest consensus state: current_term: 1 leader_uuid: "d8b9536c4202488f917b852bcfc17c73" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8b9536c4202488f917b852bcfc17c73" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45687 } } }
I20260811 15:07:47.747311 11933 sys_catalog.cc:458] T 00000000000000000000000000000000 P d8b9536c4202488f917b852bcfc17c73 [sys.catalog]: This master's current role is: LEADER
I20260811 15:07:47.748103 11941 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:07:47.750838 11941 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:07:47.756264 11941 catalog_manager.cc:1347] Generated new cluster ID: d328d7a3111841bba7b6c429a25dcd12
I20260811 15:07:47.756335 11941 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:07:47.768818 11941 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 15:07:47.769758 11941 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:07:47.777226 11941 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d8b9536c4202488f917b852bcfc17c73: Generated new TSK 0
I20260811 15:07:47.777918 11941 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 15:07:47.781919 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 11839
W20260811 15:07:47.793545 11822 connection.cc:535] client connection to 127.0.0.1:45687 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:45687): Connection reset by peer (error 104)
2026-08-11T15:07:47Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1493 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786460596631409-20401-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 15:07:47 dist-test-slave-8n49 krb5kdc[11955](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 15:07:47 dist-test-slave-8n49 krb5kdc[11955](info): set up 2 sockets
Aug 11 15:07:47 dist-test-slave-8n49 krb5kdc[11955](info): commencing operation
krb5kdc: starting...
W20260811 15:07:48.907136 20401 mini_kdc.cc:121] Time spent starting KDC: real 1.099s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786460596631409-20401-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786460596631409-20401-0/krb5kdc/test-user.keytab.
Aug 11 15:07:48 dist-test-slave-8n49 krb5kdc[11955](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460868, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T15:07:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T15:07:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786460596631409-20401-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786460596631409-20401-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 15:07:49.035816 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786460596631409-20401-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786460596631409-20401-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786460596631409-20401-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42943
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786460596631409-20401-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40799
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42943
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:07:49.150009 11970 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:07:49.150285 11970 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:07:49.150326 11970 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:07:49.154280 11970 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:07:49.154333 11970 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:07:49.154352 11970 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:07:49.154369 11970 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:07:49.154384 11970 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:07:49.159596 11970 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40799
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786460596631409-20401-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786460596631409-20401-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42943
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786460596631409-20401-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42943
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11970
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786460596631409-20401-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:07:49.160653 11970 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:07:49.161672 11970 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:07:49.170301 11978 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:07:49.170295 11976 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:07:49.170389 11975 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:07:49.170444 11970 server_base.cc:1034] running on GCE node
I20260811 15:07:49.171113 11970 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:07:49.172276 11970 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:07:49.173461 11970 hybrid_clock.cc:648] HybridClock initialized: now 1786460869173440 us; error 35 us; skew 500 ppm
Aug 11 15:07:49 dist-test-slave-8n49 krb5kdc[11955](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460869, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:07:49.176159 11970 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 15:07:49.177161 11970 webserver.cc:460] Webserver started at http://127.0.0.1:42151/ using document root <none> and password file <none>
I20260811 15:07:49.177755 11970 fs_manager.cc:359] Metadata directory not provided
I20260811 15:07:49.177851 11970 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:07:49.178090 11970 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:07:49.180155 11970 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786460596631409-20401-0/minicluster-data/master-0/data/instance:
uuid: "4c80a565888c4485b86deba5f9ddc8c0"
format_stamp: "Formatted at 2026-08-11 15:07:49 on dist-test-slave-8n49"
server_key: "760c48691b76288ca20435db64a1f96e"
server_key_iv: "f1f4bec0cf034b2a7237a066f04c8e7f"
server_key_version: "encryptionkey@0"
I20260811 15:07:49.180795 11970 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786460596631409-20401-0/minicluster-data/master-0/wal/instance:
uuid: "4c80a565888c4485b86deba5f9ddc8c0"
format_stamp: "Formatted at 2026-08-11 15:07:49 on dist-test-slave-8n49"
server_key: "760c48691b76288ca20435db64a1f96e"
server_key_iv: "f1f4bec0cf034b2a7237a066f04c8e7f"
server_key_version: "encryptionkey@0"
I20260811 15:07:49.184469 11970 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260811 15:07:49.186839 11986 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:07:49.188126 11970 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 15:07:49.188256 11970 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786460596631409-20401-0/minicluster-data/master-0/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786460596631409-20401-0/minicluster-data/master-0/wal
uuid: "4c80a565888c4485b86deba5f9ddc8c0"
format_stamp: "Formatted at 2026-08-11 15:07:49 on dist-test-slave-8n49"
server_key: "760c48691b76288ca20435db64a1f96e"
server_key_iv: "f1f4bec0cf034b2a7237a066f04c8e7f"
server_key_version: "encryptionkey@0"
I20260811 15:07:49.188361 11970 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786460596631409-20401-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786460596631409-20401-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786460596631409-20401-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:07:49.192889 11970 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:07:49.195837 11970 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:07:49.196030 11970 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:07:49.202855 11970 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42943
I20260811 15:07:49.202929 12044 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42943 every 8 connection(s)
I20260811 15:07:49.203828 11970 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
I20260811 15:07:49.206736 12046 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:07:49.212677 12046 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4c80a565888c4485b86deba5f9ddc8c0: Bootstrap starting.
I20260811 15:07:49.212824 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 11970
I20260811 15:07:49.212996 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786460596631409-20401-0/minicluster-data/master-0/wal/instance
I20260811 15:07:49.213276 20401 external_mini_cluster.cc:1428] Setting key 5c266243315c02a6882e1ff14e8bd344
I20260811 15:07:49.215669 12046 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4c80a565888c4485b86deba5f9ddc8c0: Neither blocks nor log segments found. Creating new log.
I20260811 15:07:49.216647 12046 log.cc:824] T 00000000000000000000000000000000 P 4c80a565888c4485b86deba5f9ddc8c0: Log is configured to *not* fsync() on all Append() calls
I20260811 15:07:49.218767 12046 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4c80a565888c4485b86deba5f9ddc8c0: No bootstrap required, opened a new log
I20260811 15:07:49.220480 12049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:49.214723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.25:58203 (local address 127.0.0.1:42943)
0811 15:07:49.215177 (+ 454us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:49.215198 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:49.215244 (+ 46us) server_negotiation.cc:407] Connection header received
0811 15:07:49.216216 (+ 972us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:49.216241 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:49.216657 (+ 416us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:49.217048 (+ 391us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:07:49.219204 (+ 2156us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:07:49.219210 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:07:49.219222 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:07:49.219234 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:07:49.219291 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:07:49.219311 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:07:49.219407 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:49.219555 (+ 148us) server_negotiation.cc:299] Negotiation successful
0811 15:07:49.219746 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":283,"thread_start_us":111,"threads_started":1}
I20260811 15:07:49.223163 12046 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4c80a565888c4485b86deba5f9ddc8c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c80a565888c4485b86deba5f9ddc8c0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42943 } }
I20260811 15:07:49.223469 12046 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4c80a565888c4485b86deba5f9ddc8c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:07:49.223495 20401 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 15:07:49.223558 12046 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4c80a565888c4485b86deba5f9ddc8c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c80a565888c4485b86deba5f9ddc8c0, State: Initialized, Role: FOLLOWER
I20260811 15:07:49.223984 12046 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4c80a565888c4485b86deba5f9ddc8c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c80a565888c4485b86deba5f9ddc8c0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42943 } }
I20260811 15:07:49.224135 12046 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4c80a565888c4485b86deba5f9ddc8c0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 15:07:49.224222 12046 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4c80a565888c4485b86deba5f9ddc8c0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 15:07:49.224323 12046 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4c80a565888c4485b86deba5f9ddc8c0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:07:49.225423 12046 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4c80a565888c4485b86deba5f9ddc8c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c80a565888c4485b86deba5f9ddc8c0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42943 } }
I20260811 15:07:49.225812 12046 leader_election.cc:302] T 00000000000000000000000000000000 P 4c80a565888c4485b86deba5f9ddc8c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4c80a565888c4485b86deba5f9ddc8c0; no voters:
I20260811 15:07:49.226243 12046 leader_election.cc:288] T 00000000000000000000000000000000 P 4c80a565888c4485b86deba5f9ddc8c0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 15:07:49.226307 12056 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4c80a565888c4485b86deba5f9ddc8c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:07:49.226527 12056 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4c80a565888c4485b86deba5f9ddc8c0 [term 1 LEADER]: Becoming Leader. State: Replica: 4c80a565888c4485b86deba5f9ddc8c0, State: Running, Role: LEADER
I20260811 15:07:49.226830 12056 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4c80a565888c4485b86deba5f9ddc8c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c80a565888c4485b86deba5f9ddc8c0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42943 } }
I20260811 15:07:49.227623 12046 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4c80a565888c4485b86deba5f9ddc8c0 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:07:49.227914 12049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:49.225845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.25:44183 (local address 127.0.0.1:42943)
0811 15:07:49.226006 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:49.226011 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:49.226192 (+ 181us) server_negotiation.cc:407] Connection header received
0811 15:07:49.226357 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:49.226360 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:49.226402 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:49.226478 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:07:49.227238 (+ 760us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:07:49.227241 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:07:49.227244 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:07:49.227255 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:07:49.227281 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:07:49.227293 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:07:49.227711 (+ 418us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:49.227748 (+ 37us) server_negotiation.cc:299] Negotiation successful
0811 15:07:49.227787 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 15:07:49.228202 12057 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c80a565888c4485b86deba5f9ddc8c0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4c80a565888c4485b86deba5f9ddc8c0. Latest consensus state: current_term: 1 leader_uuid: "4c80a565888c4485b86deba5f9ddc8c0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c80a565888c4485b86deba5f9ddc8c0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42943 } } }
I20260811 15:07:49.228180 12058 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c80a565888c4485b86deba5f9ddc8c0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4c80a565888c4485b86deba5f9ddc8c0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c80a565888c4485b86deba5f9ddc8c0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42943 } } }
I20260811 15:07:49.228333 12057 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c80a565888c4485b86deba5f9ddc8c0 [sys.catalog]: This master's current role is: LEADER
I20260811 15:07:49.228333 12058 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c80a565888c4485b86deba5f9ddc8c0 [sys.catalog]: This master's current role is: LEADER
W20260811 15:07:49.232306 12072 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4c80a565888c4485b86deba5f9ddc8c0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 15:07:49.232425 12072 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 15:07:49.232510 12062 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:07:49.233264 12062 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:07:49.238508 12062 catalog_manager.cc:1347] Generated new cluster ID: 804f653b675047f7ae60a18ce7bd871b
I20260811 15:07:49.238582 12062 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:07:49.268785 12062 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 15:07:49.269120 12062 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:07:49.279793 12062 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4c80a565888c4485b86deba5f9ddc8c0: Generated new TSK 0
I20260811 15:07:49.280495 12062 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 15:07:49.284693 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 11970
2026-08-11T15:07:49Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1503 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786460596631409-20401-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 15:07:49 dist-test-slave-8n49 krb5kdc[12078](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 15:07:49 dist-test-slave-8n49 krb5kdc[12078](info): set up 2 sockets
Aug 11 15:07:49 dist-test-slave-8n49 krb5kdc[12078](info): commencing operation
krb5kdc: starting...
W20260811 15:07:50.405007 20401 mini_kdc.cc:121] Time spent starting KDC: real 1.093s user 0.006s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786460596631409-20401-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786460596631409-20401-0/krb5kdc/test-user.keytab.
Aug 11 15:07:50 dist-test-slave-8n49 krb5kdc[12078](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460870, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T15:07:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T15:07:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786460596631409-20401-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786460596631409-20401-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 15:07:50.539877 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786460596631409-20401-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786460596631409-20401-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786460596631409-20401-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35509
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786460596631409-20401-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43657
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35509
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:07:50.653400 12092 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:07:50.653728 12092 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:07:50.653817 12092 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:07:50.657979 12092 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:07:50.658072 12092 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:07:50.658110 12092 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:07:50.658170 12092 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:07:50.658213 12092 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:07:50.663585 12092 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43657
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786460596631409-20401-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786460596631409-20401-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35509
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786460596631409-20401-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35509
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12092
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786460596631409-20401-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:07:50.664821 12092 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:07:50.665894 12092 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:07:50.674691 12098 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:07:50.674683 12101 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:07:50.674662 12099 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:07:50.674820 12092 server_base.cc:1034] running on GCE node
I20260811 15:07:50.675558 12092 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:07:50.676738 12092 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:07:50.677923 12092 hybrid_clock.cc:648] HybridClock initialized: now 1786460870677909 us; error 27 us; skew 500 ppm
Aug 11 15:07:50 dist-test-slave-8n49 krb5kdc[12078](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460870, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:07:50.680737 12092 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 15:07:50.681640 12092 webserver.cc:460] Webserver started at http://127.0.0.1:33997/ using document root <none> and password file <none>
I20260811 15:07:50.682164 12092 fs_manager.cc:359] Metadata directory not provided
I20260811 15:07:50.682224 12092 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:07:50.682391 12092 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:07:50.684464 12092 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786460596631409-20401-0/minicluster-data/master-0/data/instance:
uuid: "679efcf1b0f746f2b675de54004ce79c"
format_stamp: "Formatted at 2026-08-11 15:07:50 on dist-test-slave-8n49"
server_key: "8e2c5e9a2f9bf3574bbc14543885423e"
server_key_iv: "358cda22d4c5c84ae4aa3db91f14ce5c"
server_key_version: "encryptionkey@0"
I20260811 15:07:50.685070 12092 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786460596631409-20401-0/minicluster-data/master-0/wal/instance:
uuid: "679efcf1b0f746f2b675de54004ce79c"
format_stamp: "Formatted at 2026-08-11 15:07:50 on dist-test-slave-8n49"
server_key: "8e2c5e9a2f9bf3574bbc14543885423e"
server_key_iv: "358cda22d4c5c84ae4aa3db91f14ce5c"
server_key_version: "encryptionkey@0"
I20260811 15:07:50.688817 12092 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 15:07:50.691175 12112 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:07:50.692442 12092 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 15:07:50.692623 12092 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786460596631409-20401-0/minicluster-data/master-0/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786460596631409-20401-0/minicluster-data/master-0/wal
uuid: "679efcf1b0f746f2b675de54004ce79c"
format_stamp: "Formatted at 2026-08-11 15:07:50 on dist-test-slave-8n49"
server_key: "8e2c5e9a2f9bf3574bbc14543885423e"
server_key_iv: "358cda22d4c5c84ae4aa3db91f14ce5c"
server_key_version: "encryptionkey@0"
I20260811 15:07:50.692732 12092 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786460596631409-20401-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786460596631409-20401-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786460596631409-20401-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:07:50.713299 12092 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:07:50.716456 12092 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:07:50.716712 12092 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:07:50.724357 12092 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35509
I20260811 15:07:50.724375 12165 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35509 every 8 connection(s)
I20260811 15:07:50.725392 12092 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
I20260811 15:07:50.726953 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 12092
I20260811 15:07:50.727110 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786460596631409-20401-0/minicluster-data/master-0/wal/instance
I20260811 15:07:50.727421 20401 external_mini_cluster.cc:1428] Setting key a40674b005b1d97d61963e7e12af6814
I20260811 15:07:50.728827 12166 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:07:50.735862 12166 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 679efcf1b0f746f2b675de54004ce79c: Bootstrap starting.
Aug 11 15:07:50 dist-test-slave-8n49 krb5kdc[12078](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460870, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 15:07:50.738487 12166 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 679efcf1b0f746f2b675de54004ce79c: Neither blocks nor log segments found. Creating new log.
I20260811 15:07:50.739264 12166 log.cc:824] T 00000000000000000000000000000000 P 679efcf1b0f746f2b675de54004ce79c: Log is configured to *not* fsync() on all Append() calls
I20260811 15:07:50.741684 12166 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 679efcf1b0f746f2b675de54004ce79c: No bootstrap required, opened a new log
I20260811 15:07:50.743497 12169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:50.728922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.25:48383 (local address 127.0.0.1:35509)
0811 15:07:50.729382 (+ 460us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:50.729398 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:50.729435 (+ 37us) server_negotiation.cc:407] Connection header received
0811 15:07:50.730126 (+ 691us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:50.730144 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:50.730499 (+ 355us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:50.730793 (+ 294us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:07:50.731806 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:50.733012 (+ 1206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:50.734198 (+ 1186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:50.734702 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:50.734839 (+ 137us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:50.737929 (+ 3090us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:07:50.737935 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:07:50.737949 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:07:50.737982 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:07:50.740046 (+ 2064us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:07:50.740749 (+ 703us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:07:50.740754 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:07:50.740760 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:07:50.740889 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:07:50.741289 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:07:50.741292 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:07:50.741293 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:07:50.741704 (+ 411us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:07:50.741959 (+ 255us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:50.742305 (+ 346us) server_negotiation.cc:299] Negotiation successful
0811 15:07:50.742550 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":296,"thread_start_us":142,"threads_started":1}
I20260811 15:07:50.745050 12166 raft_consensus.cc:348] T 00000000000000000000000000000000 P 679efcf1b0f746f2b675de54004ce79c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "679efcf1b0f746f2b675de54004ce79c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35509 } }
I20260811 15:07:50.745337 12166 raft_consensus.cc:374] T 00000000000000000000000000000000 P 679efcf1b0f746f2b675de54004ce79c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:07:50.745421 12166 raft_consensus.cc:729] T 00000000000000000000000000000000 P 679efcf1b0f746f2b675de54004ce79c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 679efcf1b0f746f2b675de54004ce79c, State: Initialized, Role: FOLLOWER
I20260811 15:07:50.745946 12166 consensus_queue.cc:260] T 00000000000000000000000000000000 P 679efcf1b0f746f2b675de54004ce79c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "679efcf1b0f746f2b675de54004ce79c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35509 } }
I20260811 15:07:50.746155 12166 raft_consensus.cc:388] T 00000000000000000000000000000000 P 679efcf1b0f746f2b675de54004ce79c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 15:07:50.746233 12166 raft_consensus.cc:482] T 00000000000000000000000000000000 P 679efcf1b0f746f2b675de54004ce79c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 15:07:50.746335 12166 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 679efcf1b0f746f2b675de54004ce79c [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:07:50.746796 20401 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 15:07:50.747442 12166 raft_consensus.cc:504] T 00000000000000000000000000000000 P 679efcf1b0f746f2b675de54004ce79c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "679efcf1b0f746f2b675de54004ce79c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35509 } }
I20260811 15:07:50.747798 12166 leader_election.cc:302] T 00000000000000000000000000000000 P 679efcf1b0f746f2b675de54004ce79c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 679efcf1b0f746f2b675de54004ce79c; no voters:
I20260811 15:07:50.748202 12166 leader_election.cc:288] T 00000000000000000000000000000000 P 679efcf1b0f746f2b675de54004ce79c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 15:07:50.748274 12176 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 679efcf1b0f746f2b675de54004ce79c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:07:50.748503 12176 raft_consensus.cc:686] T 00000000000000000000000000000000 P 679efcf1b0f746f2b675de54004ce79c [term 1 LEADER]: Becoming Leader. State: Replica: 679efcf1b0f746f2b675de54004ce79c, State: Running, Role: LEADER
I20260811 15:07:50.748894 12176 consensus_queue.cc:237] T 00000000000000000000000000000000 P 679efcf1b0f746f2b675de54004ce79c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "679efcf1b0f746f2b675de54004ce79c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35509 } }
I20260811 15:07:50.749590 12166 sys_catalog.cc:564] T 00000000000000000000000000000000 P 679efcf1b0f746f2b675de54004ce79c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:07:50.750229 12176 sys_catalog.cc:455] T 00000000000000000000000000000000 P 679efcf1b0f746f2b675de54004ce79c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 679efcf1b0f746f2b675de54004ce79c. Latest consensus state: current_term: 1 leader_uuid: "679efcf1b0f746f2b675de54004ce79c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "679efcf1b0f746f2b675de54004ce79c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35509 } } }
I20260811 15:07:50.750432 12176 sys_catalog.cc:458] T 00000000000000000000000000000000 P 679efcf1b0f746f2b675de54004ce79c [sys.catalog]: This master's current role is: LEADER
I20260811 15:07:50.750682 12178 sys_catalog.cc:455] T 00000000000000000000000000000000 P 679efcf1b0f746f2b675de54004ce79c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "679efcf1b0f746f2b675de54004ce79c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "679efcf1b0f746f2b675de54004ce79c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35509 } } }
I20260811 15:07:50.750800 12178 sys_catalog.cc:458] T 00000000000000000000000000000000 P 679efcf1b0f746f2b675de54004ce79c [sys.catalog]: This master's current role is: LEADER
I20260811 15:07:50.751157 12191 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:07:50.754467 12191 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:07:50.759063 12169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:50.749081 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.25:41585 (local address 127.0.0.1:35509)
0811 15:07:50.749217 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:50.749221 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:50.749457 (+ 236us) server_negotiation.cc:407] Connection header received
0811 15:07:50.749664 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:50.749667 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:50.749727 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:50.749804 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:07:50.750773 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:50.751609 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:50.752897 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:50.753260 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:50.753362 (+ 102us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:50.755060 (+ 1698us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:07:50.755064 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:07:50.755066 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:07:50.755091 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:07:50.756726 (+ 1635us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:07:50.757313 (+ 587us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:07:50.757317 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:07:50.757318 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:07:50.757405 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:07:50.757826 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:07:50.757829 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:07:50.757831 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:07:50.758041 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:07:50.758180 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:50.758824 (+ 644us) server_negotiation.cc:299] Negotiation successful
0811 15:07:50.758904 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":64}
I20260811 15:07:50.761076 12191 catalog_manager.cc:1347] Generated new cluster ID: 56abb13257714afc85142a3d9d71bb90
I20260811 15:07:50.761154 12191 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:07:50.799382 12191 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 15:07:50.800369 12191 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:07:50.816458 12191 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 679efcf1b0f746f2b675de54004ce79c: Generated new TSK 0
I20260811 15:07:50.817379 12191 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 15:07:50.832846 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 12092
W20260811 15:07:50.843650 12076 connection.cc:535] client connection to 127.0.0.1:35509 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:35509): Connection reset by peer (error 104)
2026-08-11T15:07:50Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1546 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786460596631409-20401-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 15:07:50 dist-test-slave-8n49 krb5kdc[12208](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 15:07:50 dist-test-slave-8n49 krb5kdc[12208](info): set up 2 sockets
Aug 11 15:07:50 dist-test-slave-8n49 krb5kdc[12208](info): commencing operation
krb5kdc: starting...
W20260811 15:07:51.954458 20401 mini_kdc.cc:121] Time spent starting KDC: real 1.096s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786460596631409-20401-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786460596631409-20401-0/krb5kdc/test-user.keytab.
Aug 11 15:07:52 dist-test-slave-8n49 krb5kdc[12208](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460872, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T15:07:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T15:07:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786460596631409-20401-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786460596631409-20401-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 15:07:52.083441 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786460596631409-20401-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786460596631409-20401-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786460596631409-20401-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36125
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786460596631409-20401-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41671
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36125
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:07:52.196477 12221 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:07:52.196770 12221 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:07:52.196810 12221 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:07:52.200727 12221 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:07:52.200780 12221 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:07:52.200799 12221 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:07:52.200815 12221 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:07:52.200830 12221 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:07:52.206224 12221 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41671
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786460596631409-20401-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786460596631409-20401-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36125
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786460596631409-20401-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36125
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12221
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786460596631409-20401-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:07:52.207319 12221 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:07:52.208323 12221 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:07:52.216943 12227 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:07:52.216953 12229 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:07:52.216953 12226 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:07:52.217216 12221 server_base.cc:1034] running on GCE node
I20260811 15:07:52.217761 12221 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:07:52.218834 12221 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:07:52.220026 12221 hybrid_clock.cc:648] HybridClock initialized: now 1786460872219997 us; error 44 us; skew 500 ppm
Aug 11 15:07:52 dist-test-slave-8n49 krb5kdc[12208](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460872, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:07:52.226236 12221 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 15:07:52.227216 12221 webserver.cc:460] Webserver started at http://127.0.0.1:34221/ using document root <none> and password file <none>
I20260811 15:07:52.227808 12221 fs_manager.cc:359] Metadata directory not provided
I20260811 15:07:52.227901 12221 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:07:52.228147 12221 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:07:52.230357 12221 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786460596631409-20401-0/minicluster-data/master-0/data/instance:
uuid: "bb75f1183617455eaf1f54bd1d6fc269"
format_stamp: "Formatted at 2026-08-11 15:07:52 on dist-test-slave-8n49"
server_key: "29a660bd98cbea111a29b325400c01f0"
server_key_iv: "e62df54f7d800db0ed35f64909a63307"
server_key_version: "encryptionkey@0"
I20260811 15:07:52.230943 12221 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786460596631409-20401-0/minicluster-data/master-0/wal/instance:
uuid: "bb75f1183617455eaf1f54bd1d6fc269"
format_stamp: "Formatted at 2026-08-11 15:07:52 on dist-test-slave-8n49"
server_key: "29a660bd98cbea111a29b325400c01f0"
server_key_iv: "e62df54f7d800db0ed35f64909a63307"
server_key_version: "encryptionkey@0"
I20260811 15:07:52.234822 12221 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260811 15:07:52.237326 12236 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:07:52.238482 12221 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260811 15:07:52.238624 12221 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786460596631409-20401-0/minicluster-data/master-0/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786460596631409-20401-0/minicluster-data/master-0/wal
uuid: "bb75f1183617455eaf1f54bd1d6fc269"
format_stamp: "Formatted at 2026-08-11 15:07:52 on dist-test-slave-8n49"
server_key: "29a660bd98cbea111a29b325400c01f0"
server_key_iv: "e62df54f7d800db0ed35f64909a63307"
server_key_version: "encryptionkey@0"
I20260811 15:07:52.238741 12221 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786460596631409-20401-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786460596631409-20401-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786460596631409-20401-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:07:52.250491 12221 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:07:52.253573 12221 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:07:52.253794 12221 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:07:52.261071 12221 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36125
I20260811 15:07:52.261088 12294 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36125 every 8 connection(s)
I20260811 15:07:52.262043 12221 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
I20260811 15:07:52.264918 12295 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:07:52.270417 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 12221
I20260811 15:07:52.270481 12295 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bb75f1183617455eaf1f54bd1d6fc269: Bootstrap starting.
I20260811 15:07:52.270609 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786460596631409-20401-0/minicluster-data/master-0/wal/instance
I20260811 15:07:52.270880 20401 external_mini_cluster.cc:1428] Setting key 038c4a97b2e1c03b3003990f6a262bda
I20260811 15:07:52.273177 12295 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bb75f1183617455eaf1f54bd1d6fc269: Neither blocks nor log segments found. Creating new log.
I20260811 15:07:52.273936 12295 log.cc:824] T 00000000000000000000000000000000 P bb75f1183617455eaf1f54bd1d6fc269: Log is configured to *not* fsync() on all Append() calls
I20260811 15:07:52.275840 12295 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bb75f1183617455eaf1f54bd1d6fc269: No bootstrap required, opened a new log
I20260811 15:07:52.279373 12295 raft_consensus.cc:348] T 00000000000000000000000000000000 P bb75f1183617455eaf1f54bd1d6fc269 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb75f1183617455eaf1f54bd1d6fc269" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36125 } }
I20260811 15:07:52.279632 12295 raft_consensus.cc:374] T 00000000000000000000000000000000 P bb75f1183617455eaf1f54bd1d6fc269 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:07:52.279736 12295 raft_consensus.cc:729] T 00000000000000000000000000000000 P bb75f1183617455eaf1f54bd1d6fc269 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb75f1183617455eaf1f54bd1d6fc269, State: Initialized, Role: FOLLOWER
I20260811 15:07:52.280229 12295 consensus_queue.cc:260] T 00000000000000000000000000000000 P bb75f1183617455eaf1f54bd1d6fc269 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb75f1183617455eaf1f54bd1d6fc269" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36125 } }
I20260811 15:07:52.280398 12295 raft_consensus.cc:388] T 00000000000000000000000000000000 P bb75f1183617455eaf1f54bd1d6fc269 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 15:07:52.280493 12295 raft_consensus.cc:482] T 00000000000000000000000000000000 P bb75f1183617455eaf1f54bd1d6fc269 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 15:07:52.280614 12295 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bb75f1183617455eaf1f54bd1d6fc269 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:07:52.281047 12298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:52.272298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.25:59513 (local address 127.0.0.1:36125)
0811 15:07:52.272835 (+ 537us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:52.272853 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:52.272892 (+ 39us) server_negotiation.cc:407] Connection header received
0811 15:07:52.273665 (+ 773us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:52.273685 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:52.274085 (+ 400us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:52.274465 (+ 380us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:07:52.274924 (+ 459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:52.276038 (+ 1114us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:52.277124 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:52.277648 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:52.277850 (+ 202us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:52.278841 (+ 991us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:07:52.278847 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:07:52.278861 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:07:52.279277 (+ 416us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:07:52.279339 (+ 62us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:07:52.279363 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:07:52.279517 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:52.279720 (+ 203us) server_negotiation.cc:299] Negotiation successful
0811 15:07:52.280053 (+ 333us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":373,"thread_start_us":176,"threads_started":1}
I20260811 15:07:52.281775 12295 raft_consensus.cc:504] T 00000000000000000000000000000000 P bb75f1183617455eaf1f54bd1d6fc269 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb75f1183617455eaf1f54bd1d6fc269" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36125 } }
I20260811 15:07:52.282127 12295 leader_election.cc:302] T 00000000000000000000000000000000 P bb75f1183617455eaf1f54bd1d6fc269 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bb75f1183617455eaf1f54bd1d6fc269; no voters:
I20260811 15:07:52.282514 12295 leader_election.cc:288] T 00000000000000000000000000000000 P bb75f1183617455eaf1f54bd1d6fc269 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 15:07:52.282589 12300 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bb75f1183617455eaf1f54bd1d6fc269 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:07:52.282783 12300 raft_consensus.cc:686] T 00000000000000000000000000000000 P bb75f1183617455eaf1f54bd1d6fc269 [term 1 LEADER]: Becoming Leader. State: Replica: bb75f1183617455eaf1f54bd1d6fc269, State: Running, Role: LEADER
I20260811 15:07:52.283466 12300 consensus_queue.cc:237] T 00000000000000000000000000000000 P bb75f1183617455eaf1f54bd1d6fc269 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb75f1183617455eaf1f54bd1d6fc269" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36125 } }
I20260811 15:07:52.283846 12295 sys_catalog.cc:564] T 00000000000000000000000000000000 P bb75f1183617455eaf1f54bd1d6fc269 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:07:52.284369 20401 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 15:07:52.284711 12300 sys_catalog.cc:455] T 00000000000000000000000000000000 P bb75f1183617455eaf1f54bd1d6fc269 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bb75f1183617455eaf1f54bd1d6fc269. Latest consensus state: current_term: 1 leader_uuid: "bb75f1183617455eaf1f54bd1d6fc269" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb75f1183617455eaf1f54bd1d6fc269" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36125 } } }
I20260811 15:07:52.284858 12300 sys_catalog.cc:458] T 00000000000000000000000000000000 P bb75f1183617455eaf1f54bd1d6fc269 [sys.catalog]: This master's current role is: LEADER
I20260811 15:07:52.285542 12301 sys_catalog.cc:455] T 00000000000000000000000000000000 P bb75f1183617455eaf1f54bd1d6fc269 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bb75f1183617455eaf1f54bd1d6fc269" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb75f1183617455eaf1f54bd1d6fc269" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36125 } } }
I20260811 15:07:52.285722 12301 sys_catalog.cc:458] T 00000000000000000000000000000000 P bb75f1183617455eaf1f54bd1d6fc269 [sys.catalog]: This master's current role is: LEADER
W20260811 15:07:52.289485 12320 catalog_manager.cc:1558] T 00000000000000000000000000000000 P bb75f1183617455eaf1f54bd1d6fc269: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 15:07:52.289613 12320 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 15:07:52.289687 12309 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:07:52.290587 12309 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:07:52.291497 12298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:52.287143 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.25:34163 (local address 127.0.0.1:36125)
0811 15:07:52.287244 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:52.287250 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:52.287464 (+ 214us) server_negotiation.cc:407] Connection header received
0811 15:07:52.287611 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:52.287614 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:52.287682 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:52.287777 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:07:52.288060 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:52.288711 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:52.289601 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:52.289938 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:52.290059 (+ 121us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:52.290994 (+ 935us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:07:52.290998 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:07:52.291001 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:07:52.291015 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:07:52.291049 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:07:52.291061 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:07:52.291169 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:52.291306 (+ 137us) server_negotiation.cc:299] Negotiation successful
0811 15:07:52.291344 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 15:07:52.296667 12309 catalog_manager.cc:1347] Generated new cluster ID: fbeeea9e7c6a48a08926cbf9cb756e01
I20260811 15:07:52.296742 12309 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:07:52.311002 12309 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 15:07:52.312021 12309 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:07:52.323516 12309 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bb75f1183617455eaf1f54bd1d6fc269: Generated new TSK 0
I20260811 15:07:52.324273 12309 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 15:07:52.329177 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 12221
W20260811 15:07:52.338515 12205 connection.cc:535] client connection to 127.0.0.1:36125 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:36125): Connection reset by peer (error 104)
2026-08-11T15:07:52Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1494 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786460596631409-20401-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 15:07:52 dist-test-slave-8n49 krb5kdc[12328](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 15:07:52 dist-test-slave-8n49 krb5kdc[12328](info): set up 2 sockets
Aug 11 15:07:52 dist-test-slave-8n49 krb5kdc[12328](info): commencing operation
krb5kdc: starting...
W20260811 15:07:53.439640 20401 mini_kdc.cc:121] Time spent starting KDC: real 1.086s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786460596631409-20401-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786460596631409-20401-0/krb5kdc/test-user.keytab.
Aug 11 15:07:53 dist-test-slave-8n49 krb5kdc[12328](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460873, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T15:07:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T15:07:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786460596631409-20401-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786460596631409-20401-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 15:07:53.569832 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786460596631409-20401-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786460596631409-20401-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786460596631409-20401-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38091
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786460596631409-20401-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34701
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38091
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:07:53.684098 12343 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:07:53.684368 12343 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:07:53.684412 12343 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:07:53.688454 12343 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:07:53.688517 12343 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:07:53.688537 12343 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:07:53.688611 12343 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:07:53.688647 12343 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:07:53.693946 12343 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34701
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786460596631409-20401-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786460596631409-20401-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38091
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786460596631409-20401-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38091
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12343
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786460596631409-20401-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:07:53.695055 12343 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:07:53.696123 12343 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:07:53.704741 12349 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:07:53.704777 12352 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:07:53.704741 12350 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:07:53.705108 12343 server_base.cc:1034] running on GCE node
I20260811 15:07:53.705720 12343 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:07:53.706858 12343 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:07:53.708074 12343 hybrid_clock.cc:648] HybridClock initialized: now 1786460873708055 us; error 31 us; skew 500 ppm
Aug 11 15:07:53 dist-test-slave-8n49 krb5kdc[12328](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460873, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:07:53.710999 12343 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 15:07:53.711952 12343 webserver.cc:460] Webserver started at http://127.0.0.1:46809/ using document root <none> and password file <none>
I20260811 15:07:53.712587 12343 fs_manager.cc:359] Metadata directory not provided
I20260811 15:07:53.712694 12343 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:07:53.712945 12343 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:07:53.715144 12343 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786460596631409-20401-0/minicluster-data/master-0/data/instance:
uuid: "58f71bb2e3e24951ae6a4629d1b1de9c"
format_stamp: "Formatted at 2026-08-11 15:07:53 on dist-test-slave-8n49"
server_key: "188053d61c79e13dad517846d845b30e"
server_key_iv: "76a8d34cee9a63b64312d4ac63c8bcca"
server_key_version: "encryptionkey@0"
I20260811 15:07:53.715728 12343 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786460596631409-20401-0/minicluster-data/master-0/wal/instance:
uuid: "58f71bb2e3e24951ae6a4629d1b1de9c"
format_stamp: "Formatted at 2026-08-11 15:07:53 on dist-test-slave-8n49"
server_key: "188053d61c79e13dad517846d845b30e"
server_key_iv: "76a8d34cee9a63b64312d4ac63c8bcca"
server_key_version: "encryptionkey@0"
I20260811 15:07:53.719540 12343 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260811 15:07:53.722074 12359 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:07:53.723330 12343 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 15:07:53.723490 12343 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786460596631409-20401-0/minicluster-data/master-0/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786460596631409-20401-0/minicluster-data/master-0/wal
uuid: "58f71bb2e3e24951ae6a4629d1b1de9c"
format_stamp: "Formatted at 2026-08-11 15:07:53 on dist-test-slave-8n49"
server_key: "188053d61c79e13dad517846d845b30e"
server_key_iv: "76a8d34cee9a63b64312d4ac63c8bcca"
server_key_version: "encryptionkey@0"
I20260811 15:07:53.723610 12343 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786460596631409-20401-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786460596631409-20401-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786460596631409-20401-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:07:53.728325 12343 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:07:53.731616 12343 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:07:53.731812 12343 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:07:53.739248 12343 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38091
I20260811 15:07:53.739259 12418 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38091 every 8 connection(s)
I20260811 15:07:53.740193 12343 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
I20260811 15:07:53.743049 12419 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:07:53.746469 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 12343
I20260811 15:07:53.746624 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786460596631409-20401-0/minicluster-data/master-0/wal/instance
I20260811 15:07:53.746927 20401 external_mini_cluster.cc:1428] Setting key 32aa79fc3653cb17877b526cf26f9924
I20260811 15:07:53.749334 12419 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 58f71bb2e3e24951ae6a4629d1b1de9c: Bootstrap starting.
I20260811 15:07:53.752023 12419 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 58f71bb2e3e24951ae6a4629d1b1de9c: Neither blocks nor log segments found. Creating new log.
I20260811 15:07:53.752220 12422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:53.748334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.25:57511 (local address 127.0.0.1:38091)
0811 15:07:53.748760 (+ 426us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:53.748778 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:53.748820 (+ 42us) server_negotiation.cc:407] Connection header received
0811 15:07:53.749502 (+ 682us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:53.749522 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:53.749807 (+ 285us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:53.750078 (+ 271us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:07:53.750937 (+ 859us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:07:53.750941 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:07:53.750953 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:07:53.750963 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:07:53.751017 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:07:53.751039 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:07:53.751149 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:53.751269 (+ 120us) server_negotiation.cc:299] Negotiation successful
0811 15:07:53.751445 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":280,"thread_start_us":165,"threads_started":1}
I20260811 15:07:53.752974 12419 log.cc:824] T 00000000000000000000000000000000 P 58f71bb2e3e24951ae6a4629d1b1de9c: Log is configured to *not* fsync() on all Append() calls
I20260811 15:07:53.755255 20401 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 15:07:53.755311 12419 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 58f71bb2e3e24951ae6a4629d1b1de9c: No bootstrap required, opened a new log
I20260811 15:07:53.759368 12422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:53.757631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.25:45009 (local address 127.0.0.1:38091)
0811 15:07:53.757766 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:53.757771 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:53.757973 (+ 202us) server_negotiation.cc:407] Connection header received
0811 15:07:53.758088 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:53.758091 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:53.758127 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:53.758207 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:07:53.758946 (+ 739us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:07:53.758951 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:07:53.758954 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:07:53.758971 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:07:53.759005 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:07:53.759022 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:07:53.759133 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:53.759196 (+ 63us) server_negotiation.cc:299] Negotiation successful
0811 15:07:53.759236 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 15:07:53.760116 12419 raft_consensus.cc:348] T 00000000000000000000000000000000 P 58f71bb2e3e24951ae6a4629d1b1de9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58f71bb2e3e24951ae6a4629d1b1de9c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38091 } }
I20260811 15:07:53.760396 12419 raft_consensus.cc:374] T 00000000000000000000000000000000 P 58f71bb2e3e24951ae6a4629d1b1de9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:07:53.760488 12419 raft_consensus.cc:729] T 00000000000000000000000000000000 P 58f71bb2e3e24951ae6a4629d1b1de9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58f71bb2e3e24951ae6a4629d1b1de9c, State: Initialized, Role: FOLLOWER
I20260811 15:07:53.760926 12419 consensus_queue.cc:260] T 00000000000000000000000000000000 P 58f71bb2e3e24951ae6a4629d1b1de9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58f71bb2e3e24951ae6a4629d1b1de9c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38091 } }
I20260811 15:07:53.761045 12419 raft_consensus.cc:388] T 00000000000000000000000000000000 P 58f71bb2e3e24951ae6a4629d1b1de9c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 15:07:53.761137 12419 raft_consensus.cc:482] T 00000000000000000000000000000000 P 58f71bb2e3e24951ae6a4629d1b1de9c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 15:07:53.761235 12419 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 58f71bb2e3e24951ae6a4629d1b1de9c [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:07:53.762182 12419 raft_consensus.cc:504] T 00000000000000000000000000000000 P 58f71bb2e3e24951ae6a4629d1b1de9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58f71bb2e3e24951ae6a4629d1b1de9c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38091 } }
I20260811 15:07:53.762531 12419 leader_election.cc:302] T 00000000000000000000000000000000 P 58f71bb2e3e24951ae6a4629d1b1de9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 58f71bb2e3e24951ae6a4629d1b1de9c; no voters:
I20260811 15:07:53.762852 12419 leader_election.cc:288] T 00000000000000000000000000000000 P 58f71bb2e3e24951ae6a4629d1b1de9c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 15:07:53.763010 12430 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 58f71bb2e3e24951ae6a4629d1b1de9c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:07:53.763248 12430 raft_consensus.cc:686] T 00000000000000000000000000000000 P 58f71bb2e3e24951ae6a4629d1b1de9c [term 1 LEADER]: Becoming Leader. State: Replica: 58f71bb2e3e24951ae6a4629d1b1de9c, State: Running, Role: LEADER
I20260811 15:07:53.763659 12430 consensus_queue.cc:237] T 00000000000000000000000000000000 P 58f71bb2e3e24951ae6a4629d1b1de9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58f71bb2e3e24951ae6a4629d1b1de9c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38091 } }
I20260811 15:07:53.764142 12419 sys_catalog.cc:564] T 00000000000000000000000000000000 P 58f71bb2e3e24951ae6a4629d1b1de9c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:07:53.765391 12431 sys_catalog.cc:455] T 00000000000000000000000000000000 P 58f71bb2e3e24951ae6a4629d1b1de9c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "58f71bb2e3e24951ae6a4629d1b1de9c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58f71bb2e3e24951ae6a4629d1b1de9c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38091 } } }
I20260811 15:07:53.765529 12431 sys_catalog.cc:458] T 00000000000000000000000000000000 P 58f71bb2e3e24951ae6a4629d1b1de9c [sys.catalog]: This master's current role is: LEADER
I20260811 15:07:53.765499 12433 sys_catalog.cc:455] T 00000000000000000000000000000000 P 58f71bb2e3e24951ae6a4629d1b1de9c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 58f71bb2e3e24951ae6a4629d1b1de9c. Latest consensus state: current_term: 1 leader_uuid: "58f71bb2e3e24951ae6a4629d1b1de9c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58f71bb2e3e24951ae6a4629d1b1de9c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38091 } } }
I20260811 15:07:53.765601 12433 sys_catalog.cc:458] T 00000000000000000000000000000000 P 58f71bb2e3e24951ae6a4629d1b1de9c [sys.catalog]: This master's current role is: LEADER
I20260811 15:07:53.766010 12440 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:07:53.769341 12440 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:07:53.775281 12440 catalog_manager.cc:1347] Generated new cluster ID: 4e57dac054da4419890bfdcfab522509
I20260811 15:07:53.775377 12440 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:07:53.800698 12440 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 15:07:53.801074 12440 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:07:53.820310 12440 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 58f71bb2e3e24951ae6a4629d1b1de9c: Generated new TSK 0
I20260811 15:07:53.821202 12440 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 15:07:53.825906 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 12343
2026-08-11T15:07:53Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1496 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786460596631409-20401-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 15:07:53 dist-test-slave-8n49 krb5kdc[12454](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 15:07:53 dist-test-slave-8n49 krb5kdc[12454](info): set up 2 sockets
Aug 11 15:07:53 dist-test-slave-8n49 krb5kdc[12454](info): commencing operation
krb5kdc: starting...
W20260811 15:07:54.940836 20401 mini_kdc.cc:121] Time spent starting KDC: real 1.091s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786460596631409-20401-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786460596631409-20401-0/krb5kdc/test-user.keytab.
Aug 11 15:07:55 dist-test-slave-8n49 krb5kdc[12454](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460875, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T15:07:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T15:07:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.236.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.236.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.236.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab.
Entry for principal kudu/127.19.236.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab.
I20260811 15:07:55.070154 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786460596631409-20401-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786460596631409-20401-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786460596631409-20401-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:42513
--webserver_interface=127.19.236.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab
--principal=kudu/127.19.236.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:44449
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.236.126:42513
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:07:55.184402 12468 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:07:55.184753 12468 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:07:55.184834 12468 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:07:55.188898 12468 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:07:55.188998 12468 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:07:55.189038 12468 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:07:55.189098 12468 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:07:55.189134 12468 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:07:55.194499 12468 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:44449
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786460596631409-20401-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786460596631409-20401-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.236.126:42513
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab
--principal=kudu/127.19.236.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:42513
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.236.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12468
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786460596631409-20401-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:07:55.195622 12468 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:07:55.196725 12468 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:07:55.205580 12474 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:07:55.205613 12475 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:07:55.205658 12477 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:07:55.205861 12468 server_base.cc:1034] running on GCE node
I20260811 15:07:55.206482 12468 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:07:55.207648 12468 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:07:55.208812 12468 hybrid_clock.cc:648] HybridClock initialized: now 1786460875208793 us; error 31 us; skew 500 ppm
Aug 11 15:07:55 dist-test-slave-8n49 krb5kdc[12454](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460875, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:07:55.211608 12468 init.cc:377] Logged in from keytab as kudu/127.19.236.126@KRBTEST.COM (short username kudu)
I20260811 15:07:55.212666 12468 webserver.cc:460] Webserver started at http://127.19.236.126:33427/ using document root <none> and password file <none>
I20260811 15:07:55.213246 12468 fs_manager.cc:359] Metadata directory not provided
I20260811 15:07:55.213307 12468 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:07:55.213553 12468 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:07:55.215679 12468 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786460596631409-20401-0/minicluster-data/master-0/data/instance:
uuid: "75e9790559ac4eb39620ea75533a0314"
format_stamp: "Formatted at 2026-08-11 15:07:55 on dist-test-slave-8n49"
server_key: "5d460c854c05836ba2f2a106597c3485"
server_key_iv: "eaa49b033f395db42d123a4a043f45b5"
server_key_version: "encryptionkey@0"
I20260811 15:07:55.216264 12468 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786460596631409-20401-0/minicluster-data/master-0/wal/instance:
uuid: "75e9790559ac4eb39620ea75533a0314"
format_stamp: "Formatted at 2026-08-11 15:07:55 on dist-test-slave-8n49"
server_key: "5d460c854c05836ba2f2a106597c3485"
server_key_iv: "eaa49b033f395db42d123a4a043f45b5"
server_key_version: "encryptionkey@0"
I20260811 15:07:55.220130 12468 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260811 15:07:55.222643 12485 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:07:55.223858 12468 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 15:07:55.224016 12468 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786460596631409-20401-0/minicluster-data/master-0/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786460596631409-20401-0/minicluster-data/master-0/wal
uuid: "75e9790559ac4eb39620ea75533a0314"
format_stamp: "Formatted at 2026-08-11 15:07:55 on dist-test-slave-8n49"
server_key: "5d460c854c05836ba2f2a106597c3485"
server_key_iv: "eaa49b033f395db42d123a4a043f45b5"
server_key_version: "encryptionkey@0"
I20260811 15:07:55.224133 12468 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786460596631409-20401-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786460596631409-20401-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786460596631409-20401-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:07:55.252997 12468 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:07:55.256143 12468 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:07:55.256366 12468 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:07:55.263921 12468 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.126:42513
I20260811 15:07:55.263942 12547 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.126:42513 every 8 connection(s)
I20260811 15:07:55.264972 12468 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
I20260811 15:07:55.267426 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 12468
I20260811 15:07:55.267612 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786460596631409-20401-0/minicluster-data/master-0/wal/instance
I20260811 15:07:55.267835 12548 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:07:55.267987 20401 external_mini_cluster.cc:1428] Setting key 776c26af662fa94188d88b2c73561eaf
I20260811 15:07:55.275336 12548 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 75e9790559ac4eb39620ea75533a0314: Bootstrap starting.
Aug 11 15:07:55 dist-test-slave-8n49 krb5kdc[12454](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460875, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
I20260811 15:07:55.277997 12548 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 75e9790559ac4eb39620ea75533a0314: Neither blocks nor log segments found. Creating new log.
I20260811 15:07:55.278885 12548 log.cc:824] T 00000000000000000000000000000000 P 75e9790559ac4eb39620ea75533a0314: Log is configured to *not* fsync() on all Append() calls
I20260811 15:07:55.281311 12548 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 75e9790559ac4eb39620ea75533a0314: No bootstrap required, opened a new log
I20260811 15:07:55.284266 12552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:55.269492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50657 (local address 127.19.236.126:42513)
0811 15:07:55.269936 (+ 444us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:55.269967 (+ 31us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:55.270011 (+ 44us) server_negotiation.cc:407] Connection header received
0811 15:07:55.270740 (+ 729us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:55.270764 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:55.271222 (+ 458us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:55.271591 (+ 369us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:07:55.272297 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:55.273835 (+ 1538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:55.274713 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:55.275388 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:55.275555 (+ 167us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:55.278473 (+ 2918us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:07:55.278480 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:07:55.278497 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:07:55.278528 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:07:55.280589 (+ 2061us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:07:55.281459 (+ 870us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:07:55.281465 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:07:55.281472 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:07:55.281608 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:07:55.281931 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:07:55.281934 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:07:55.281935 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:07:55.282432 (+ 497us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:07:55.282653 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:55.282968 (+ 315us) server_negotiation.cc:299] Negotiation successful
0811 15:07:55.283197 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":296,"thread_start_us":128,"threads_started":1}
I20260811 15:07:55.285971 12548 raft_consensus.cc:348] T 00000000000000000000000000000000 P 75e9790559ac4eb39620ea75533a0314 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75e9790559ac4eb39620ea75533a0314" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 42513 } }
I20260811 15:07:55.286266 12548 raft_consensus.cc:374] T 00000000000000000000000000000000 P 75e9790559ac4eb39620ea75533a0314 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:07:55.286370 12548 raft_consensus.cc:729] T 00000000000000000000000000000000 P 75e9790559ac4eb39620ea75533a0314 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75e9790559ac4eb39620ea75533a0314, State: Initialized, Role: FOLLOWER
I20260811 15:07:55.286864 12548 consensus_queue.cc:260] T 00000000000000000000000000000000 P 75e9790559ac4eb39620ea75533a0314 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75e9790559ac4eb39620ea75533a0314" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 42513 } }
I20260811 15:07:55.287031 12548 raft_consensus.cc:388] T 00000000000000000000000000000000 P 75e9790559ac4eb39620ea75533a0314 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 15:07:55.287099 12548 raft_consensus.cc:482] T 00000000000000000000000000000000 P 75e9790559ac4eb39620ea75533a0314 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 15:07:55.287194 12548 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 75e9790559ac4eb39620ea75533a0314 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:07:55.287482 20401 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 15:07:55.288365 12548 raft_consensus.cc:504] T 00000000000000000000000000000000 P 75e9790559ac4eb39620ea75533a0314 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75e9790559ac4eb39620ea75533a0314" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 42513 } }
I20260811 15:07:55.288762 12548 leader_election.cc:302] T 00000000000000000000000000000000 P 75e9790559ac4eb39620ea75533a0314 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 75e9790559ac4eb39620ea75533a0314; no voters:
I20260811 15:07:55.289124 12548 leader_election.cc:288] T 00000000000000000000000000000000 P 75e9790559ac4eb39620ea75533a0314 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 15:07:55.289252 12559 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 75e9790559ac4eb39620ea75533a0314 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:07:55.289528 12559 raft_consensus.cc:686] T 00000000000000000000000000000000 P 75e9790559ac4eb39620ea75533a0314 [term 1 LEADER]: Becoming Leader. State: Replica: 75e9790559ac4eb39620ea75533a0314, State: Running, Role: LEADER
I20260811 15:07:55.289886 12559 consensus_queue.cc:237] T 00000000000000000000000000000000 P 75e9790559ac4eb39620ea75533a0314 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75e9790559ac4eb39620ea75533a0314" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 42513 } }
I20260811 15:07:55.290498 12548 sys_catalog.cc:564] T 00000000000000000000000000000000 P 75e9790559ac4eb39620ea75533a0314 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:07:55.291324 12560 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75e9790559ac4eb39620ea75533a0314 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 75e9790559ac4eb39620ea75533a0314. Latest consensus state: current_term: 1 leader_uuid: "75e9790559ac4eb39620ea75533a0314" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75e9790559ac4eb39620ea75533a0314" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 42513 } } }
I20260811 15:07:55.291527 12560 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75e9790559ac4eb39620ea75533a0314 [sys.catalog]: This master's current role is: LEADER
I20260811 15:07:55.291854 12561 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75e9790559ac4eb39620ea75533a0314 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "75e9790559ac4eb39620ea75533a0314" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75e9790559ac4eb39620ea75533a0314" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 42513 } } }
I20260811 15:07:55.291954 12561 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75e9790559ac4eb39620ea75533a0314 [sys.catalog]: This master's current role is: LEADER
I20260811 15:07:55.292152 12571 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:07:55.295603 12571 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:07:55.299990 12552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:55.290112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35801 (local address 127.19.236.126:42513)
0811 15:07:55.290212 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:55.290216 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:55.290253 (+ 37us) server_negotiation.cc:407] Connection header received
0811 15:07:55.290288 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:55.290291 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:55.290331 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:55.290406 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:07:55.292105 (+ 1699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:55.292936 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:55.294059 (+ 1123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:55.294389 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:55.294503 (+ 114us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:55.296368 (+ 1865us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:07:55.296372 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:07:55.296375 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:07:55.296400 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:07:55.298142 (+ 1742us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:07:55.298655 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:07:55.298659 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:07:55.298661 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:07:55.298749 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:07:55.299110 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:07:55.299113 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:07:55.299115 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:07:55.299299 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:07:55.299471 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:55.299744 (+ 273us) server_negotiation.cc:299] Negotiation successful
0811 15:07:55.299842 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 15:07:55.302361 12571 catalog_manager.cc:1347] Generated new cluster ID: a61dedac2abf40c9a3c606454d935dc9
I20260811 15:07:55.302449 12571 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:07:55.318032 12571 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 15:07:55.319029 12571 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:07:55.328985 12571 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 75e9790559ac4eb39620ea75533a0314: Generated new TSK 0
I20260811 15:07:55.329891 12571 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 15:07:55.334964 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 12468
W20260811 15:07:55.343520 12452 connection.cc:535] client connection to 127.19.236.126:42513 recv error: Network error: failed to read from TLS socket (remote: 127.19.236.126:42513): Connection reset by peer (error 104)
2026-08-11T15:07:55Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1508 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786460596631409-20401-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 15:07:55 dist-test-slave-8n49 krb5kdc[12584](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 15:07:55 dist-test-slave-8n49 krb5kdc[12584](info): set up 2 sockets
Aug 11 15:07:55 dist-test-slave-8n49 krb5kdc[12584](info): commencing operation
krb5kdc: starting...
W20260811 15:07:56.499948 20401 mini_kdc.cc:121] Time spent starting KDC: real 1.142s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786460596631409-20401-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786460596631409-20401-0/krb5kdc/test-user.keytab.
Aug 11 15:07:56 dist-test-slave-8n49 krb5kdc[12584](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460876, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T15:07:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T15:07:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.236.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.236.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.236.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab.
Entry for principal kudu/127.19.236.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab.
I20260811 15:07:56.627967 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786460596631409-20401-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786460596631409-20401-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786460596631409-20401-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:33067
--webserver_interface=127.19.236.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab
--principal=kudu/127.19.236.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:36351
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.236.126:33067
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:07:56.740579 12598 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:07:56.740878 12598 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:07:56.740931 12598 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:07:56.745389 12598 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:07:56.745445 12598 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:07:56.745464 12598 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:07:56.745481 12598 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:07:56.745496 12598 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:07:56.750730 12598 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:36351
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786460596631409-20401-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786460596631409-20401-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.236.126:33067
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab
--principal=kudu/127.19.236.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:33067
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.236.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12598
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786460596631409-20401-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:07:56.751784 12598 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:07:56.752831 12598 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:07:56.761356 12607 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:07:56.761368 12603 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:07:56.761368 12604 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:07:56.761471 12598 server_base.cc:1034] running on GCE node
I20260811 15:07:56.762260 12598 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:07:56.763429 12598 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:07:56.764653 12598 hybrid_clock.cc:648] HybridClock initialized: now 1786460876764613 us; error 46 us; skew 500 ppm
Aug 11 15:07:56 dist-test-slave-8n49 krb5kdc[12584](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460876, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:07:56.767503 12598 init.cc:377] Logged in from keytab as kudu/127.19.236.126@KRBTEST.COM (short username kudu)
I20260811 15:07:56.768460 12598 webserver.cc:460] Webserver started at http://127.19.236.126:35623/ using document root <none> and password file <none>
I20260811 15:07:56.769065 12598 fs_manager.cc:359] Metadata directory not provided
I20260811 15:07:56.769163 12598 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:07:56.769413 12598 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:07:56.771481 12598 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786460596631409-20401-0/minicluster-data/master-0/data/instance:
uuid: "37dd6e3d69da4f2da05f32682a78226c"
format_stamp: "Formatted at 2026-08-11 15:07:56 on dist-test-slave-8n49"
server_key: "854acc67bffcd29d8b8ac92279dd3e92"
server_key_iv: "ee2dea4b7422c9738db8bae787af5fe9"
server_key_version: "encryptionkey@0"
I20260811 15:07:56.772058 12598 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786460596631409-20401-0/minicluster-data/master-0/wal/instance:
uuid: "37dd6e3d69da4f2da05f32682a78226c"
format_stamp: "Formatted at 2026-08-11 15:07:56 on dist-test-slave-8n49"
server_key: "854acc67bffcd29d8b8ac92279dd3e92"
server_key_iv: "ee2dea4b7422c9738db8bae787af5fe9"
server_key_version: "encryptionkey@0"
I20260811 15:07:56.775877 12598 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260811 15:07:56.778398 12615 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:07:56.779582 12598 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 15:07:56.779731 12598 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786460596631409-20401-0/minicluster-data/master-0/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786460596631409-20401-0/minicluster-data/master-0/wal
uuid: "37dd6e3d69da4f2da05f32682a78226c"
format_stamp: "Formatted at 2026-08-11 15:07:56 on dist-test-slave-8n49"
server_key: "854acc67bffcd29d8b8ac92279dd3e92"
server_key_iv: "ee2dea4b7422c9738db8bae787af5fe9"
server_key_version: "encryptionkey@0"
I20260811 15:07:56.779842 12598 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786460596631409-20401-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786460596631409-20401-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786460596631409-20401-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:07:56.809125 12598 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:07:56.812520 12598 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:07:56.812822 12598 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:07:56.820487 12598 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.126:33067
I20260811 15:07:56.820516 12676 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.126:33067 every 8 connection(s)
I20260811 15:07:56.821611 12598 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
I20260811 15:07:56.824470 12677 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:07:56.825318 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 12598
I20260811 15:07:56.825464 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786460596631409-20401-0/minicluster-data/master-0/wal/instance
I20260811 15:07:56.825789 20401 external_mini_cluster.cc:1428] Setting key af60e64d95d6f8b7a1a0e30853f714b8
I20260811 15:07:56.831606 12677 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 37dd6e3d69da4f2da05f32682a78226c: Bootstrap starting.
I20260811 15:07:56.834304 12677 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 37dd6e3d69da4f2da05f32682a78226c: Neither blocks nor log segments found. Creating new log.
I20260811 15:07:56.835261 12677 log.cc:824] T 00000000000000000000000000000000 P 37dd6e3d69da4f2da05f32682a78226c: Log is configured to *not* fsync() on all Append() calls
I20260811 15:07:56.836226 12680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:56.827301 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38253 (local address 127.19.236.126:33067)
0811 15:07:56.827754 (+ 453us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:56.827775 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:56.827820 (+ 45us) server_negotiation.cc:407] Connection header received
0811 15:07:56.828661 (+ 841us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:56.828688 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:56.829122 (+ 434us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:56.829498 (+ 376us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:07:56.829919 (+ 421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:56.831387 (+ 1468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:56.832320 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:56.833080 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:56.833238 (+ 158us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:56.834125 (+ 887us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:07:56.834135 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:07:56.834155 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:07:56.834707 (+ 552us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:07:56.834775 (+ 68us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:07:56.834806 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:07:56.834943 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:56.835134 (+ 191us) server_negotiation.cc:299] Negotiation successful
0811 15:07:56.835273 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":295,"thread_start_us":108,"threads_started":1}
I20260811 15:07:56.837460 12677 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 37dd6e3d69da4f2da05f32682a78226c: No bootstrap required, opened a new log
I20260811 15:07:56.839313 20401 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 15:07:56.841770 12677 raft_consensus.cc:348] T 00000000000000000000000000000000 P 37dd6e3d69da4f2da05f32682a78226c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37dd6e3d69da4f2da05f32682a78226c" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 33067 } }
I20260811 15:07:56.842038 12677 raft_consensus.cc:374] T 00000000000000000000000000000000 P 37dd6e3d69da4f2da05f32682a78226c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:07:56.842103 12677 raft_consensus.cc:729] T 00000000000000000000000000000000 P 37dd6e3d69da4f2da05f32682a78226c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37dd6e3d69da4f2da05f32682a78226c, State: Initialized, Role: FOLLOWER
I20260811 15:07:56.842545 12677 consensus_queue.cc:260] T 00000000000000000000000000000000 P 37dd6e3d69da4f2da05f32682a78226c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37dd6e3d69da4f2da05f32682a78226c" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 33067 } }
I20260811 15:07:56.842706 12677 raft_consensus.cc:388] T 00000000000000000000000000000000 P 37dd6e3d69da4f2da05f32682a78226c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 15:07:56.842799 12677 raft_consensus.cc:482] T 00000000000000000000000000000000 P 37dd6e3d69da4f2da05f32682a78226c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 15:07:56.842922 12677 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 37dd6e3d69da4f2da05f32682a78226c [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:07:56.843865 12677 raft_consensus.cc:504] T 00000000000000000000000000000000 P 37dd6e3d69da4f2da05f32682a78226c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37dd6e3d69da4f2da05f32682a78226c" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 33067 } }
I20260811 15:07:56.844267 12677 leader_election.cc:302] T 00000000000000000000000000000000 P 37dd6e3d69da4f2da05f32682a78226c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 37dd6e3d69da4f2da05f32682a78226c; no voters:
I20260811 15:07:56.844671 12677 leader_election.cc:288] T 00000000000000000000000000000000 P 37dd6e3d69da4f2da05f32682a78226c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 15:07:56.844769 12688 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 37dd6e3d69da4f2da05f32682a78226c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:07:56.845009 12688 raft_consensus.cc:686] T 00000000000000000000000000000000 P 37dd6e3d69da4f2da05f32682a78226c [term 1 LEADER]: Becoming Leader. State: Replica: 37dd6e3d69da4f2da05f32682a78226c, State: Running, Role: LEADER
I20260811 15:07:56.845366 12688 consensus_queue.cc:237] T 00000000000000000000000000000000 P 37dd6e3d69da4f2da05f32682a78226c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37dd6e3d69da4f2da05f32682a78226c" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 33067 } }
I20260811 15:07:56.845695 12680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:56.841346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34195 (local address 127.19.236.126:33067)
0811 15:07:56.841486 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:56.841490 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:56.841654 (+ 164us) server_negotiation.cc:407] Connection header received
0811 15:07:56.841817 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:56.841820 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:56.841858 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:56.841939 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:07:56.842228 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:56.842898 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:56.843722 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:56.843983 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:56.844105 (+ 122us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:56.845164 (+ 1059us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:07:56.845168 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:07:56.845171 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:07:56.845184 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:07:56.845212 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:07:56.845225 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:07:56.845281 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:56.845531 (+ 250us) server_negotiation.cc:299] Negotiation successful
0811 15:07:56.845569 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 15:07:56.846165 12677 sys_catalog.cc:564] T 00000000000000000000000000000000 P 37dd6e3d69da4f2da05f32682a78226c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:07:56.847370 12689 sys_catalog.cc:455] T 00000000000000000000000000000000 P 37dd6e3d69da4f2da05f32682a78226c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "37dd6e3d69da4f2da05f32682a78226c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37dd6e3d69da4f2da05f32682a78226c" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 33067 } } }
I20260811 15:07:56.847508 12689 sys_catalog.cc:458] T 00000000000000000000000000000000 P 37dd6e3d69da4f2da05f32682a78226c [sys.catalog]: This master's current role is: LEADER
I20260811 15:07:56.847965 12699 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:07:56.847922 12690 sys_catalog.cc:455] T 00000000000000000000000000000000 P 37dd6e3d69da4f2da05f32682a78226c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 37dd6e3d69da4f2da05f32682a78226c. Latest consensus state: current_term: 1 leader_uuid: "37dd6e3d69da4f2da05f32682a78226c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37dd6e3d69da4f2da05f32682a78226c" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 33067 } } }
I20260811 15:07:56.848071 12690 sys_catalog.cc:458] T 00000000000000000000000000000000 P 37dd6e3d69da4f2da05f32682a78226c [sys.catalog]: This master's current role is: LEADER
I20260811 15:07:56.850696 12699 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:07:56.856341 12699 catalog_manager.cc:1347] Generated new cluster ID: 482c8d7b9dd94aaeac419db26287f2d2
I20260811 15:07:56.856472 12699 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:07:56.867691 12699 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 15:07:56.868947 12699 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:07:56.874805 12699 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 37dd6e3d69da4f2da05f32682a78226c: Generated new TSK 0
I20260811 15:07:56.875576 12699 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 15:07:56.883275 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 12598
W20260811 15:07:56.891736 12582 connection.cc:535] client connection to 127.19.236.126:33067 recv error: Network error: failed to read from TLS socket (remote: 127.19.236.126:33067): Connection reset by peer (error 104)
2026-08-11T15:07:56Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1548 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786460596631409-20401-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 15:07:56 dist-test-slave-8n49 krb5kdc[12712](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 15:07:56 dist-test-slave-8n49 krb5kdc[12712](info): set up 2 sockets
Aug 11 15:07:56 dist-test-slave-8n49 krb5kdc[12712](info): commencing operation
krb5kdc: starting...
W20260811 15:07:57.992012 20401 mini_kdc.cc:121] Time spent starting KDC: real 1.086s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786460596631409-20401-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786460596631409-20401-0/krb5kdc/test-user.keytab.
Aug 11 15:07:58 dist-test-slave-8n49 krb5kdc[12712](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460878, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T15:07:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T15:07:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.236.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.236.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.236.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab.
Entry for principal kudu/127.19.236.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab.
I20260811 15:07:58.131771 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786460596631409-20401-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786460596631409-20401-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786460596631409-20401-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:37481
--webserver_interface=127.19.236.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab
--principal=kudu/127.19.236.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:43161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.236.126:37481
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:07:58.248507 12727 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:07:58.248836 12727 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:07:58.248920 12727 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:07:58.253362 12727 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:07:58.253441 12727 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:07:58.253496 12727 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:07:58.253522 12727 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:07:58.253542 12727 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:07:58.258775 12727 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:43161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786460596631409-20401-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786460596631409-20401-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.236.126:37481
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab
--principal=kudu/127.19.236.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:37481
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.236.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12727
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786460596631409-20401-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:07:58.259776 12727 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:07:58.260787 12727 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:07:58.269351 12732 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:07:58.269321 12733 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:07:58.269434 12727 server_base.cc:1034] running on GCE node
W20260811 15:07:58.269321 12735 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:07:58.270138 12727 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:07:58.271234 12727 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:07:58.272447 12727 hybrid_clock.cc:648] HybridClock initialized: now 1786460878272433 us; error 25 us; skew 500 ppm
Aug 11 15:07:58 dist-test-slave-8n49 krb5kdc[12712](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460878, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:07:58.275305 12727 init.cc:377] Logged in from keytab as kudu/127.19.236.126@KRBTEST.COM (short username kudu)
I20260811 15:07:58.276196 12727 webserver.cc:460] Webserver started at http://127.19.236.126:41053/ using document root <none> and password file <none>
I20260811 15:07:58.276840 12727 fs_manager.cc:359] Metadata directory not provided
I20260811 15:07:58.276934 12727 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:07:58.277168 12727 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:07:58.279265 12727 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786460596631409-20401-0/minicluster-data/master-0/data/instance:
uuid: "c9da7ce45365404682b25bf394684aa1"
format_stamp: "Formatted at 2026-08-11 15:07:58 on dist-test-slave-8n49"
server_key: "70e4060a8e7dc2be196dcf6556860126"
server_key_iv: "9c3f4071e35d61ec1c1a0d0a069c1b39"
server_key_version: "encryptionkey@0"
I20260811 15:07:58.279847 12727 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786460596631409-20401-0/minicluster-data/master-0/wal/instance:
uuid: "c9da7ce45365404682b25bf394684aa1"
format_stamp: "Formatted at 2026-08-11 15:07:58 on dist-test-slave-8n49"
server_key: "70e4060a8e7dc2be196dcf6556860126"
server_key_iv: "9c3f4071e35d61ec1c1a0d0a069c1b39"
server_key_version: "encryptionkey@0"
I20260811 15:07:58.283766 12727 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260811 15:07:58.286369 12743 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:07:58.287686 12727 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 15:07:58.287844 12727 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786460596631409-20401-0/minicluster-data/master-0/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786460596631409-20401-0/minicluster-data/master-0/wal
uuid: "c9da7ce45365404682b25bf394684aa1"
format_stamp: "Formatted at 2026-08-11 15:07:58 on dist-test-slave-8n49"
server_key: "70e4060a8e7dc2be196dcf6556860126"
server_key_iv: "9c3f4071e35d61ec1c1a0d0a069c1b39"
server_key_version: "encryptionkey@0"
I20260811 15:07:58.287966 12727 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786460596631409-20401-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786460596631409-20401-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786460596631409-20401-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:07:58.292832 12727 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:07:58.296226 12727 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:07:58.296438 12727 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:07:58.304420 12727 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.126:37481
I20260811 15:07:58.304451 12803 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.126:37481 every 8 connection(s)
I20260811 15:07:58.305477 12727 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
I20260811 15:07:58.308423 12804 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:07:58.308872 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 12727
I20260811 15:07:58.309031 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786460596631409-20401-0/minicluster-data/master-0/wal/instance
I20260811 15:07:58.309348 20401 external_mini_cluster.cc:1428] Setting key 5ace2c20a457e8943347e54f7cac2b0c
I20260811 15:07:58.315061 12807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:58.311022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42641 (local address 127.19.236.126:37481)
0811 15:07:58.311504 (+ 482us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:58.311520 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:58.311555 (+ 35us) server_negotiation.cc:407] Connection header received
0811 15:07:58.312236 (+ 681us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:58.312252 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:58.312616 (+ 364us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:58.312976 (+ 360us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:07:58.313878 (+ 902us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:07:58.313883 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:07:58.313895 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:07:58.313907 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:07:58.313963 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:07:58.313982 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:07:58.314145 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:58.314217 (+ 72us) server_negotiation.cc:299] Negotiation successful
0811 15:07:58.314378 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":321,"thread_start_us":145,"threads_started":1}
I20260811 15:07:58.315157 12804 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c9da7ce45365404682b25bf394684aa1: Bootstrap starting.
I20260811 15:07:58.317974 12804 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c9da7ce45365404682b25bf394684aa1: Neither blocks nor log segments found. Creating new log.
I20260811 15:07:58.318084 20401 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 15:07:58.318784 12804 log.cc:824] T 00000000000000000000000000000000 P c9da7ce45365404682b25bf394684aa1: Log is configured to *not* fsync() on all Append() calls
I20260811 15:07:58.321086 12804 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c9da7ce45365404682b25bf394684aa1: No bootstrap required, opened a new log
I20260811 15:07:58.322224 12807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:58.320297 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33253 (local address 127.19.236.126:37481)
0811 15:07:58.320433 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:58.320438 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:58.320740 (+ 302us) server_negotiation.cc:407] Connection header received
0811 15:07:58.320895 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:58.320898 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:58.320941 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:58.321025 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:07:58.321813 (+ 788us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:07:58.321817 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:07:58.321820 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:07:58.321832 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:07:58.321862 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:07:58.321879 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:07:58.321972 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:58.322047 (+ 75us) server_negotiation.cc:299] Negotiation successful
0811 15:07:58.322097 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 15:07:58.325382 12804 raft_consensus.cc:348] T 00000000000000000000000000000000 P c9da7ce45365404682b25bf394684aa1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9da7ce45365404682b25bf394684aa1" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 37481 } }
I20260811 15:07:58.325649 12804 raft_consensus.cc:374] T 00000000000000000000000000000000 P c9da7ce45365404682b25bf394684aa1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:07:58.325721 12804 raft_consensus.cc:729] T 00000000000000000000000000000000 P c9da7ce45365404682b25bf394684aa1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9da7ce45365404682b25bf394684aa1, State: Initialized, Role: FOLLOWER
I20260811 15:07:58.326249 12804 consensus_queue.cc:260] T 00000000000000000000000000000000 P c9da7ce45365404682b25bf394684aa1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9da7ce45365404682b25bf394684aa1" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 37481 } }
I20260811 15:07:58.326422 12804 raft_consensus.cc:388] T 00000000000000000000000000000000 P c9da7ce45365404682b25bf394684aa1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 15:07:58.326519 12804 raft_consensus.cc:482] T 00000000000000000000000000000000 P c9da7ce45365404682b25bf394684aa1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 15:07:58.326648 12804 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c9da7ce45365404682b25bf394684aa1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:07:58.327675 12804 raft_consensus.cc:504] T 00000000000000000000000000000000 P c9da7ce45365404682b25bf394684aa1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9da7ce45365404682b25bf394684aa1" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 37481 } }
I20260811 15:07:58.328040 12804 leader_election.cc:302] T 00000000000000000000000000000000 P c9da7ce45365404682b25bf394684aa1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c9da7ce45365404682b25bf394684aa1; no voters:
I20260811 15:07:58.328383 12804 leader_election.cc:288] T 00000000000000000000000000000000 P c9da7ce45365404682b25bf394684aa1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 15:07:58.328584 12816 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c9da7ce45365404682b25bf394684aa1 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:07:58.328851 12816 raft_consensus.cc:686] T 00000000000000000000000000000000 P c9da7ce45365404682b25bf394684aa1 [term 1 LEADER]: Becoming Leader. State: Replica: c9da7ce45365404682b25bf394684aa1, State: Running, Role: LEADER
I20260811 15:07:58.329177 12816 consensus_queue.cc:237] T 00000000000000000000000000000000 P c9da7ce45365404682b25bf394684aa1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9da7ce45365404682b25bf394684aa1" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 37481 } }
I20260811 15:07:58.329792 12804 sys_catalog.cc:564] T 00000000000000000000000000000000 P c9da7ce45365404682b25bf394684aa1 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:07:58.331393 12817 sys_catalog.cc:455] T 00000000000000000000000000000000 P c9da7ce45365404682b25bf394684aa1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c9da7ce45365404682b25bf394684aa1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9da7ce45365404682b25bf394684aa1" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 37481 } } }
I20260811 15:07:58.331555 12817 sys_catalog.cc:458] T 00000000000000000000000000000000 P c9da7ce45365404682b25bf394684aa1 [sys.catalog]: This master's current role is: LEADER
I20260811 15:07:58.331897 12818 sys_catalog.cc:455] T 00000000000000000000000000000000 P c9da7ce45365404682b25bf394684aa1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c9da7ce45365404682b25bf394684aa1. Latest consensus state: current_term: 1 leader_uuid: "c9da7ce45365404682b25bf394684aa1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c9da7ce45365404682b25bf394684aa1" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 37481 } } }
I20260811 15:07:58.332015 12818 sys_catalog.cc:458] T 00000000000000000000000000000000 P c9da7ce45365404682b25bf394684aa1 [sys.catalog]: This master's current role is: LEADER
I20260811 15:07:58.332424 12830 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:07:58.335503 12830 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:07:58.342163 12830 catalog_manager.cc:1347] Generated new cluster ID: b02193a3c8d04b2ead6079bcf7f1a934
I20260811 15:07:58.342235 12830 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:07:58.352066 12830 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 15:07:58.352422 12830 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:07:58.361334 12830 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c9da7ce45365404682b25bf394684aa1: Generated new TSK 0
I20260811 15:07:58.362200 12830 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 15:07:58.365911 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 12727
2026-08-11T15:07:58Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1483 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786460596631409-20401-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 15:07:58 dist-test-slave-8n49 krb5kdc[12838](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 15:07:58 dist-test-slave-8n49 krb5kdc[12838](info): set up 2 sockets
Aug 11 15:07:58 dist-test-slave-8n49 krb5kdc[12838](info): commencing operation
krb5kdc: starting...
W20260811 15:07:59.484184 20401 mini_kdc.cc:121] Time spent starting KDC: real 1.094s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786460596631409-20401-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786460596631409-20401-0/krb5kdc/test-user.keytab.
Aug 11 15:07:59 dist-test-slave-8n49 krb5kdc[12838](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460879, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T15:07:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T15:07:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.236.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.236.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.236.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab.
Entry for principal kudu/127.19.236.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab.
I20260811 15:07:59.617332 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786460596631409-20401-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786460596631409-20401-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786460596631409-20401-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:43327
--webserver_interface=127.19.236.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab
--principal=kudu/127.19.236.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:41077
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.236.126:43327
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:07:59.738834 12852 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:07:59.739115 12852 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:07:59.739158 12852 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:07:59.743166 12852 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:07:59.743229 12852 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:07:59.743249 12852 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:07:59.743271 12852 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:07:59.743286 12852 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:07:59.748687 12852 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:41077
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786460596631409-20401-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786460596631409-20401-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.236.126:43327
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab
--principal=kudu/127.19.236.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:43327
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.236.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12852
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786460596631409-20401-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:07:59.749771 12852 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:07:59.750799 12852 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:07:59.759786 12859 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:07:59.759795 12860 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:07:59.759795 12852 server_base.cc:1034] running on GCE node
W20260811 15:07:59.759815 12862 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:07:59.760715 12852 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:07:59.761899 12852 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:07:59.763103 12852 hybrid_clock.cc:648] HybridClock initialized: now 1786460879763072 us; error 44 us; skew 500 ppm
Aug 11 15:07:59 dist-test-slave-8n49 krb5kdc[12838](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460879, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:07:59.766153 12852 init.cc:377] Logged in from keytab as kudu/127.19.236.126@KRBTEST.COM (short username kudu)
I20260811 15:07:59.767105 12852 webserver.cc:460] Webserver started at http://127.19.236.126:37765/ using document root <none> and password file <none>
I20260811 15:07:59.767696 12852 fs_manager.cc:359] Metadata directory not provided
I20260811 15:07:59.767791 12852 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:07:59.768040 12852 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:07:59.770217 12852 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786460596631409-20401-0/minicluster-data/master-0/data/instance:
uuid: "4f802e0ddf9145518a717f49586fa394"
format_stamp: "Formatted at 2026-08-11 15:07:59 on dist-test-slave-8n49"
server_key: "70f111656b80fc1eded0b9806712d5d7"
server_key_iv: "1060f323e8ec72eef3d77906d4fce69c"
server_key_version: "encryptionkey@0"
I20260811 15:07:59.770816 12852 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786460596631409-20401-0/minicluster-data/master-0/wal/instance:
uuid: "4f802e0ddf9145518a717f49586fa394"
format_stamp: "Formatted at 2026-08-11 15:07:59 on dist-test-slave-8n49"
server_key: "70f111656b80fc1eded0b9806712d5d7"
server_key_iv: "1060f323e8ec72eef3d77906d4fce69c"
server_key_version: "encryptionkey@0"
I20260811 15:07:59.774737 12852 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 15:07:59.777254 12869 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:07:59.778540 12852 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 15:07:59.778690 12852 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786460596631409-20401-0/minicluster-data/master-0/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786460596631409-20401-0/minicluster-data/master-0/wal
uuid: "4f802e0ddf9145518a717f49586fa394"
format_stamp: "Formatted at 2026-08-11 15:07:59 on dist-test-slave-8n49"
server_key: "70f111656b80fc1eded0b9806712d5d7"
server_key_iv: "1060f323e8ec72eef3d77906d4fce69c"
server_key_version: "encryptionkey@0"
I20260811 15:07:59.778816 12852 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786460596631409-20401-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786460596631409-20401-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786460596631409-20401-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:07:59.814229 12852 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:07:59.817898 12852 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:07:59.818138 12852 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:07:59.825778 12852 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.126:43327
I20260811 15:07:59.825800 12929 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.126:43327 every 8 connection(s)
I20260811 15:07:59.826781 12852 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
I20260811 15:07:59.829743 12930 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:07:59.835466 12930 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4f802e0ddf9145518a717f49586fa394: Bootstrap starting.
I20260811 15:07:59.835865 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 12852
I20260811 15:07:59.836043 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786460596631409-20401-0/minicluster-data/master-0/wal/instance
I20260811 15:07:59.836342 20401 external_mini_cluster.cc:1428] Setting key 5adb3b4f41aad634f4fa93aa4d38fffd
I20260811 15:07:59.838517 12930 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4f802e0ddf9145518a717f49586fa394: Neither blocks nor log segments found. Creating new log.
I20260811 15:07:59.839479 12930 log.cc:824] T 00000000000000000000000000000000 P 4f802e0ddf9145518a717f49586fa394: Log is configured to *not* fsync() on all Append() calls
I20260811 15:07:59.841915 12930 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4f802e0ddf9145518a717f49586fa394: No bootstrap required, opened a new log
I20260811 15:07:59.846517 12930 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4f802e0ddf9145518a717f49586fa394 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f802e0ddf9145518a717f49586fa394" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 43327 } }
Aug 11 15:07:59 dist-test-slave-8n49 krb5kdc[12838](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460879, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
I20260811 15:07:59.846846 12930 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4f802e0ddf9145518a717f49586fa394 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:07:59.846905 12930 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4f802e0ddf9145518a717f49586fa394 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f802e0ddf9145518a717f49586fa394, State: Initialized, Role: FOLLOWER
I20260811 15:07:59.847420 12930 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4f802e0ddf9145518a717f49586fa394 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f802e0ddf9145518a717f49586fa394" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 43327 } }
I20260811 15:07:59.847617 12930 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4f802e0ddf9145518a717f49586fa394 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 15:07:59.847698 12930 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4f802e0ddf9145518a717f49586fa394 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 15:07:59.847815 12930 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4f802e0ddf9145518a717f49586fa394 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:07:59.849373 12930 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4f802e0ddf9145518a717f49586fa394 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f802e0ddf9145518a717f49586fa394" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 43327 } }
I20260811 15:07:59.849795 12930 leader_election.cc:302] T 00000000000000000000000000000000 P 4f802e0ddf9145518a717f49586fa394 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4f802e0ddf9145518a717f49586fa394; no voters:
I20260811 15:07:59.850203 12930 leader_election.cc:288] T 00000000000000000000000000000000 P 4f802e0ddf9145518a717f49586fa394 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 15:07:59.850338 12935 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4f802e0ddf9145518a717f49586fa394 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:07:59.850594 12935 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4f802e0ddf9145518a717f49586fa394 [term 1 LEADER]: Becoming Leader. State: Replica: 4f802e0ddf9145518a717f49586fa394, State: Running, Role: LEADER
I20260811 15:07:59.851024 12935 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4f802e0ddf9145518a717f49586fa394 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f802e0ddf9145518a717f49586fa394" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 43327 } }
I20260811 15:07:59.851694 12930 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4f802e0ddf9145518a717f49586fa394 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:07:59.852849 12937 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4f802e0ddf9145518a717f49586fa394 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4f802e0ddf9145518a717f49586fa394. Latest consensus state: current_term: 1 leader_uuid: "4f802e0ddf9145518a717f49586fa394" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f802e0ddf9145518a717f49586fa394" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 43327 } } }
I20260811 15:07:59.852983 12937 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4f802e0ddf9145518a717f49586fa394 [sys.catalog]: This master's current role is: LEADER
I20260811 15:07:59.853333 12936 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4f802e0ddf9145518a717f49586fa394 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4f802e0ddf9145518a717f49586fa394" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f802e0ddf9145518a717f49586fa394" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 43327 } } }
I20260811 15:07:59.853411 12936 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4f802e0ddf9145518a717f49586fa394 [sys.catalog]: This master's current role is: LEADER
I20260811 15:07:59.853961 12933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:59.837841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50735 (local address 127.19.236.126:43327)
0811 15:07:59.838294 (+ 453us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:59.838314 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:59.838357 (+ 43us) server_negotiation.cc:407] Connection header received
0811 15:07:59.839264 (+ 907us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:59.839287 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:59.839745 (+ 458us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:59.840094 (+ 349us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:07:59.841063 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:59.842514 (+ 1451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:59.843474 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:59.844210 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:59.844376 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:59.847529 (+ 3153us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:07:59.847537 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:07:59.847558 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:07:59.847608 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:07:59.850140 (+ 2532us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:07:59.850759 (+ 619us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:07:59.850765 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:07:59.850772 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:07:59.850939 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:07:59.851301 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:07:59.851305 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:07:59.851306 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:07:59.851887 (+ 581us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:07:59.852108 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:59.852466 (+ 358us) server_negotiation.cc:299] Negotiation successful
0811 15:07:59.852881 (+ 415us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":298,"thread_start_us":125,"threads_started":1}
I20260811 15:07:59.857147 20401 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260811 15:07:59.857797 12952 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4f802e0ddf9145518a717f49586fa394: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 15:07:59.857915 12952 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 15:07:59.858033 12945 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:07:59.858940 12945 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:07:59.864997 12945 catalog_manager.cc:1347] Generated new cluster ID: 098d7af1b54f41b8879a270d5a218952
I20260811 15:07:59.865150 12945 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:07:59.868678 12933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:07:59.859399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49075 (local address 127.19.236.126:43327)
0811 15:07:59.859517 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0811 15:07:59.859522 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:07:59.859706 (+ 184us) server_negotiation.cc:407] Connection header received
0811 15:07:59.859863 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:07:59.859866 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:07:59.859967 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:07:59.860108 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:07:59.860879 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:59.861627 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:59.862903 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:07:59.863237 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:07:59.863349 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:07:59.865088 (+ 1739us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:07:59.865093 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:07:59.865096 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:07:59.865124 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:07:59.866873 (+ 1749us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:07:59.867343 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:07:59.867347 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:07:59.867350 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:07:59.867445 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:07:59.867749 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:07:59.867753 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:07:59.867754 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:07:59.867984 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:07:59.868119 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0811 15:07:59.868356 (+ 237us) server_negotiation.cc:299] Negotiation successful
0811 15:07:59.868481 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 15:07:59.893154 12945 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 15:07:59.894265 12945 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:07:59.899320 12945 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4f802e0ddf9145518a717f49586fa394: Generated new TSK 0
I20260811 15:07:59.900297 12945 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 15:07:59.910568 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 12852
2026-08-11T15:07:59Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1544 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786460596631409-20401-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 15:07:59 dist-test-slave-8n49 krb5kdc[12965](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 15:07:59 dist-test-slave-8n49 krb5kdc[12965](info): set up 2 sockets
Aug 11 15:07:59 dist-test-slave-8n49 krb5kdc[12965](info): commencing operation
krb5kdc: starting...
W20260811 15:08:01.029456 20401 mini_kdc.cc:121] Time spent starting KDC: real 1.095s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786460596631409-20401-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786460596631409-20401-0/krb5kdc/test-user.keytab.
Aug 11 15:08:01 dist-test-slave-8n49 krb5kdc[12965](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460881, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T15:08:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T15:08:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.236.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.236.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.236.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab.
Entry for principal kudu/127.19.236.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab.
I20260811 15:08:01.159238 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786460596631409-20401-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786460596631409-20401-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786460596631409-20401-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:43345
--webserver_interface=127.19.236.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab
--principal=kudu/127.19.236.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:42051
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.236.126:43345
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:08:01.273332 12980 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:08:01.273638 12980 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:08:01.273718 12980 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:08:01.277700 12980 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:08:01.277793 12980 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:08:01.277833 12980 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:08:01.277885 12980 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:08:01.277917 12980 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:08:01.283207 12980 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:42051
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786460596631409-20401-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786460596631409-20401-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.236.126:43345
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab
--principal=kudu/127.19.236.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:43345
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.236.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12980
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786460596631409-20401-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:08:01.284363 12980 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:08:01.285457 12980 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 15:08:01.294054 12980 server_base.cc:1034] running on GCE node
W20260811 15:08:01.294039 12985 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:08:01.294039 12986 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:08:01.294230 12988 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:08:01.294854 12980 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:08:01.296062 12980 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:08:01.297226 12980 hybrid_clock.cc:648] HybridClock initialized: now 1786460881297208 us; error 33 us; skew 500 ppm
Aug 11 15:08:01 dist-test-slave-8n49 krb5kdc[12965](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460881, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:08:01.300098 12980 init.cc:377] Logged in from keytab as kudu/127.19.236.126@KRBTEST.COM (short username kudu)
I20260811 15:08:01.301074 12980 webserver.cc:460] Webserver started at http://127.19.236.126:41505/ using document root <none> and password file <none>
I20260811 15:08:01.301651 12980 fs_manager.cc:359] Metadata directory not provided
I20260811 15:08:01.301744 12980 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:08:01.301959 12980 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:08:01.304034 12980 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786460596631409-20401-0/minicluster-data/master-0/data/instance:
uuid: "dd781c62b4e04b3d81ba8da1ba180347"
format_stamp: "Formatted at 2026-08-11 15:08:01 on dist-test-slave-8n49"
server_key: "fd158fd6305058b42f5667fd91e37c52"
server_key_iv: "7fa7e72e865701f34101b90d3dd787fb"
server_key_version: "encryptionkey@0"
I20260811 15:08:01.304670 12980 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786460596631409-20401-0/minicluster-data/master-0/wal/instance:
uuid: "dd781c62b4e04b3d81ba8da1ba180347"
format_stamp: "Formatted at 2026-08-11 15:08:01 on dist-test-slave-8n49"
server_key: "fd158fd6305058b42f5667fd91e37c52"
server_key_iv: "7fa7e72e865701f34101b90d3dd787fb"
server_key_version: "encryptionkey@0"
I20260811 15:08:01.308471 12980 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260811 15:08:01.310962 12995 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:08:01.312227 12980 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 15:08:01.312403 12980 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786460596631409-20401-0/minicluster-data/master-0/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786460596631409-20401-0/minicluster-data/master-0/wal
uuid: "dd781c62b4e04b3d81ba8da1ba180347"
format_stamp: "Formatted at 2026-08-11 15:08:01 on dist-test-slave-8n49"
server_key: "fd158fd6305058b42f5667fd91e37c52"
server_key_iv: "7fa7e72e865701f34101b90d3dd787fb"
server_key_version: "encryptionkey@0"
I20260811 15:08:01.312523 12980 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786460596631409-20401-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786460596631409-20401-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786460596631409-20401-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:08:01.342834 12980 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:08:01.346333 12980 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:08:01.346563 12980 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:08:01.354202 12980 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.126:43345
I20260811 15:08:01.354228 13056 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.126:43345 every 8 connection(s)
I20260811 15:08:01.355187 12980 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
I20260811 15:08:01.356499 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 12980
I20260811 15:08:01.356655 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786460596631409-20401-0/minicluster-data/master-0/wal/instance
I20260811 15:08:01.356992 20401 external_mini_cluster.cc:1428] Setting key d73fa5fc1a7a729e057c4dd7bbc95678
I20260811 15:08:01.358496 13057 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:08:01.364106 13057 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dd781c62b4e04b3d81ba8da1ba180347: Bootstrap starting.
I20260811 15:08:01.365948 13060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:01.358480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43201 (local address 127.19.236.126:43345)
0811 15:08:01.358947 (+ 467us) server_negotiation.cc:206] Beginning negotiation
0811 15:08:01.358962 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 15:08:01.358999 (+ 37us) server_negotiation.cc:407] Connection header received
0811 15:08:01.359641 (+ 642us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:08:01.359656 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:08:01.359991 (+ 335us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:08:01.360325 (+ 334us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:08:01.360766 (+ 441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:08:01.361762 (+ 996us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:08:01.362668 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:08:01.363148 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:08:01.363328 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:08:01.364224 (+ 896us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:08:01.364231 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:08:01.364254 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:08:01.364712 (+ 458us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:08:01.364771 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:08:01.364794 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:08:01.364915 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0811 15:08:01.365032 (+ 117us) server_negotiation.cc:299] Negotiation successful
0811 15:08:01.365243 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":312,"thread_start_us":152,"threads_started":1}
I20260811 15:08:01.366534 13057 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dd781c62b4e04b3d81ba8da1ba180347: Neither blocks nor log segments found. Creating new log.
I20260811 15:08:01.367254 13057 log.cc:824] T 00000000000000000000000000000000 P dd781c62b4e04b3d81ba8da1ba180347: Log is configured to *not* fsync() on all Append() calls
I20260811 15:08:01.368911 20401 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 15:08:01.369788 13057 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dd781c62b4e04b3d81ba8da1ba180347: No bootstrap required, opened a new log
I20260811 15:08:01.374326 13057 raft_consensus.cc:348] T 00000000000000000000000000000000 P dd781c62b4e04b3d81ba8da1ba180347 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd781c62b4e04b3d81ba8da1ba180347" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 43345 } }
I20260811 15:08:01.374644 13057 raft_consensus.cc:374] T 00000000000000000000000000000000 P dd781c62b4e04b3d81ba8da1ba180347 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:08:01.374758 13057 raft_consensus.cc:729] T 00000000000000000000000000000000 P dd781c62b4e04b3d81ba8da1ba180347 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd781c62b4e04b3d81ba8da1ba180347, State: Initialized, Role: FOLLOWER
I20260811 15:08:01.375267 13057 consensus_queue.cc:260] T 00000000000000000000000000000000 P dd781c62b4e04b3d81ba8da1ba180347 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd781c62b4e04b3d81ba8da1ba180347" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 43345 } }
I20260811 15:08:01.375444 13057 raft_consensus.cc:388] T 00000000000000000000000000000000 P dd781c62b4e04b3d81ba8da1ba180347 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 15:08:01.375521 13057 raft_consensus.cc:482] T 00000000000000000000000000000000 P dd781c62b4e04b3d81ba8da1ba180347 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 15:08:01.375631 13057 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dd781c62b4e04b3d81ba8da1ba180347 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:08:01.376951 13057 raft_consensus.cc:504] T 00000000000000000000000000000000 P dd781c62b4e04b3d81ba8da1ba180347 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd781c62b4e04b3d81ba8da1ba180347" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 43345 } }
I20260811 15:08:01.377074 13060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:01.371478 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41707 (local address 127.19.236.126:43345)
0811 15:08:01.371619 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0811 15:08:01.371624 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:08:01.371914 (+ 290us) server_negotiation.cc:407] Connection header received
0811 15:08:01.372030 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:08:01.372033 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:08:01.372102 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:08:01.372184 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:08:01.372618 (+ 434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:08:01.373877 (+ 1259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:08:01.375085 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:08:01.375476 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:08:01.375565 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:08:01.376590 (+ 1025us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:08:01.376595 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:08:01.376598 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:08:01.376611 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:08:01.376639 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:08:01.376657 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:08:01.376740 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 15:08:01.376833 (+ 93us) server_negotiation.cc:299] Negotiation successful
0811 15:08:01.376887 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 15:08:01.377355 13057 leader_election.cc:302] T 00000000000000000000000000000000 P dd781c62b4e04b3d81ba8da1ba180347 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dd781c62b4e04b3d81ba8da1ba180347; no voters:
I20260811 15:08:01.377760 13057 leader_election.cc:288] T 00000000000000000000000000000000 P dd781c62b4e04b3d81ba8da1ba180347 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 15:08:01.377840 13069 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dd781c62b4e04b3d81ba8da1ba180347 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:08:01.378166 13069 raft_consensus.cc:686] T 00000000000000000000000000000000 P dd781c62b4e04b3d81ba8da1ba180347 [term 1 LEADER]: Becoming Leader. State: Replica: dd781c62b4e04b3d81ba8da1ba180347, State: Running, Role: LEADER
I20260811 15:08:01.378469 13069 consensus_queue.cc:237] T 00000000000000000000000000000000 P dd781c62b4e04b3d81ba8da1ba180347 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd781c62b4e04b3d81ba8da1ba180347" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 43345 } }
I20260811 15:08:01.379145 13057 sys_catalog.cc:564] T 00000000000000000000000000000000 P dd781c62b4e04b3d81ba8da1ba180347 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:08:01.379719 13069 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd781c62b4e04b3d81ba8da1ba180347 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dd781c62b4e04b3d81ba8da1ba180347. Latest consensus state: current_term: 1 leader_uuid: "dd781c62b4e04b3d81ba8da1ba180347" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd781c62b4e04b3d81ba8da1ba180347" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 43345 } } }
I20260811 15:08:01.379840 13069 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd781c62b4e04b3d81ba8da1ba180347 [sys.catalog]: This master's current role is: LEADER
I20260811 15:08:01.380316 13070 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd781c62b4e04b3d81ba8da1ba180347 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dd781c62b4e04b3d81ba8da1ba180347" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd781c62b4e04b3d81ba8da1ba180347" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 43345 } } }
I20260811 15:08:01.380429 13070 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd781c62b4e04b3d81ba8da1ba180347 [sys.catalog]: This master's current role is: LEADER
I20260811 15:08:01.380738 13075 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:08:01.383546 13075 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:08:01.389170 13075 catalog_manager.cc:1347] Generated new cluster ID: 8d7d9782130b4603ad12cdf24855fef0
I20260811 15:08:01.389240 13075 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:08:01.416033 13075 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 15:08:01.417416 13075 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:08:01.432598 13075 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dd781c62b4e04b3d81ba8da1ba180347: Generated new TSK 0
I20260811 15:08:01.433527 13075 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 15:08:01.439987 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 12980
2026-08-11T15:08:01Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1529 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786460596631409-20401-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 15:08:01 dist-test-slave-8n49 krb5kdc[13094](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 15:08:01 dist-test-slave-8n49 krb5kdc[13094](info): set up 2 sockets
Aug 11 15:08:01 dist-test-slave-8n49 krb5kdc[13094](info): commencing operation
krb5kdc: starting...
W20260811 15:08:02.545691 20401 mini_kdc.cc:121] Time spent starting KDC: real 1.082s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786460596631409-20401-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786460596631409-20401-0/krb5kdc/test-user.keytab.
Aug 11 15:08:02 dist-test-slave-8n49 krb5kdc[13094](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460882, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T15:08:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T15:08:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.236.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.236.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.236.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab.
Entry for principal kudu/127.19.236.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab.
I20260811 15:08:02.680025 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786460596631409-20401-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786460596631409-20401-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786460596631409-20401-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:36441
--webserver_interface=127.19.236.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab
--principal=kudu/127.19.236.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:44371
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.236.126:36441
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:08:02.796949 13107 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:08:02.797276 13107 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:08:02.797360 13107 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:08:02.801465 13107 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:08:02.801569 13107 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:08:02.801610 13107 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:08:02.801649 13107 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:08:02.801687 13107 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:08:02.807268 13107 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:44371
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786460596631409-20401-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786460596631409-20401-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.236.126:36441
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab
--principal=kudu/127.19.236.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:36441
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.236.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13107
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786460596631409-20401-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:08:02.808460 13107 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:08:02.809572 13107 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:08:02.818662 13112 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:08:02.818658 13113 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:08:02.818658 13115 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:08:02.818717 13107 server_base.cc:1034] running on GCE node
I20260811 15:08:02.819624 13107 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:08:02.820946 13107 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:08:02.822144 13107 hybrid_clock.cc:648] HybridClock initialized: now 1786460882822126 us; error 34 us; skew 500 ppm
Aug 11 15:08:02 dist-test-slave-8n49 krb5kdc[13094](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460882, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:08:02.825112 13107 init.cc:377] Logged in from keytab as kudu/127.19.236.126@KRBTEST.COM (short username kudu)
I20260811 15:08:02.826071 13107 webserver.cc:460] Webserver started at http://127.19.236.126:36675/ using document root <none> and password file <none>
I20260811 15:08:02.826751 13107 fs_manager.cc:359] Metadata directory not provided
I20260811 15:08:02.826844 13107 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:08:02.827103 13107 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:08:02.829321 13107 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786460596631409-20401-0/minicluster-data/master-0/data/instance:
uuid: "a04b3b7d6533440a9dbd0b90e5fed7bf"
format_stamp: "Formatted at 2026-08-11 15:08:02 on dist-test-slave-8n49"
server_key: "80e6eb7e16445d75bd41b85079c5e343"
server_key_iv: "343fae1fa8af6903c6ff7949b084b6ba"
server_key_version: "encryptionkey@0"
I20260811 15:08:02.829953 13107 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786460596631409-20401-0/minicluster-data/master-0/wal/instance:
uuid: "a04b3b7d6533440a9dbd0b90e5fed7bf"
format_stamp: "Formatted at 2026-08-11 15:08:02 on dist-test-slave-8n49"
server_key: "80e6eb7e16445d75bd41b85079c5e343"
server_key_iv: "343fae1fa8af6903c6ff7949b084b6ba"
server_key_version: "encryptionkey@0"
I20260811 15:08:02.834522 13107 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 15:08:02.837453 13122 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:08:02.838804 13107 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 15:08:02.838974 13107 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786460596631409-20401-0/minicluster-data/master-0/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786460596631409-20401-0/minicluster-data/master-0/wal
uuid: "a04b3b7d6533440a9dbd0b90e5fed7bf"
format_stamp: "Formatted at 2026-08-11 15:08:02 on dist-test-slave-8n49"
server_key: "80e6eb7e16445d75bd41b85079c5e343"
server_key_iv: "343fae1fa8af6903c6ff7949b084b6ba"
server_key_version: "encryptionkey@0"
I20260811 15:08:02.839107 13107 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786460596631409-20401-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786460596631409-20401-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786460596631409-20401-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:08:02.844007 13107 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:08:02.847285 13107 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:08:02.847489 13107 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:08:02.854633 13107 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.126:36441
I20260811 15:08:02.854708 13181 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.126:36441 every 8 connection(s)
I20260811 15:08:02.855669 13107 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
I20260811 15:08:02.857199 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 13107
I20260811 15:08:02.857352 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786460596631409-20401-0/minicluster-data/master-0/wal/instance
I20260811 15:08:02.857661 20401 external_mini_cluster.cc:1428] Setting key aaccc1543c6e775f976b927a53efc969
I20260811 15:08:02.858937 13182 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:08:02.863456 13185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:02.859075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50187 (local address 127.19.236.126:36441)
0811 15:08:02.859524 (+ 449us) server_negotiation.cc:206] Beginning negotiation
0811 15:08:02.859546 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0811 15:08:02.859590 (+ 44us) server_negotiation.cc:407] Connection header received
0811 15:08:02.860444 (+ 854us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:08:02.860469 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:08:02.860860 (+ 391us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:08:02.861220 (+ 360us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:08:02.861993 (+ 773us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:08:02.861999 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:08:02.862013 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:08:02.862035 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:08:02.862105 (+ 70us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:08:02.862135 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:08:02.862280 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0811 15:08:02.862351 (+ 71us) server_negotiation.cc:299] Negotiation successful
0811 15:08:02.862504 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":290,"thread_start_us":125,"threads_started":1}
I20260811 15:08:02.866158 13182 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a04b3b7d6533440a9dbd0b90e5fed7bf: Bootstrap starting.
I20260811 15:08:02.866480 20401 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 15:08:02.868633 13182 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a04b3b7d6533440a9dbd0b90e5fed7bf: Neither blocks nor log segments found. Creating new log.
I20260811 15:08:02.869583 13182 log.cc:824] T 00000000000000000000000000000000 P a04b3b7d6533440a9dbd0b90e5fed7bf: Log is configured to *not* fsync() on all Append() calls
I20260811 15:08:02.870299 13185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:02.868616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54323 (local address 127.19.236.126:36441)
0811 15:08:02.868753 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0811 15:08:02.868760 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 15:08:02.868902 (+ 142us) server_negotiation.cc:407] Connection header received
0811 15:08:02.868984 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:08:02.868988 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:08:02.869038 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:08:02.869120 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:08:02.869859 (+ 739us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:08:02.869863 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:08:02.869867 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 15:08:02.869880 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:08:02.869908 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 15:08:02.869923 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:08:02.870023 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0811 15:08:02.870129 (+ 106us) server_negotiation.cc:299] Negotiation successful
0811 15:08:02.870161 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 15:08:02.871803 13182 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a04b3b7d6533440a9dbd0b90e5fed7bf: No bootstrap required, opened a new log
I20260811 15:08:02.875373 13182 raft_consensus.cc:348] T 00000000000000000000000000000000 P a04b3b7d6533440a9dbd0b90e5fed7bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a04b3b7d6533440a9dbd0b90e5fed7bf" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 36441 } }
I20260811 15:08:02.875607 13182 raft_consensus.cc:374] T 00000000000000000000000000000000 P a04b3b7d6533440a9dbd0b90e5fed7bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 15:08:02.875687 13182 raft_consensus.cc:729] T 00000000000000000000000000000000 P a04b3b7d6533440a9dbd0b90e5fed7bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a04b3b7d6533440a9dbd0b90e5fed7bf, State: Initialized, Role: FOLLOWER
I20260811 15:08:02.876176 13182 consensus_queue.cc:260] T 00000000000000000000000000000000 P a04b3b7d6533440a9dbd0b90e5fed7bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a04b3b7d6533440a9dbd0b90e5fed7bf" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 36441 } }
I20260811 15:08:02.876343 13182 raft_consensus.cc:388] T 00000000000000000000000000000000 P a04b3b7d6533440a9dbd0b90e5fed7bf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 15:08:02.876412 13182 raft_consensus.cc:482] T 00000000000000000000000000000000 P a04b3b7d6533440a9dbd0b90e5fed7bf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 15:08:02.876514 13182 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a04b3b7d6533440a9dbd0b90e5fed7bf [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:08:02.877512 13182 raft_consensus.cc:504] T 00000000000000000000000000000000 P a04b3b7d6533440a9dbd0b90e5fed7bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a04b3b7d6533440a9dbd0b90e5fed7bf" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 36441 } }
I20260811 15:08:02.877868 13182 leader_election.cc:302] T 00000000000000000000000000000000 P a04b3b7d6533440a9dbd0b90e5fed7bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a04b3b7d6533440a9dbd0b90e5fed7bf; no voters:
I20260811 15:08:02.878211 13182 leader_election.cc:288] T 00000000000000000000000000000000 P a04b3b7d6533440a9dbd0b90e5fed7bf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 15:08:02.878332 13193 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a04b3b7d6533440a9dbd0b90e5fed7bf [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:08:02.878604 13193 raft_consensus.cc:686] T 00000000000000000000000000000000 P a04b3b7d6533440a9dbd0b90e5fed7bf [term 1 LEADER]: Becoming Leader. State: Replica: a04b3b7d6533440a9dbd0b90e5fed7bf, State: Running, Role: LEADER
I20260811 15:08:02.879014 13193 consensus_queue.cc:237] T 00000000000000000000000000000000 P a04b3b7d6533440a9dbd0b90e5fed7bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a04b3b7d6533440a9dbd0b90e5fed7bf" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 36441 } }
I20260811 15:08:02.879532 13182 sys_catalog.cc:564] T 00000000000000000000000000000000 P a04b3b7d6533440a9dbd0b90e5fed7bf [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:08:02.880780 13194 sys_catalog.cc:455] T 00000000000000000000000000000000 P a04b3b7d6533440a9dbd0b90e5fed7bf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a04b3b7d6533440a9dbd0b90e5fed7bf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a04b3b7d6533440a9dbd0b90e5fed7bf" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 36441 } } }
I20260811 15:08:02.880926 13194 sys_catalog.cc:458] T 00000000000000000000000000000000 P a04b3b7d6533440a9dbd0b90e5fed7bf [sys.catalog]: This master's current role is: LEADER
I20260811 15:08:02.881294 13195 sys_catalog.cc:455] T 00000000000000000000000000000000 P a04b3b7d6533440a9dbd0b90e5fed7bf [sys.catalog]: SysCatalogTable state changed. Reason: New leader a04b3b7d6533440a9dbd0b90e5fed7bf. Latest consensus state: current_term: 1 leader_uuid: "a04b3b7d6533440a9dbd0b90e5fed7bf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a04b3b7d6533440a9dbd0b90e5fed7bf" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 36441 } } }
I20260811 15:08:02.881385 13195 sys_catalog.cc:458] T 00000000000000000000000000000000 P a04b3b7d6533440a9dbd0b90e5fed7bf [sys.catalog]: This master's current role is: LEADER
I20260811 15:08:02.881460 13204 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:08:02.884347 13204 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:08:02.890044 13204 catalog_manager.cc:1347] Generated new cluster ID: 531b78e7ba464e8fbf9aac0388a0b599
I20260811 15:08:02.890147 13204 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:08:02.900956 13204 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 15:08:02.901321 13204 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:08:02.908735 13204 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a04b3b7d6533440a9dbd0b90e5fed7bf: Generated new TSK 0
I20260811 15:08:02.909509 13204 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 15:08:02.918048 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 13107
2026-08-11T15:08:02Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1478 ms)
[----------] 18 tests from AuthTokenIssuingTest (27105 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460596631409-20401-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 15:08:02 dist-test-slave-8n49 krb5kdc[13216](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 15:08:02 dist-test-slave-8n49 krb5kdc[13216](info): set up 2 sockets
Aug 11 15:08:02 dist-test-slave-8n49 krb5kdc[13216](info): commencing operation
krb5kdc: starting...
W20260811 15:08:04.033154 20401 mini_kdc.cc:121] Time spent starting KDC: real 1.091s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460596631409-20401-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460596631409-20401-0/krb5kdc/test-user.keytab.
Aug 11 15:08:04 dist-test-slave-8n49 krb5kdc[13216](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460884, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T15:08:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T15:08:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.236.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.236.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.236.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab.
Entry for principal kudu/127.19.236.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab.
I20260811 15:08:04.163244 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460596631409-20401-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460596631409-20401-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460596631409-20401-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:37551
--webserver_interface=127.19.236.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab
--principal=kudu/127.19.236.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:39459
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.236.126:37551,127.19.236.125:37623,127.19.236.124:44117
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:08:04.279181 13231 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 15:08:04.279464 13231 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:08:04.279488 13231 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:08:04.279599 13231 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:08:04.283710 13231 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:08:04.283773 13231 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:08:04.283793 13231 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:08:04.283816 13231 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:08:04.283833 13231 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:08:04.289126 13231 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:39459
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460596631409-20401-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460596631409-20401-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.236.126:37551,127.19.236.125:37623,127.19.236.124:44117
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab
--principal=kudu/127.19.236.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:37551
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.236.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13231
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460596631409-20401-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:08:04.290198 13231 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:08:04.291245 13231 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:08:04.299990 13239 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:08:04.299988 13237 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:08:04.300141 13231 server_base.cc:1034] running on GCE node
W20260811 15:08:04.300343 13236 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:08:04.301008 13231 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:08:04.302129 13231 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:08:04.303320 13231 hybrid_clock.cc:648] HybridClock initialized: now 1786460884303293 us; error 40 us; skew 500 ppm
Aug 11 15:08:04 dist-test-slave-8n49 krb5kdc[13216](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460884, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:08:04.311585 13231 init.cc:377] Logged in from keytab as kudu/127.19.236.126@KRBTEST.COM (short username kudu)
I20260811 15:08:04.312743 13231 webserver.cc:460] Webserver started at http://127.19.236.126:36283/ using document root <none> and password file <none>
I20260811 15:08:04.313371 13231 fs_manager.cc:359] Metadata directory not provided
I20260811 15:08:04.313482 13231 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:08:04.313745 13231 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:08:04.316171 13231 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460596631409-20401-0/minicluster-data/master-0/data/instance:
uuid: "b7ce7c8be1c3491d8df338ee8b465b99"
format_stamp: "Formatted at 2026-08-11 15:08:04 on dist-test-slave-8n49"
server_key: "69a202da52efe50195695163df162831"
server_key_iv: "6f6529307b23871105807c6d832c72d1"
server_key_version: "encryptionkey@0"
I20260811 15:08:04.316857 13231 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460596631409-20401-0/minicluster-data/master-0/wal/instance:
uuid: "b7ce7c8be1c3491d8df338ee8b465b99"
format_stamp: "Formatted at 2026-08-11 15:08:04 on dist-test-slave-8n49"
server_key: "69a202da52efe50195695163df162831"
server_key_iv: "6f6529307b23871105807c6d832c72d1"
server_key_version: "encryptionkey@0"
I20260811 15:08:04.320933 13231 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260811 15:08:04.323443 13248 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:08:04.324806 13231 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 15:08:04.324970 13231 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460596631409-20401-0/minicluster-data/master-0/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460596631409-20401-0/minicluster-data/master-0/wal
uuid: "b7ce7c8be1c3491d8df338ee8b465b99"
format_stamp: "Formatted at 2026-08-11 15:08:04 on dist-test-slave-8n49"
server_key: "69a202da52efe50195695163df162831"
server_key_iv: "6f6529307b23871105807c6d832c72d1"
server_key_version: "encryptionkey@0"
I20260811 15:08:04.325100 13231 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460596631409-20401-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460596631409-20401-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460596631409-20401-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:08:04.340008 13231 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:08:04.343329 13231 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:08:04.343555 13231 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:08:04.351022 13231 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.126:37551
I20260811 15:08:04.351325 13304 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.126:37551 every 8 connection(s)
I20260811 15:08:04.352043 13231 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
I20260811 15:08:04.354947 13306 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:08:04.358711 13306 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.236.126" port: 37551 } has no permanent_uuid. Determining permanent_uuid...
I20260811 15:08:04.360329 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 13231
I20260811 15:08:04.360491 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460596631409-20401-0/minicluster-data/master-0/wal/instance
I20260811 15:08:04.360839 20401 external_mini_cluster.cc:1428] Setting key 438828f078c5cf2bbf437b49f53c021b
Aug 11 15:08:04 dist-test-slave-8n49 krb5kdc[13216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460884, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.126@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.19.236.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.236.125@KRBTEST.COM" created.
I20260811 15:08:04.375854 13311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:04.362117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44268 (local address 127.19.236.126:37551)
0811 15:08:04.362468 (+ 351us) server_negotiation.cc:206] Beginning negotiation
0811 15:08:04.362482 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 15:08:04.362535 (+ 53us) server_negotiation.cc:407] Connection header received
0811 15:08:04.363280 (+ 745us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:08:04.363285 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:08:04.363476 (+ 191us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:08:04.363637 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:08:04.364871 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:08:04.365792 (+ 921us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:08:04.367505 (+ 1713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:08:04.367905 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:08:04.368055 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:08:04.370727 (+ 2672us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:08:04.370733 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:08:04.370745 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:08:04.370767 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:08:04.372378 (+ 1611us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:08:04.373073 (+ 695us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:08:04.373080 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:08:04.373082 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:08:04.373225 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:08:04.373591 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:08:04.373597 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:08:04.373602 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:08:04.374181 (+ 579us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:08:04.374330 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0811 15:08:04.374754 (+ 424us) server_negotiation.cc:299] Negotiation successful
0811 15:08:04.375038 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":47,"server-negotiator.queue_time_us":206,"thread_start_us":90,"threads_started":1}
I20260811 15:08:04.375859 13308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:04.361195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:37551 (local address 127.0.0.1:44268)
0811 15:08:04.361723 (+ 528us) negotiation.cc:107] Waiting for socket to connect
0811 15:08:04.361777 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 15:08:04.362941 (+ 1164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:08:04.363699 (+ 758us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:08:04.363707 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:08:04.364252 (+ 545us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:08:04.364683 (+ 431us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:08:04.364708 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:08:04.365966 (+ 1258us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:08:04.365972 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:08:04.367341 (+ 1369us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:08:04.367357 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:08:04.368104 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:08:04.368111 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:08:04.368259 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:08:04.369024 (+ 765us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:08:04.369042 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:08:04.370554 (+ 1512us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:08:04.372501 (+ 1947us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:08:04.372510 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:08:04.372520 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:08:04.372918 (+ 398us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:08:04.373325 (+ 407us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:08:04.373331 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:08:04.373336 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:08:04.373476 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:08:04.374314 (+ 838us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:08:04.374320 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:08:04.374463 (+ 143us) client_negotiation.cc:769] Sending connection context
0811 15:08:04.374613 (+ 150us) client_negotiation.cc:240] Negotiation successful
0811 15:08:04.374894 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":311,"thread_start_us":154,"threads_started":1}
I20260811 15:08:04.378724 13306 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.236.125" port: 37623 } has no permanent_uuid. Determining permanent_uuid...
I20260811 15:08:04.379612 13308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:04.379239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.125:37623 (local address 127.0.0.1:44660)
0811 15:08:04.379414 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0811 15:08:04.379517 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.125:37623: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260811 15:08:04.379827 13250 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.236.125:37623: connect: Connection refused (error 111)
I20260811 15:08:04.380784 13308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:04.380486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.125:37623 (local address 127.0.0.1:44666)
0811 15:08:04.380646 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0811 15:08:04.380703 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.125:37623: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260811 15:08:04.381014 13306 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.236.125:37623: Network error: Client connection negotiation failed: client connection to 127.19.236.125:37623: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.236.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.125.keytab.
Entry for principal kudu/127.19.236.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.125.keytab.
I20260811 15:08:04.392284 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460596631409-20401-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460596631409-20401-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460596631409-20401-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460596631409-20401-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.125:37623
--webserver_interface=127.19.236.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.125.keytab
--principal=kudu/127.19.236.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:39459
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.236.126:37551,127.19.236.125:37623,127.19.236.124:44117
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 15:08:04.430255 13306 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.236.125" port: 37623 } attempt: 1
I20260811 15:08:04.431188 13308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:04.430874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.125:37623 (local address 127.0.0.1:44678)
0811 15:08:04.431044 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0811 15:08:04.431107 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.125:37623: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260811 15:08:04.431955 13308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:04.431739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.125:37623 (local address 127.0.0.1:44682)
0811 15:08:04.431844 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0811 15:08:04.431889 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.125:37623: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260811 15:08:04.432106 13306 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.236.125:37623: Network error: Client connection negotiation failed: client connection to 127.19.236.125:37623: connect: Connection refused (error 111)
I20260811 15:08:04.500319 13306 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.236.125" port: 37623 } attempt: 2
I20260811 15:08:04.501372 13308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:04.501021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.125:37623 (local address 127.0.0.1:44694)
0811 15:08:04.501213 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0811 15:08:04.501289 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.125:37623: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
I20260811 15:08:04.502311 13308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:04.502062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.125:37623 (local address 127.0.0.1:44706)
0811 15:08:04.502203 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0811 15:08:04.502252 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.125:37623: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
W20260811 15:08:04.502549 13306 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.236.125:37623: Network error: Client connection negotiation failed: client connection to 127.19.236.125:37623: connect: Connection refused (error 111)
W20260811 15:08:04.509610 13316 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 15:08:04.509881 13316 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:08:04.509933 13316 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:08:04.510001 13316 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:08:04.514050 13316 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:08:04.514110 13316 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:08:04.514130 13316 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:08:04.514147 13316 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:08:04.514163 13316 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:08:04.519737 13316 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:39459
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460596631409-20401-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460596631409-20401-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.19.236.126:37551,127.19.236.125:37623,127.19.236.124:44117
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.125.keytab
--principal=kudu/127.19.236.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.125:37623
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460596631409-20401-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.19.236.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13316
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460596631409-20401-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:08:04.520995 13316 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:08:04.522079 13316 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:08:04.530903 13322 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:08:04.530951 13321 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:08:04.530961 13325 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:08:04.531121 13316 server_base.cc:1034] running on GCE node
I20260811 15:08:04.531803 13316 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:08:04.532967 13316 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:08:04.534130 13316 hybrid_clock.cc:648] HybridClock initialized: now 1786460884534102 us; error 40 us; skew 500 ppm
Aug 11 15:08:04 dist-test-slave-8n49 krb5kdc[13216](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460884, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:08:04.536890 13316 init.cc:377] Logged in from keytab as kudu/127.19.236.125@KRBTEST.COM (short username kudu)
I20260811 15:08:04.537806 13316 webserver.cc:460] Webserver started at http://127.19.236.125:35027/ using document root <none> and password file <none>
I20260811 15:08:04.538404 13316 fs_manager.cc:359] Metadata directory not provided
I20260811 15:08:04.538496 13316 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:08:04.538735 13316 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:08:04.540927 13316 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460596631409-20401-0/minicluster-data/master-1/data/instance:
uuid: "8075c78272f24ae3a04233064aab3b07"
format_stamp: "Formatted at 2026-08-11 15:08:04 on dist-test-slave-8n49"
server_key: "96c982fed41d5a704dad264c2c6217a9"
server_key_iv: "5fd25b0f02f51584c9a94d48017d6088"
server_key_version: "encryptionkey@0"
I20260811 15:08:04.541544 13316 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460596631409-20401-0/minicluster-data/master-1/wal/instance:
uuid: "8075c78272f24ae3a04233064aab3b07"
format_stamp: "Formatted at 2026-08-11 15:08:04 on dist-test-slave-8n49"
server_key: "96c982fed41d5a704dad264c2c6217a9"
server_key_iv: "5fd25b0f02f51584c9a94d48017d6088"
server_key_version: "encryptionkey@0"
I20260811 15:08:04.545347 13316 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260811 15:08:04.547724 13332 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:08:04.549008 13316 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 15:08:04.549144 13316 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460596631409-20401-0/minicluster-data/master-1/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460596631409-20401-0/minicluster-data/master-1/wal
uuid: "8075c78272f24ae3a04233064aab3b07"
format_stamp: "Formatted at 2026-08-11 15:08:04 on dist-test-slave-8n49"
server_key: "96c982fed41d5a704dad264c2c6217a9"
server_key_iv: "5fd25b0f02f51584c9a94d48017d6088"
server_key_version: "encryptionkey@0"
I20260811 15:08:04.549254 13316 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460596631409-20401-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460596631409-20401-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460596631409-20401-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:08:04.563905 13316 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:08:04.568382 13316 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:08:04.568634 13316 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:08:04.577636 13316 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.125:37623
I20260811 15:08:04.577931 13393 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.125:37623 every 8 connection(s)
I20260811 15:08:04.578753 13316 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460596631409-20401-0/minicluster-data/master-1/data/info.pb
I20260811 15:08:04.579589 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 13316
I20260811 15:08:04.579720 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460596631409-20401-0/minicluster-data/master-1/wal/instance
I20260811 15:08:04.580027 20401 external_mini_cluster.cc:1428] Setting key bce3a8d4fe37705a67870c6606483d83
I20260811 15:08:04.582340 13394 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:08:04.587378 13394 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.236.126" port: 37551 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.19.236.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.236.124@KRBTEST.COM" created.
I20260811 15:08:04.593741 13306 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.236.125" port: 37623 } attempt: 3
Aug 11 15:08:04 dist-test-slave-8n49 krb5kdc[13216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460884, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.125@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
Aug 11 15:08:04 dist-test-slave-8n49 krb5kdc[13216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460884, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.126@KRBTEST.COM for kudu/127.19.236.125@KRBTEST.COM
I20260811 15:08:04.604097 13311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:04.589473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44272 (local address 127.19.236.126:37551)
0811 15:08:04.589648 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0811 15:08:04.589653 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:08:04.590629 (+ 976us) server_negotiation.cc:407] Connection header received
0811 15:08:04.591604 (+ 975us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:08:04.591608 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:08:04.591676 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:08:04.591758 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:08:04.593273 (+ 1515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:08:04.594150 (+ 877us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:08:04.595655 (+ 1505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:08:04.596051 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:08:04.596195 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:08:04.599020 (+ 2825us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:08:04.599026 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:08:04.599034 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:08:04.599057 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:08:04.601559 (+ 2502us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:08:04.602201 (+ 642us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:08:04.602204 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:08:04.602205 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:08:04.602279 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:08:04.602707 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:08:04.602712 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:08:04.602714 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:08:04.602917 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:08:04.603043 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0811 15:08:04.603760 (+ 717us) server_negotiation.cc:299] Negotiation successful
0811 15:08:04.603911 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260811 15:08:04.605350 13397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:04.589869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:37551 (local address 127.0.0.1:44272)
0811 15:08:04.590462 (+ 593us) negotiation.cc:107] Waiting for socket to connect
0811 15:08:04.590507 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 15:08:04.591323 (+ 816us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:08:04.591933 (+ 610us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:08:04.591940 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:08:04.592490 (+ 550us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:08:04.593097 (+ 607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:08:04.593111 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:08:04.594339 (+ 1228us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:08:04.594345 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:08:04.595513 (+ 1168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:08:04.595529 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:08:04.596235 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:08:04.596239 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:08:04.596433 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:08:04.597183 (+ 750us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:08:04.597205 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:08:04.598899 (+ 1694us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:08:04.601672 (+ 2773us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:08:04.601684 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:08:04.601697 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:08:04.602099 (+ 402us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:08:04.602386 (+ 287us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:08:04.602390 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:08:04.602392 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:08:04.602582 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:08:04.603046 (+ 464us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:08:04.603054 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:08:04.603438 (+ 384us) client_negotiation.cc:769] Sending connection context
0811 15:08:04.603697 (+ 259us) client_negotiation.cc:240] Negotiation successful
0811 15:08:04.604097 (+ 400us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":311,"spinlock_wait_cycles":768,"thread_start_us":116,"threads_started":1}
I20260811 15:08:04.605659 13308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:04.594223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.125:37623 (local address 127.0.0.1:44708)
0811 15:08:04.594413 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0811 15:08:04.594428 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 15:08:04.594515 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:08:04.595344 (+ 829us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:08:04.595347 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:08:04.595543 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:08:04.595682 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:08:04.595689 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:08:04.596891 (+ 1202us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:08:04.596895 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:08:04.597723 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:08:04.597738 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:08:04.598628 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:08:04.598632 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:08:04.598737 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:08:04.599275 (+ 538us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:08:04.599292 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:08:04.600852 (+ 1560us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:08:04.603664 (+ 2812us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:08:04.603669 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:08:04.603671 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:08:04.603892 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:08:04.604281 (+ 389us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:08:04.604287 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:08:04.604289 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:08:04.604376 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:08:04.605024 (+ 648us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:08:04.605027 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:08:04.605136 (+ 109us) client_negotiation.cc:769] Sending connection context
0811 15:08:04.605252 (+ 116us) client_negotiation.cc:240] Negotiation successful
0811 15:08:04.605515 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121}
I20260811 15:08:04.606177 13399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:04.594315 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44708 (local address 127.19.236.125:37623)
0811 15:08:04.594837 (+ 522us) server_negotiation.cc:206] Beginning negotiation
0811 15:08:04.594850 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 15:08:04.594877 (+ 27us) server_negotiation.cc:407] Connection header received
0811 15:08:04.594928 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:08:04.594936 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:08:04.595160 (+ 224us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:08:04.595339 (+ 179us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:08:04.595796 (+ 457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:08:04.596781 (+ 985us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:08:04.597874 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:08:04.598483 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:08:04.598622 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:08:04.601026 (+ 2404us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:08:04.601035 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:08:04.601061 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:08:04.601088 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:08:04.603551 (+ 2463us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:08:04.604054 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:08:04.604059 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:08:04.604060 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:08:04.604135 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:08:04.604499 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:08:04.604502 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:08:04.604503 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:08:04.604901 (+ 398us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:08:04.605018 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0811 15:08:04.605357 (+ 339us) server_negotiation.cc:299] Negotiation successful
0811 15:08:04.606039 (+ 682us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":406,"spinlock_wait_cycles":896,"thread_start_us":172,"threads_started":1}
I20260811 15:08:04.606990 13394 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.236.125" port: 37623 } has no permanent_uuid. Determining permanent_uuid...
I20260811 15:08:04.608186 13306 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.236.124" port: 44117 } has no permanent_uuid. Determining permanent_uuid...
I20260811 15:08:04.608902 13308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:04.608700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.124:44117 (local address 127.0.0.1:58954)
0811 15:08:04.608801 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0811 15:08:04.608849 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.124:44117: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260811 15:08:04.609764 13308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:04.609490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.124:44117 (local address 127.0.0.1:58962)
0811 15:08:04.609653 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0811 15:08:04.609705 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.124:44117: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
W20260811 15:08:04.609936 13306 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.236.124:44117: Network error: Client connection negotiation failed: client connection to 127.19.236.124:44117: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.236.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.124.keytab.
Entry for principal kudu/127.19.236.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.124.keytab.
I20260811 15:08:04.611848 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460596631409-20401-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460596631409-20401-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460596631409-20401-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460596631409-20401-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.124:44117
--webserver_interface=127.19.236.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.124.keytab
--principal=kudu/127.19.236.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:39459
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.236.126:37551,127.19.236.125:37623,127.19.236.124:44117
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 15:08:04 dist-test-slave-8n49 krb5kdc[13216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460884, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.125@KRBTEST.COM for kudu/127.19.236.125@KRBTEST.COM
I20260811 15:08:04.617992 13397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:04.607495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.125:37623 (local address 127.0.0.1:44716)
0811 15:08:04.607620 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0811 15:08:04.607634 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 15:08:04.607708 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:08:04.607947 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:08:04.607950 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:08:04.608163 (+ 213us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:08:04.608272 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:08:04.608301 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:08:04.609342 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:08:04.609345 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:08:04.610368 (+ 1023us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:08:04.610379 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:08:04.610986 (+ 607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:08:04.610993 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:08:04.611130 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:08:04.611643 (+ 513us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:08:04.611657 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:08:04.612967 (+ 1310us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:08:04.614802 (+ 1835us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:08:04.614808 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:08:04.614811 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:08:04.615088 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:08:04.616914 (+ 1826us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:08:04.616916 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:08:04.616917 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:08:04.616997 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:08:04.617543 (+ 546us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:08:04.617545 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:08:04.617629 (+ 84us) client_negotiation.cc:769] Sending connection context
0811 15:08:04.617723 (+ 94us) client_negotiation.cc:240] Negotiation successful
0811 15:08:04.617862 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55}
I20260811 15:08:04.618229 13399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:04.607576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44716 (local address 127.19.236.125:37623)
0811 15:08:04.607678 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0811 15:08:04.607682 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:08:04.607695 (+ 13us) server_negotiation.cc:407] Connection header received
0811 15:08:04.607789 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:08:04.607792 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:08:04.607854 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:08:04.607934 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:08:04.608450 (+ 516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:08:04.609217 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:08:04.610484 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:08:04.610812 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:08:04.610938 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:08:04.613110 (+ 2172us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:08:04.613116 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:08:04.613122 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:08:04.613155 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:08:04.614676 (+ 1521us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:08:04.616683 (+ 2007us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:08:04.616690 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:08:04.616695 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:08:04.616797 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:08:04.617118 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:08:04.617123 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:08:04.617128 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:08:04.617407 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:08:04.617528 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0811 15:08:04.617837 (+ 309us) server_negotiation.cc:299] Negotiation successful
0811 15:08:04.617983 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 15:08:04.619002 13394 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.236.124" port: 44117 } has no permanent_uuid. Determining permanent_uuid...
I20260811 15:08:04.619756 13397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:04.619506 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.124:44117 (local address 127.0.0.1:58974)
0811 15:08:04.619629 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0811 15:08:04.619705 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.124:44117: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260811 15:08:04.620368 13335 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.236.124:44117: connect: Connection refused (error 111)
I20260811 15:08:04.621385 13397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:04.621179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.124:44117 (local address 127.0.0.1:58988)
0811 15:08:04.621289 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0811 15:08:04.621339 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.124:44117: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260811 15:08:04.621554 13394 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.236.124:44117: Network error: Client connection negotiation failed: client connection to 127.19.236.124:44117: connect: Connection refused (error 111)
I20260811 15:08:04.641139 13306 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.236.124" port: 44117 } attempt: 1
I20260811 15:08:04.642058 13308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:04.641758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.124:44117 (local address 127.0.0.1:59000)
0811 15:08:04.641909 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0811 15:08:04.641979 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.124:44117: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260811 15:08:04.642850 13308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:04.642611 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.124:44117 (local address 127.0.0.1:59006)
0811 15:08:04.642744 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0811 15:08:04.642796 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.124:44117: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260811 15:08:04.643023 13306 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.236.124:44117: Network error: Client connection negotiation failed: client connection to 127.19.236.124:44117: connect: Connection refused (error 111)
I20260811 15:08:04.670817 13394 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.236.124" port: 44117 } attempt: 1
I20260811 15:08:04.671826 13397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:04.671455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.124:44117 (local address 127.0.0.1:59020)
0811 15:08:04.671647 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0811 15:08:04.671726 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.124:44117: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260811 15:08:04.672714 13397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:04.672447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.124:44117 (local address 127.0.0.1:59032)
0811 15:08:04.672590 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0811 15:08:04.672647 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.124:44117: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260811 15:08:04.672878 13394 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.236.124:44117: Network error: Client connection negotiation failed: client connection to 127.19.236.124:44117: connect: Connection refused (error 111)
I20260811 15:08:04.718252 13306 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.236.124" port: 44117 } attempt: 2
I20260811 15:08:04.719157 13308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:04.718839 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.124:44117 (local address 127.0.0.1:59044)
0811 15:08:04.719005 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0811 15:08:04.719076 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.124:44117: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260811 15:08:04.719897 13308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:04.719675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.124:44117 (local address 127.0.0.1:59052)
0811 15:08:04.719786 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0811 15:08:04.719837 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.124:44117: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260811 15:08:04.720034 13306 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.236.124:44117: Network error: Client connection negotiation failed: client connection to 127.19.236.124:44117: connect: Connection refused (error 111)
W20260811 15:08:04.729986 13400 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 15:08:04.730316 13400 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:08:04.730382 13400 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:08:04.730459 13400 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:08:04.734613 13400 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:08:04.734691 13400 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:08:04.734728 13400 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:08:04.734766 13400 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:08:04.734802 13400 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:08:04.740221 13400 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:39459
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460596631409-20401-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460596631409-20401-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.19.236.126:37551,127.19.236.125:37623,127.19.236.124:44117
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.124.keytab
--principal=kudu/127.19.236.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.124:44117
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460596631409-20401-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.19.236.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13400
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460596631409-20401-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:08:04.741031 13394 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.236.124" port: 44117 } attempt: 2
I20260811 15:08:04.741504 13400 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:08:04.741938 13397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:04.741626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.124:44117 (local address 127.0.0.1:59068)
0811 15:08:04.741781 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 15:08:04.741851 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.124:44117: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260811 15:08:04.742642 13400 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 15:08:04.742722 13397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:04.742489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.124:44117 (local address 127.0.0.1:59076)
0811 15:08:04.742612 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0811 15:08:04.742665 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.124:44117: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260811 15:08:04.742884 13394 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.236.124:44117: Network error: Client connection negotiation failed: client connection to 127.19.236.124:44117: connect: Connection refused (error 111)
W20260811 15:08:04.751442 13407 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:08:04.751435 13406 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:08:04.751442 13409 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:08:04.751855 13400 server_base.cc:1034] running on GCE node
I20260811 15:08:04.752537 13400 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:08:04.753841 13400 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:08:04.755038 13400 hybrid_clock.cc:648] HybridClock initialized: now 1786460884755028 us; error 33 us; skew 500 ppm
Aug 11 15:08:04 dist-test-slave-8n49 krb5kdc[13216](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460884, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:08:04.757887 13400 init.cc:377] Logged in from keytab as kudu/127.19.236.124@KRBTEST.COM (short username kudu)
I20260811 15:08:04.758741 13400 webserver.cc:460] Webserver started at http://127.19.236.124:41387/ using document root <none> and password file <none>
I20260811 15:08:04.759271 13400 fs_manager.cc:359] Metadata directory not provided
I20260811 15:08:04.759328 13400 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:08:04.759502 13400 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:08:04.761654 13400 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460596631409-20401-0/minicluster-data/master-2/data/instance:
uuid: "b02820df13c7475aa192f23cdf1e5284"
format_stamp: "Formatted at 2026-08-11 15:08:04 on dist-test-slave-8n49"
server_key: "953a33cb544626bbd0bc3db484cb3c03"
server_key_iv: "dcbafad1de6c4ae7e5db1e73be12cac1"
server_key_version: "encryptionkey@0"
I20260811 15:08:04.762177 13400 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460596631409-20401-0/minicluster-data/master-2/wal/instance:
uuid: "b02820df13c7475aa192f23cdf1e5284"
format_stamp: "Formatted at 2026-08-11 15:08:04 on dist-test-slave-8n49"
server_key: "953a33cb544626bbd0bc3db484cb3c03"
server_key_iv: "dcbafad1de6c4ae7e5db1e73be12cac1"
server_key_version: "encryptionkey@0"
I20260811 15:08:04.765923 13400 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 15:08:04.768393 13416 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:08:04.769708 13400 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 15:08:04.769856 13400 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460596631409-20401-0/minicluster-data/master-2/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460596631409-20401-0/minicluster-data/master-2/wal
uuid: "b02820df13c7475aa192f23cdf1e5284"
format_stamp: "Formatted at 2026-08-11 15:08:04 on dist-test-slave-8n49"
server_key: "953a33cb544626bbd0bc3db484cb3c03"
server_key_iv: "dcbafad1de6c4ae7e5db1e73be12cac1"
server_key_version: "encryptionkey@0"
I20260811 15:08:04.769989 13400 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460596631409-20401-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460596631409-20401-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460596631409-20401-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:08:04.794886 13400 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:08:04.798182 13400 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:08:04.798400 13400 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:08:04.805783 13400 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.124:44117
I20260811 15:08:04.806110 13474 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.124:44117 every 8 connection(s)
I20260811 15:08:04.806825 13400 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460596631409-20401-0/minicluster-data/master-2/data/info.pb
I20260811 15:08:04.809665 13478 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:08:04.810236 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 13400
I20260811 15:08:04.810375 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786460596631409-20401-0/minicluster-data/master-2/wal/instance
I20260811 15:08:04.810679 20401 external_mini_cluster.cc:1428] Setting key bf1019e17e6c0c91fa96179eaee11629
I20260811 15:08:04.815192 13478 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.236.126" port: 37551 } has no permanent_uuid. Determining permanent_uuid...
I20260811 15:08:04.819212 13306 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.236.124" port: 44117 } attempt: 3
Aug 11 15:08:04 dist-test-slave-8n49 krb5kdc[13216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460884, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.236.124@KRBTEST.COM
Aug 11 15:08:04 dist-test-slave-8n49 krb5kdc[13216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460884, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.124@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
Aug 11 15:08:04 dist-test-slave-8n49 krb5kdc[13216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460884, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.126@KRBTEST.COM for kudu/127.19.236.124@KRBTEST.COM
I20260811 15:08:04.827968 13311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:04.817274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44280 (local address 127.19.236.126:37551)
0811 15:08:04.817407 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0811 15:08:04.817414 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 15:08:04.817729 (+ 315us) server_negotiation.cc:407] Connection header received
0811 15:08:04.817944 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:08:04.817947 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:08:04.817995 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:08:04.818063 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:08:04.818981 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:08:04.819817 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:08:04.821255 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:08:04.821575 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:08:04.821685 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:08:04.824582 (+ 2897us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:08:04.824589 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:08:04.824595 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:08:04.824628 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:08:04.826066 (+ 1438us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:08:04.826657 (+ 591us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:08:04.826660 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:08:04.826662 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:08:04.826747 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:08:04.827071 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:08:04.827074 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:08:04.827075 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:08:04.827299 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:08:04.827380 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 15:08:04.827745 (+ 365us) server_negotiation.cc:299] Negotiation successful
0811 15:08:04.827840 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":44,"server-negotiator.queue_time_us":47}
I20260811 15:08:04.828143 13481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:04.812126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59086 (local address 127.19.236.124:44117)
0811 15:08:04.812594 (+ 468us) server_negotiation.cc:206] Beginning negotiation
0811 15:08:04.812613 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0811 15:08:04.812659 (+ 46us) server_negotiation.cc:407] Connection header received
0811 15:08:04.813485 (+ 826us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:08:04.813510 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:08:04.813948 (+ 438us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:08:04.814321 (+ 373us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:08:04.815018 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:08:04.816473 (+ 1455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:08:04.817723 (+ 1250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:08:04.818411 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:08:04.818574 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:08:04.821590 (+ 3016us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:08:04.821595 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:08:04.821605 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:08:04.821657 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:08:04.823955 (+ 2298us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:08:04.824905 (+ 950us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:08:04.824914 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:08:04.824923 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:08:04.825468 (+ 545us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:08:04.825800 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:08:04.825802 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:08:04.825803 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:08:04.826202 (+ 399us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:08:04.826431 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0811 15:08:04.826747 (+ 316us) server_negotiation.cc:299] Negotiation successful
0811 15:08:04.827079 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":288,"thread_start_us":115,"threads_started":1}
I20260811 15:08:04.828373 13482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:04.817205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:37551 (local address 127.0.0.1:44280)
0811 15:08:04.817591 (+ 386us) negotiation.cc:107] Waiting for socket to connect
0811 15:08:04.817631 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 15:08:04.817823 (+ 192us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:08:04.818134 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:08:04.818140 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:08:04.818637 (+ 497us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:08:04.818789 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:08:04.818795 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:08:04.820010 (+ 1215us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:08:04.820013 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:08:04.821121 (+ 1108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:08:04.821137 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:08:04.821783 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:08:04.821788 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:08:04.821943 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:08:04.822508 (+ 565us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:08:04.822527 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:08:04.824394 (+ 1867us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:08:04.826178 (+ 1784us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:08:04.826189 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:08:04.826197 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:08:04.826512 (+ 315us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:08:04.826863 (+ 351us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:08:04.826865 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:08:04.826867 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:08:04.826951 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:08:04.827407 (+ 456us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:08:04.827413 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:08:04.827533 (+ 120us) client_negotiation.cc:769] Sending connection context
0811 15:08:04.827682 (+ 149us) client_negotiation.cc:240] Negotiation successful
0811 15:08:04.827847 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":242,"thread_start_us":98,"threads_started":1}
I20260811 15:08:04.830271 13478 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.236.125" port: 37623 } has no permanent_uuid. Determining permanent_uuid...
I20260811 15:08:04.831619 13308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:04.819652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.124:44117 (local address 127.0.0.1:59100)
0811 15:08:04.819846 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0811 15:08:04.819871 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0811 15:08:04.819953 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:08:04.820289 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:08:04.820292 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:08:04.820480 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:08:04.820620 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:08:04.820627 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:08:04.821691 (+ 1064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:08:04.821694 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:08:04.822605 (+ 911us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:08:04.822617 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:08:04.823445 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:08:04.823449 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:08:04.823538 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:08:04.824037 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:08:04.824056 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:08:04.825487 (+ 1431us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:08:04.830026 (+ 4539us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:08:04.830032 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:08:04.830034 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:08:04.830238 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:08:04.830515 (+ 277us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:08:04.830518 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:08:04.830520 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:08:04.830608 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:08:04.831074 (+ 466us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:08:04.831078 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:08:04.831185 (+ 107us) client_negotiation.cc:769] Sending connection context
0811 15:08:04.831288 (+ 103us) client_negotiation.cc:240] Negotiation successful
0811 15:08:04.831439 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"mutex_wait_us":41}
I20260811 15:08:04.831753 13483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:04.819709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59100 (local address 127.19.236.124:44117)
0811 15:08:04.820094 (+ 385us) server_negotiation.cc:206] Beginning negotiation
0811 15:08:04.820102 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 15:08:04.820112 (+ 10us) server_negotiation.cc:407] Connection header received
0811 15:08:04.820140 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:08:04.820142 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:08:04.820174 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:08:04.820272 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:08:04.820731 (+ 459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:08:04.821569 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:08:04.822980 (+ 1411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:08:04.823307 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:08:04.823430 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:08:04.826228 (+ 2798us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:08:04.826232 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:08:04.826236 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:08:04.826263 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:08:04.829938 (+ 3675us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:08:04.830338 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:08:04.830343 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:08:04.830345 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:08:04.830433 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:08:04.830704 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:08:04.830708 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:08:04.830710 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:08:04.830940 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:08:04.831350 (+ 410us) server_negotiation.cc:1035] Waiting for connection context
0811 15:08:04.831424 (+ 74us) server_negotiation.cc:299] Negotiation successful
0811 15:08:04.831555 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":317,"thread_start_us":164,"threads_started":1}
I20260811 15:08:04.834614 13394 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.236.124" port: 44117 } attempt: 3
I20260811 15:08:04.834980 13306 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b7ce7c8be1c3491d8df338ee8b465b99: Bootstrap starting.
Aug 11 15:08:04 dist-test-slave-8n49 krb5kdc[13216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460884, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.124@KRBTEST.COM for kudu/127.19.236.125@KRBTEST.COM
Aug 11 15:08:04 dist-test-slave-8n49 krb5kdc[13216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460884, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
I20260811 15:08:04.837977 13306 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b7ce7c8be1c3491d8df338ee8b465b99: Neither blocks nor log segments found. Creating new log.
I20260811 15:08:04.839003 13306 log.cc:824] T 00000000000000000000000000000000 P b7ce7c8be1c3491d8df338ee8b465b99: Log is configured to *not* fsync() on all Append() calls
Aug 11 15:08:04 dist-test-slave-8n49 krb5kdc[13216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460884, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.125@KRBTEST.COM for kudu/127.19.236.124@KRBTEST.COM
I20260811 15:08:04.841742 13482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:04.830835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.125:37623 (local address 127.0.0.1:44724)
0811 15:08:04.831229 (+ 394us) negotiation.cc:107] Waiting for socket to connect
0811 15:08:04.831244 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 15:08:04.831365 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:08:04.831742 (+ 377us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:08:04.831746 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:08:04.831931 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:08:04.832060 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:08:04.832067 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:08:04.833078 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:08:04.833083 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:08:04.833915 (+ 832us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:08:04.833927 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:08:04.834569 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:08:04.834573 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:08:04.834673 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:08:04.835509 (+ 836us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:08:04.835524 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:08:04.837637 (+ 2113us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:08:04.839966 (+ 2329us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:08:04.839972 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:08:04.839974 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:08:04.840245 (+ 271us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:08:04.840597 (+ 352us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:08:04.840603 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:08:04.840608 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:08:04.840703 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:08:04.841238 (+ 535us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:08:04.841242 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:08:04.841336 (+ 94us) client_negotiation.cc:769] Sending connection context
0811 15:08:04.841445 (+ 109us) client_negotiation.cc:240] Negotiation successful
0811 15:08:04.841586 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":318}
I20260811 15:08:04.842154 13399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:04.830962 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44724 (local address 127.19.236.125:37623)
0811 15:08:04.831103 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0811 15:08:04.831108 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:08:04.831300 (+ 192us) server_negotiation.cc:407] Connection header received
0811 15:08:04.831479 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:08:04.831483 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:08:04.831534 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:08:04.831586 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:08:04.832199 (+ 613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:08:04.832963 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:08:04.834083 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:08:04.834415 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:08:04.834518 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:08:04.837800 (+ 3282us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:08:04.837807 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:08:04.837813 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:08:04.837845 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:08:04.839843 (+ 1998us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:08:04.840336 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:08:04.840341 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:08:04.840343 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:08:04.840461 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:08:04.840821 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:08:04.840828 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:08:04.840833 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:08:04.841084 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:08:04.841195 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0811 15:08:04.841523 (+ 328us) server_negotiation.cc:299] Negotiation successful
0811 15:08:04.841762 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 15:08:04.842360 13306 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b7ce7c8be1c3491d8df338ee8b465b99: No bootstrap required, opened a new log
I20260811 15:08:04.842859 13478 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.236.124" port: 44117 } has no permanent_uuid. Determining permanent_uuid...
I20260811 15:08:04.844242 13311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:04.831190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44286 (local address 127.19.236.126:37551)
0811 15:08:04.831308 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0811 15:08:04.831312 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:08:04.831325 (+ 13us) server_negotiation.cc:407] Connection header received
0811 15:08:04.831359 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:08:04.831365 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:08:04.831420 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:08:04.831491 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:08:04.832301 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:08:04.833047 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:08:04.834097 (+ 1050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:08:04.834329 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:08:04.834452 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:08:04.837816 (+ 3364us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:08:04.837820 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:08:04.837823 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:08:04.837850 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:08:04.840481 (+ 2631us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:08:04.842626 (+ 2145us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:08:04.842629 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:08:04.842632 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:08:04.842711 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:08:04.843141 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:08:04.843144 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:08:04.843146 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:08:04.843388 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:08:04.843562 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0811 15:08:04.843971 (+ 409us) server_negotiation.cc:299] Negotiation successful
0811 15:08:04.844097 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 15:08:04.846482 13397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:04.834984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.124:44117 (local address 127.0.0.1:59116)
0811 15:08:04.835149 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0811 15:08:04.835165 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 15:08:04.835247 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:08:04.836676 (+ 1429us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:08:04.836679 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:08:04.836862 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:08:04.836952 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:08:04.836958 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:08:04.838336 (+ 1378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:08:04.838340 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:08:04.839053 (+ 713us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:08:04.839067 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:08:04.839735 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:08:04.839741 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:08:04.839846 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:08:04.840323 (+ 477us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:08:04.840340 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:08:04.842260 (+ 1920us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:08:04.844489 (+ 2229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:08:04.844492 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:08:04.844494 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:08:04.844758 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:08:04.845445 (+ 687us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:08:04.845451 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:08:04.845456 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:08:04.845547 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:08:04.846006 (+ 459us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:08:04.846009 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:08:04.846111 (+ 102us) client_negotiation.cc:769] Sending connection context
0811 15:08:04.846200 (+ 89us) client_negotiation.cc:240] Negotiation successful
0811 15:08:04.846329 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":66}
I20260811 15:08:04.847148 13483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:04.835232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59116 (local address 127.19.236.124:44117)
0811 15:08:04.836459 (+ 1227us) server_negotiation.cc:206] Beginning negotiation
0811 15:08:04.836463 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:08:04.836473 (+ 10us) server_negotiation.cc:407] Connection header received
0811 15:08:04.836501 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:08:04.836503 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:08:04.836535 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:08:04.836652 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:08:04.837071 (+ 419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:08:04.838244 (+ 1173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:08:04.839196 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:08:04.839593 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:08:04.840081 (+ 488us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:08:04.842600 (+ 2519us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:08:04.842605 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:08:04.842609 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:08:04.842633 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:08:04.844364 (+ 1731us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:08:04.845130 (+ 766us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:08:04.845235 (+ 105us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:08:04.845237 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:08:04.845323 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:08:04.845669 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:08:04.845672 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:08:04.845673 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:08:04.845877 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:08:04.846769 (+ 892us) server_negotiation.cc:1035] Waiting for connection context
0811 15:08:04.846855 (+ 86us) server_negotiation.cc:299] Negotiation successful
0811 15:08:04.846976 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1159}
I20260811 15:08:04.847118 13306 raft_consensus.cc:348] T 00000000000000000000000000000000 P b7ce7c8be1c3491d8df338ee8b465b99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ce7c8be1c3491d8df338ee8b465b99" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 37551 } } peers { permanent_uuid: "8075c78272f24ae3a04233064aab3b07" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 37623 } } peers { permanent_uuid: "b02820df13c7475aa192f23cdf1e5284" member_type: VOTER last_known_addr { host: "127.19.236.124" port: 44117 } }
I20260811 15:08:04.847370 13306 raft_consensus.cc:729] T 00000000000000000000000000000000 P b7ce7c8be1c3491d8df338ee8b465b99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7ce7c8be1c3491d8df338ee8b465b99, State: Initialized, Role: FOLLOWER
I20260811 15:08:04.847723 13306 consensus_queue.cc:260] T 00000000000000000000000000000000 P b7ce7c8be1c3491d8df338ee8b465b99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ce7c8be1c3491d8df338ee8b465b99" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 37551 } } peers { permanent_uuid: "8075c78272f24ae3a04233064aab3b07" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 37623 } } peers { permanent_uuid: "b02820df13c7475aa192f23cdf1e5284" member_type: VOTER last_known_addr { host: "127.19.236.124" port: 44117 } }
I20260811 15:08:04.849378 13306 sys_catalog.cc:564] T 00000000000000000000000000000000 P b7ce7c8be1c3491d8df338ee8b465b99 [sys.catalog]: configured and running, proceeding with master startup.
Aug 11 15:08:04 dist-test-slave-8n49 krb5kdc[13216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460884, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.124@KRBTEST.COM for kudu/127.19.236.124@KRBTEST.COM
I20260811 15:08:04.850672 13394 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8075c78272f24ae3a04233064aab3b07: Bootstrap starting.
Aug 11 15:08:04 dist-test-slave-8n49 krb5kdc[13216](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460884, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.236.125@KRBTEST.COM
I20260811 15:08:04.854620 13481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:04.843393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59132 (local address 127.19.236.124:44117)
0811 15:08:04.843512 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0811 15:08:04.843515 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 15:08:04.844831 (+ 1316us) server_negotiation.cc:407] Connection header received
0811 15:08:04.844856 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:08:04.844859 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:08:04.844893 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:08:04.844950 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:08:04.845409 (+ 459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:08:04.846150 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:08:04.847685 (+ 1535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:08:04.848138 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:08:04.848234 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:08:04.850471 (+ 2237us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:08:04.850477 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:08:04.850482 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:08:04.850506 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:08:04.852719 (+ 2213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:08:04.853267 (+ 548us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:08:04.853273 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:08:04.853278 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:08:04.853362 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:08:04.853657 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:08:04.853661 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:08:04.853662 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:08:04.853952 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:08:04.854045 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0811 15:08:04.854320 (+ 275us) server_negotiation.cc:299] Negotiation successful
0811 15:08:04.854471 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":55,"server-negotiator.queue_time_us":56}
I20260811 15:08:04.855204 13482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:04.843356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.124:44117 (local address 127.0.0.1:59132)
0811 15:08:04.844661 (+ 1305us) negotiation.cc:107] Waiting for socket to connect
0811 15:08:04.844676 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 15:08:04.844758 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:08:04.845055 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:08:04.845058 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:08:04.845214 (+ 156us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:08:04.845295 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:08:04.845301 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:08:04.846265 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:08:04.846270 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:08:04.847567 (+ 1297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:08:04.847578 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:08:04.848326 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:08:04.848329 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:08:04.848394 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:08:04.848854 (+ 460us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:08:04.848867 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:08:04.850319 (+ 1452us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:08:04.852881 (+ 2562us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:08:04.852884 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:08:04.852886 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:08:04.853151 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:08:04.853462 (+ 311us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:08:04.853465 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:08:04.853467 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:08:04.853557 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:08:04.854080 (+ 523us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:08:04.854083 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:08:04.854166 (+ 83us) client_negotiation.cc:769] Sending connection context
0811 15:08:04.854275 (+ 109us) client_negotiation.cc:240] Negotiation successful
0811 15:08:04.854416 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1229}
I20260811 15:08:04.855333 13485 sys_catalog.cc:455] T 00000000000000000000000000000000 P b7ce7c8be1c3491d8df338ee8b465b99 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ce7c8be1c3491d8df338ee8b465b99" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 37551 } } peers { permanent_uuid: "8075c78272f24ae3a04233064aab3b07" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 37623 } } peers { permanent_uuid: "b02820df13c7475aa192f23cdf1e5284" member_type: VOTER last_known_addr { host: "127.19.236.124" port: 44117 } } }
I20260811 15:08:04.855819 13399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:04.845806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44740 (local address 127.19.236.125:37623)
0811 15:08:04.845902 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0811 15:08:04.845907 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:08:04.846172 (+ 265us) server_negotiation.cc:407] Connection header received
0811 15:08:04.846209 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:08:04.846212 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:08:04.846246 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:08:04.846310 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:08:04.847132 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:08:04.847792 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:08:04.848849 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:08:04.849149 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:08:04.849256 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:08:04.852076 (+ 2820us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:08:04.852079 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:08:04.852082 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:08:04.852110 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:08:04.853938 (+ 1828us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:08:04.854412 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:08:04.854415 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:08:04.854417 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:08:04.854501 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:08:04.854802 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:08:04.854806 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:08:04.854807 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:08:04.854997 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:08:04.855167 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0811 15:08:04.855559 (+ 392us) server_negotiation.cc:299] Negotiation successful
0811 15:08:04.855667 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 15:08:04.855454 13485 sys_catalog.cc:458] T 00000000000000000000000000000000 P b7ce7c8be1c3491d8df338ee8b465b99 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 15:08:04.858309 13478 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b02820df13c7475aa192f23cdf1e5284: Bootstrap starting.
I20260811 15:08:04.855227 13231 master_runner.cc:186] Error getting master registration for 127.19.236.125:37623: OK, instance_id { permanent_uuid: "8075c78272f24ae3a04233064aab3b07" instance_seqno: 1786460884575414 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 15:08:04.859297 13231 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260811 15:08:04.859413 13496 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b7ce7c8be1c3491d8df338ee8b465b99: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 15:08:04.859475 13496 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 15:08:04.859956 13394 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8075c78272f24ae3a04233064aab3b07: Neither blocks nor log segments found. Creating new log.
I20260811 15:08:04.860641 20401 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 15:08:04.860870 13478 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b02820df13c7475aa192f23cdf1e5284: Neither blocks nor log segments found. Creating new log.
I20260811 15:08:04.860903 13394 log.cc:824] T 00000000000000000000000000000000 P 8075c78272f24ae3a04233064aab3b07: Log is configured to *not* fsync() on all Append() calls
I20260811 15:08:04.861625 13478 log.cc:824] T 00000000000000000000000000000000 P b02820df13c7475aa192f23cdf1e5284: Log is configured to *not* fsync() on all Append() calls
I20260811 15:08:04.861979 13276 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "b7ce7c8be1c3491d8df338ee8b465b99"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44286
I20260811 15:08:04.862203 13276 raft_consensus.cc:482] T 00000000000000000000000000000000 P b7ce7c8be1c3491d8df338ee8b465b99 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 15:08:04.862315 13276 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b7ce7c8be1c3491d8df338ee8b465b99 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:08:04.863483 13478 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b02820df13c7475aa192f23cdf1e5284: No bootstrap required, opened a new log
I20260811 15:08:04.863615 13276 raft_consensus.cc:504] T 00000000000000000000000000000000 P b7ce7c8be1c3491d8df338ee8b465b99 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ce7c8be1c3491d8df338ee8b465b99" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 37551 } } peers { permanent_uuid: "8075c78272f24ae3a04233064aab3b07" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 37623 } } peers { permanent_uuid: "b02820df13c7475aa192f23cdf1e5284" member_type: VOTER last_known_addr { host: "127.19.236.124" port: 44117 } }
I20260811 15:08:04.864660 13276 leader_election.cc:288] T 00000000000000000000000000000000 P b7ce7c8be1c3491d8df338ee8b465b99 [CANDIDATE]: Term 1 election: Requested vote from peers 8075c78272f24ae3a04233064aab3b07 (127.19.236.125:37623), b02820df13c7475aa192f23cdf1e5284 (127.19.236.124:44117)
I20260811 15:08:04.868348 13394 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8075c78272f24ae3a04233064aab3b07: No bootstrap required, opened a new log
I20260811 15:08:04.868115 13478 raft_consensus.cc:348] T 00000000000000000000000000000000 P b02820df13c7475aa192f23cdf1e5284 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ce7c8be1c3491d8df338ee8b465b99" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 37551 } } peers { permanent_uuid: "8075c78272f24ae3a04233064aab3b07" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 37623 } } peers { permanent_uuid: "b02820df13c7475aa192f23cdf1e5284" member_type: VOTER last_known_addr { host: "127.19.236.124" port: 44117 } }
I20260811 15:08:04.868445 13478 raft_consensus.cc:729] T 00000000000000000000000000000000 P b02820df13c7475aa192f23cdf1e5284 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b02820df13c7475aa192f23cdf1e5284, State: Initialized, Role: FOLLOWER
I20260811 15:08:04.869010 13478 consensus_queue.cc:260] T 00000000000000000000000000000000 P b02820df13c7475aa192f23cdf1e5284 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ce7c8be1c3491d8df338ee8b465b99" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 37551 } } peers { permanent_uuid: "8075c78272f24ae3a04233064aab3b07" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 37623 } } peers { permanent_uuid: "b02820df13c7475aa192f23cdf1e5284" member_type: VOTER last_known_addr { host: "127.19.236.124" port: 44117 } }
I20260811 15:08:04.870522 13478 sys_catalog.cc:564] T 00000000000000000000000000000000 P b02820df13c7475aa192f23cdf1e5284 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:08:04.870601 13446 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b7ce7c8be1c3491d8df338ee8b465b99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b02820df13c7475aa192f23cdf1e5284"
I20260811 15:08:04.870812 13446 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b02820df13c7475aa192f23cdf1e5284 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:08:04.872354 13446 raft_consensus.cc:2454] T 00000000000000000000000000000000 P b02820df13c7475aa192f23cdf1e5284 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ce7c8be1c3491d8df338ee8b465b99 in term 1.
I20260811 15:08:04.872922 13251 leader_election.cc:302] T 00000000000000000000000000000000 P b7ce7c8be1c3491d8df338ee8b465b99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b02820df13c7475aa192f23cdf1e5284, b7ce7c8be1c3491d8df338ee8b465b99; no voters:
I20260811 15:08:04.873277 13485 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b7ce7c8be1c3491d8df338ee8b465b99 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:08:04.873498 13485 raft_consensus.cc:686] T 00000000000000000000000000000000 P b7ce7c8be1c3491d8df338ee8b465b99 [term 1 LEADER]: Becoming Leader. State: Replica: b7ce7c8be1c3491d8df338ee8b465b99, State: Running, Role: LEADER
I20260811 15:08:04.873862 13485 consensus_queue.cc:237] T 00000000000000000000000000000000 P b7ce7c8be1c3491d8df338ee8b465b99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ce7c8be1c3491d8df338ee8b465b99" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 37551 } } peers { permanent_uuid: "8075c78272f24ae3a04233064aab3b07" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 37623 } } peers { permanent_uuid: "b02820df13c7475aa192f23cdf1e5284" member_type: VOTER last_known_addr { host: "127.19.236.124" port: 44117 } }
I20260811 15:08:04.876062 13394 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8075c78272f24ae3a04233064aab3b07 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ce7c8be1c3491d8df338ee8b465b99" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 37551 } } peers { permanent_uuid: "8075c78272f24ae3a04233064aab3b07" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 37623 } } peers { permanent_uuid: "b02820df13c7475aa192f23cdf1e5284" member_type: VOTER last_known_addr { host: "127.19.236.124" port: 44117 } }
I20260811 15:08:04.876291 13394 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8075c78272f24ae3a04233064aab3b07 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8075c78272f24ae3a04233064aab3b07, State: Initialized, Role: FOLLOWER
I20260811 15:08:04.876641 13394 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8075c78272f24ae3a04233064aab3b07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ce7c8be1c3491d8df338ee8b465b99" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 37551 } } peers { permanent_uuid: "8075c78272f24ae3a04233064aab3b07" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 37623 } } peers { permanent_uuid: "b02820df13c7475aa192f23cdf1e5284" member_type: VOTER last_known_addr { host: "127.19.236.124" port: 44117 } }
I20260811 15:08:04.877234 13524 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8075c78272f24ae3a04233064aab3b07 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ce7c8be1c3491d8df338ee8b465b99" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 37551 } } peers { permanent_uuid: "8075c78272f24ae3a04233064aab3b07" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 37623 } } peers { permanent_uuid: "b02820df13c7475aa192f23cdf1e5284" member_type: VOTER last_known_addr { host: "127.19.236.124" port: 44117 } } }
I20260811 15:08:04.877429 13524 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8075c78272f24ae3a04233064aab3b07 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 15:08:04.878049 13394 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8075c78272f24ae3a04233064aab3b07 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:08:04.878150 13363 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b7ce7c8be1c3491d8df338ee8b465b99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "8075c78272f24ae3a04233064aab3b07"
I20260811 15:08:04.878393 13363 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8075c78272f24ae3a04233064aab3b07 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:08:04.879683 13363 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 8075c78272f24ae3a04233064aab3b07 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ce7c8be1c3491d8df338ee8b465b99 in term 1.
I20260811 15:08:04.880815 13505 sys_catalog.cc:455] T 00000000000000000000000000000000 P b02820df13c7475aa192f23cdf1e5284 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ce7c8be1c3491d8df338ee8b465b99" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 37551 } } peers { permanent_uuid: "8075c78272f24ae3a04233064aab3b07" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 37623 } } peers { permanent_uuid: "b02820df13c7475aa192f23cdf1e5284" member_type: VOTER last_known_addr { host: "127.19.236.124" port: 44117 } } }
I20260811 15:08:04.880800 13522 sys_catalog.cc:455] T 00000000000000000000000000000000 P b7ce7c8be1c3491d8df338ee8b465b99 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b7ce7c8be1c3491d8df338ee8b465b99. Latest consensus state: current_term: 1 leader_uuid: "b7ce7c8be1c3491d8df338ee8b465b99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ce7c8be1c3491d8df338ee8b465b99" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 37551 } } peers { permanent_uuid: "8075c78272f24ae3a04233064aab3b07" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 37623 } } peers { permanent_uuid: "b02820df13c7475aa192f23cdf1e5284" member_type: VOTER last_known_addr { host: "127.19.236.124" port: 44117 } } }
I20260811 15:08:04.880939 13522 sys_catalog.cc:458] T 00000000000000000000000000000000 P b7ce7c8be1c3491d8df338ee8b465b99 [sys.catalog]: This master's current role is: LEADER
I20260811 15:08:04.880950 13505 sys_catalog.cc:458] T 00000000000000000000000000000000 P b02820df13c7475aa192f23cdf1e5284 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 15:08:04.881378 13536 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:08:04.882726 13536 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 15:08:04.885128 13400 master_runner.cc:186] Error getting master registration for 127.19.236.125:37623: OK, instance_id { permanent_uuid: "8075c78272f24ae3a04233064aab3b07" instance_seqno: 1786460884575414 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 15:08:04.888087 13400 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 15:08:04.892882 13481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:04.881538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59140 (local address 127.19.236.124:44117)
0811 15:08:04.881652 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0811 15:08:04.881656 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:08:04.883178 (+ 1522us) server_negotiation.cc:407] Connection header received
0811 15:08:04.883364 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:08:04.883367 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:08:04.883418 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:08:04.883468 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:08:04.884502 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:08:04.885332 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:08:04.886521 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:08:04.886860 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:08:04.886975 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:08:04.889121 (+ 2146us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:08:04.889125 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:08:04.889128 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:08:04.889161 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:08:04.890868 (+ 1707us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:08:04.891359 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:08:04.891363 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:08:04.891365 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:08:04.891454 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:08:04.891805 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:08:04.891808 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:08:04.891810 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:08:04.892043 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:08:04.892159 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0811 15:08:04.892589 (+ 430us) server_negotiation.cc:299] Negotiation successful
0811 15:08:04.892716 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
W20260811 15:08:04.898352 13544 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 8075c78272f24ae3a04233064aab3b07: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 15:08:04.898439 13544 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 15:08:04.899720 13311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:04.882371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44288 (local address 127.19.236.126:37551)
0811 15:08:04.882471 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0811 15:08:04.882475 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:08:04.888566 (+ 6091us) server_negotiation.cc:407] Connection header received
0811 15:08:04.888740 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:08:04.888743 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:08:04.888795 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:08:04.888842 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:08:04.890355 (+ 1513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:08:04.891134 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:08:04.892263 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:08:04.892658 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:08:04.892732 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:08:04.895680 (+ 2948us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:08:04.895686 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:08:04.895689 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:08:04.895717 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:08:04.897476 (+ 1759us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:08:04.898040 (+ 564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:08:04.898044 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:08:04.898046 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:08:04.898137 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:08:04.898596 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:08:04.898603 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:08:04.898607 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:08:04.898859 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:08:04.898962 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0811 15:08:04.899389 (+ 427us) server_negotiation.cc:299] Negotiation successful
0811 15:08:04.899520 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
W20260811 15:08:04.901476 13521 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b02820df13c7475aa192f23cdf1e5284: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 15:08:04.901556 13521 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 15:08:04.901676 13446 raft_consensus.cc:1261] T 00000000000000000000000000000000 P b02820df13c7475aa192f23cdf1e5284 [term 1 FOLLOWER]: Refusing update from remote peer b7ce7c8be1c3491d8df338ee8b465b99: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:08:04.902449 13399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:04.882698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44746 (local address 127.19.236.125:37623)
0811 15:08:04.882833 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0811 15:08:04.882838 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:08:04.893362 (+ 10524us) server_negotiation.cc:407] Connection header received
0811 15:08:04.893651 (+ 289us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:08:04.893655 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:08:04.893701 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:08:04.893751 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:08:04.894615 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:08:04.895427 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:08:04.896680 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:08:04.897065 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:08:04.897146 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:08:04.898850 (+ 1704us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:08:04.898854 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:08:04.898856 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:08:04.898884 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:08:04.900629 (+ 1745us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:08:04.901116 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:08:04.901120 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:08:04.901122 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:08:04.901212 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:08:04.901501 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:08:04.901504 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:08:04.901506 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:08:04.901724 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:08:04.901881 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0811 15:08:04.902177 (+ 296us) server_negotiation.cc:299] Negotiation successful
0811 15:08:04.902283 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 15:08:04.902400 13522 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b7ce7c8be1c3491d8df338ee8b465b99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b02820df13c7475aa192f23cdf1e5284" member_type: VOTER last_known_addr { host: "127.19.236.124" port: 44117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:08:04.903999 13363 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 8075c78272f24ae3a04233064aab3b07 [term 1 FOLLOWER]: Refusing update from remote peer b7ce7c8be1c3491d8df338ee8b465b99: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:08:04.904590 13485 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b7ce7c8be1c3491d8df338ee8b465b99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8075c78272f24ae3a04233064aab3b07" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 37623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:08:04.906816 13505 sys_catalog.cc:455] T 00000000000000000000000000000000 P b02820df13c7475aa192f23cdf1e5284 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b7ce7c8be1c3491d8df338ee8b465b99. Latest consensus state: current_term: 1 leader_uuid: "b7ce7c8be1c3491d8df338ee8b465b99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ce7c8be1c3491d8df338ee8b465b99" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 37551 } } peers { permanent_uuid: "8075c78272f24ae3a04233064aab3b07" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 37623 } } peers { permanent_uuid: "b02820df13c7475aa192f23cdf1e5284" member_type: VOTER last_known_addr { host: "127.19.236.124" port: 44117 } } }
I20260811 15:08:04.906960 13505 sys_catalog.cc:458] T 00000000000000000000000000000000 P b02820df13c7475aa192f23cdf1e5284 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 15:08:04.907891 13524 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8075c78272f24ae3a04233064aab3b07 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b7ce7c8be1c3491d8df338ee8b465b99. Latest consensus state: current_term: 1 leader_uuid: "b7ce7c8be1c3491d8df338ee8b465b99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ce7c8be1c3491d8df338ee8b465b99" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 37551 } } peers { permanent_uuid: "8075c78272f24ae3a04233064aab3b07" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 37623 } } peers { permanent_uuid: "b02820df13c7475aa192f23cdf1e5284" member_type: VOTER last_known_addr { host: "127.19.236.124" port: 44117 } } }
I20260811 15:08:04.908001 13524 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8075c78272f24ae3a04233064aab3b07 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 15:08:04.910565 13522 sys_catalog.cc:455] T 00000000000000000000000000000000 P b7ce7c8be1c3491d8df338ee8b465b99 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b7ce7c8be1c3491d8df338ee8b465b99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ce7c8be1c3491d8df338ee8b465b99" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 37551 } } peers { permanent_uuid: "8075c78272f24ae3a04233064aab3b07" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 37623 } } peers { permanent_uuid: "b02820df13c7475aa192f23cdf1e5284" member_type: VOTER last_known_addr { host: "127.19.236.124" port: 44117 } } }
I20260811 15:08:04.910688 13522 sys_catalog.cc:458] T 00000000000000000000000000000000 P b7ce7c8be1c3491d8df338ee8b465b99 [sys.catalog]: This master's current role is: LEADER
I20260811 15:08:04.911631 13505 sys_catalog.cc:455] T 00000000000000000000000000000000 P b02820df13c7475aa192f23cdf1e5284 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b7ce7c8be1c3491d8df338ee8b465b99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ce7c8be1c3491d8df338ee8b465b99" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 37551 } } peers { permanent_uuid: "8075c78272f24ae3a04233064aab3b07" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 37623 } } peers { permanent_uuid: "b02820df13c7475aa192f23cdf1e5284" member_type: VOTER last_known_addr { host: "127.19.236.124" port: 44117 } } }
I20260811 15:08:04.911746 13505 sys_catalog.cc:458] T 00000000000000000000000000000000 P b02820df13c7475aa192f23cdf1e5284 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 15:08:04.911729 13548 mvcc.cc:205] Tried to move back new op lower bound from 7317343784543494144 to 7317343784447201280. Current Snapshot: MvccSnapshot[applied={T|T < 7317343784543494144}]
I20260811 15:08:04.912362 13536 catalog_manager.cc:1347] Generated new cluster ID: 9da695c2c07740838105aa4f975fcbd7
I20260811 15:08:04.912446 13536 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:08:04.917115 13485 sys_catalog.cc:455] T 00000000000000000000000000000000 P b7ce7c8be1c3491d8df338ee8b465b99 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b7ce7c8be1c3491d8df338ee8b465b99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ce7c8be1c3491d8df338ee8b465b99" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 37551 } } peers { permanent_uuid: "8075c78272f24ae3a04233064aab3b07" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 37623 } } peers { permanent_uuid: "b02820df13c7475aa192f23cdf1e5284" member_type: VOTER last_known_addr { host: "127.19.236.124" port: 44117 } } }
I20260811 15:08:04.917243 13485 sys_catalog.cc:458] T 00000000000000000000000000000000 P b7ce7c8be1c3491d8df338ee8b465b99 [sys.catalog]: This master's current role is: LEADER
I20260811 15:08:04.918386 13550 mvcc.cc:205] Tried to move back new op lower bound from 7317343784543494144 to 7317343784447201280. Current Snapshot: MvccSnapshot[applied={T|T < 7317343784543494144}]
I20260811 15:08:04.918465 13524 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8075c78272f24ae3a04233064aab3b07 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b7ce7c8be1c3491d8df338ee8b465b99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7ce7c8be1c3491d8df338ee8b465b99" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 37551 } } peers { permanent_uuid: "8075c78272f24ae3a04233064aab3b07" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 37623 } } peers { permanent_uuid: "b02820df13c7475aa192f23cdf1e5284" member_type: VOTER last_known_addr { host: "127.19.236.124" port: 44117 } } }
I20260811 15:08:04.918572 13524 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8075c78272f24ae3a04233064aab3b07 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 15:08:04.936257 13536 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 15:08:04.937696 13536 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:08:04.975603 13536 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b7ce7c8be1c3491d8df338ee8b465b99: Generated new TSK 0
I20260811 15:08:04.979033 13536 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 15:08:05.055413 13311 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:08:05.053125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44294 (local address 127.19.236.126:37551)
0811 15:08:05.053317 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0811 15:08:05.053323 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 15:08:05.054128 (+ 805us) server_negotiation.cc:407] Connection header received
0811 15:08:05.054377 (+ 249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:08:05.054382 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:08:05.054441 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:08:05.054504 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:08:05.055260 (+ 756us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44294: BlockingRecv error: recv got EOF from 127.0.0.1:44294 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
W20260811 15:08:05.056842 13481 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:08:05.053549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59150 (local address 127.19.236.124:44117)
0811 15:08:05.053674 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0811 15:08:05.053678 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:08:05.055811 (+ 2133us) server_negotiation.cc:407] Connection header received
0811 15:08:05.056025 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:08:05.056029 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:08:05.056084 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:08:05.056141 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:08:05.056715 (+ 574us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59150: BlockingRecv error: recv got EOF from 127.0.0.1:59150 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
W20260811 15:08:05.058085 13399 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:08:05.054197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44748 (local address 127.19.236.125:37623)
0811 15:08:05.054318 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0811 15:08:05.054322 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:08:05.057282 (+ 2960us) server_negotiation.cc:407] Connection header received
0811 15:08:05.057391 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:08:05.057394 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:08:05.057464 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:08:05.057561 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:08:05.057953 (+ 392us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44748: BlockingRecv error: recv got EOF from 127.0.0.1:44748 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
W20260811 15:08:05.080826 13399 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:08:05.072414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44758 (local address 127.19.236.125:37623)
0811 15:08:05.072592 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0811 15:08:05.072599 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 15:08:05.079346 (+ 6747us) server_negotiation.cc:407] Connection header received
0811 15:08:05.079723 (+ 377us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:08:05.079728 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:08:05.079828 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:08:05.079904 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:08:05.080693 (+ 789us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44758: BlockingRecv error: recv got EOF from 127.0.0.1:44758 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
W20260811 15:08:05.102964 13399 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:08:05.101508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44772 (local address 127.19.236.125:37623)
0811 15:08:05.101666 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0811 15:08:05.101674 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 15:08:05.102033 (+ 359us) server_negotiation.cc:407] Connection header received
0811 15:08:05.102194 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:08:05.102197 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:08:05.102264 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:08:05.102369 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:08:05.102828 (+ 459us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44772: BlockingRecv error: recv got EOF from 127.0.0.1:44772 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
W20260811 15:08:05.121227 13399 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:08:05.119544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44786 (local address 127.19.236.125:37623)
0811 15:08:05.119706 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0811 15:08:05.119711 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:08:05.120281 (+ 570us) server_negotiation.cc:407] Connection header received
0811 15:08:05.120436 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:08:05.120442 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:08:05.120510 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:08:05.120620 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:08:05.121096 (+ 476us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44786: BlockingRecv error: recv got EOF from 127.0.0.1:44786 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
W20260811 15:08:05.129073 13399 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:08:05.127347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44802 (local address 127.19.236.125:37623)
0811 15:08:05.127521 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0811 15:08:05.127528 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 15:08:05.127791 (+ 263us) server_negotiation.cc:407] Connection header received
0811 15:08:05.128023 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:08:05.128029 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:08:05.128094 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:08:05.128155 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:08:05.128908 (+ 753us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44802: BlockingRecv error: recv got EOF from 127.0.0.1:44802 (error 108)
Metrics: {"server-negotiator.queue_time_us":93}
W20260811 15:08:05.141114 13399 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:08:05.139762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44818 (local address 127.19.236.125:37623)
0811 15:08:05.139889 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0811 15:08:05.139895 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 15:08:05.140057 (+ 162us) server_negotiation.cc:407] Connection header received
0811 15:08:05.140236 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:08:05.140242 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:08:05.140310 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:08:05.140402 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:08:05.140963 (+ 561us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44818: BlockingRecv error: recv got EOF from 127.0.0.1:44818 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
W20260811 15:08:05.161180 13399 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:08:05.159860 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44830 (local address 127.19.236.125:37623)
0811 15:08:05.160027 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0811 15:08:05.160033 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 15:08:05.160215 (+ 182us) server_negotiation.cc:407] Connection header received
0811 15:08:05.160332 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:08:05.160337 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:08:05.160405 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:08:05.160509 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:08:05.161027 (+ 518us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44830: BlockingRecv error: recv got EOF from 127.0.0.1:44830 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
W20260811 15:08:05.196462 13399 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:08:05.195422 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44840 (local address 127.19.236.125:37623)
0811 15:08:05.195572 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0811 15:08:05.195576 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:08:05.195591 (+ 15us) server_negotiation.cc:407] Connection header received
0811 15:08:05.195760 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:08:05.195762 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:08:05.195819 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:08:05.195915 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:08:05.196352 (+ 437us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44840: BlockingRecv error: recv got EOF from 127.0.0.1:44840 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
W20260811 15:08:05.264142 13399 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:08:05.262825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44844 (local address 127.19.236.125:37623)
0811 15:08:05.262996 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0811 15:08:05.263002 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 15:08:05.263155 (+ 153us) server_negotiation.cc:407] Connection header received
0811 15:08:05.263345 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:08:05.263348 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:08:05.263399 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:08:05.263499 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:08:05.263988 (+ 489us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44844: BlockingRecv error: recv got EOF from 127.0.0.1:44844 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
W20260811 15:08:05.395793 13399 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:08:05.394542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44854 (local address 127.19.236.125:37623)
0811 15:08:05.394722 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0811 15:08:05.394726 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:08:05.394744 (+ 18us) server_negotiation.cc:407] Connection header received
0811 15:08:05.394938 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:08:05.394941 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:08:05.394998 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:08:05.395090 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:08:05.395661 (+ 571us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44854: BlockingRecv error: recv got EOF from 127.0.0.1:44854 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
W20260811 15:08:05.655542 13399 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:08:05.654249 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44868 (local address 127.19.236.125:37623)
0811 15:08:05.654413 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0811 15:08:05.654418 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:08:05.654534 (+ 116us) server_negotiation.cc:407] Connection header received
0811 15:08:05.654741 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:08:05.654744 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:08:05.654795 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:08:05.654890 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:08:05.655391 (+ 501us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44868: BlockingRecv error: recv got EOF from 127.0.0.1:44868 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
I20260811 15:08:05.899840 13544 catalog_manager.cc:1259] Loaded cluster ID: 9da695c2c07740838105aa4f975fcbd7
I20260811 15:08:05.899931 13544 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 8075c78272f24ae3a04233064aab3b07: loading cluster ID for follower catalog manager: success
I20260811 15:08:05.901716 13544 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 8075c78272f24ae3a04233064aab3b07: acquiring CA information for follower catalog manager: success
I20260811 15:08:05.902735 13521 catalog_manager.cc:1259] Loaded cluster ID: 9da695c2c07740838105aa4f975fcbd7
I20260811 15:08:05.902824 13521 catalog_manager.cc:1552] T 00000000000000000000000000000000 P b02820df13c7475aa192f23cdf1e5284: loading cluster ID for follower catalog manager: success
I20260811 15:08:05.902980 13544 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 8075c78272f24ae3a04233064aab3b07: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 15:08:05.904408 13521 catalog_manager.cc:1574] T 00000000000000000000000000000000 P b02820df13c7475aa192f23cdf1e5284: acquiring CA information for follower catalog manager: success
I20260811 15:08:05.905499 13521 catalog_manager.cc:1602] T 00000000000000000000000000000000 P b02820df13c7475aa192f23cdf1e5284: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 15:08:06.174126 13628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:06.169909 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44882 (local address 127.19.236.125:37623)
0811 15:08:06.170220 (+ 311us) server_negotiation.cc:206] Beginning negotiation
0811 15:08:06.170227 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 15:08:06.170245 (+ 18us) server_negotiation.cc:407] Connection header received
0811 15:08:06.170315 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:08:06.170317 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:08:06.170450 (+ 133us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:08:06.170579 (+ 129us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 15:08:06.170860 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:08:06.171450 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:08:06.172394 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:08:06.172700 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:08:06.172821 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:08:06.173197 (+ 376us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 15:08:06.173662 (+ 465us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 15:08:06.173808 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0811 15:08:06.173872 (+ 64us) server_negotiation.cc:299] Negotiation successful
0811 15:08:06.173932 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":223,"thread_start_us":70,"threads_started":1}
I20260811 15:08:06.181300 13637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:06.177291 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59160 (local address 127.19.236.124:44117)
0811 15:08:06.177581 (+ 290us) server_negotiation.cc:206] Beginning negotiation
0811 15:08:06.177587 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 15:08:06.177603 (+ 16us) server_negotiation.cc:407] Connection header received
0811 15:08:06.177691 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:08:06.177693 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:08:06.177804 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:08:06.177934 (+ 130us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 15:08:06.178197 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:08:06.178768 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:08:06.179743 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:08:06.179991 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:08:06.180113 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:08:06.180427 (+ 314us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 15:08:06.180864 (+ 437us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 15:08:06.181007 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0811 15:08:06.181076 (+ 69us) server_negotiation.cc:299] Negotiation successful
0811 15:08:06.181133 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":193,"thread_start_us":92,"threads_started":1}
I20260811 15:08:06.189049 13644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:06.184369 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44308 (local address 127.19.236.126:37551)
0811 15:08:06.185019 (+ 650us) server_negotiation.cc:206] Beginning negotiation
0811 15:08:06.185024 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:08:06.185038 (+ 14us) server_negotiation.cc:407] Connection header received
0811 15:08:06.185140 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:08:06.185146 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:08:06.185319 (+ 173us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:08:06.185460 (+ 141us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 15:08:06.185845 (+ 385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:08:06.186576 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:08:06.187488 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:08:06.187733 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:08:06.187851 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:08:06.188189 (+ 338us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 15:08:06.188575 (+ 386us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 15:08:06.188672 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0811 15:08:06.188778 (+ 106us) server_negotiation.cc:299] Negotiation successful
0811 15:08:06.188844 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":513,"thread_start_us":70,"threads_started":1}
I20260811 15:08:06.189276 13637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:06.184447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59170 (local address 127.19.236.124:44117)
0811 15:08:06.184601 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0811 15:08:06.184606 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:08:06.184835 (+ 229us) server_negotiation.cc:407] Connection header received
0811 15:08:06.185039 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:08:06.185042 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:08:06.185099 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:08:06.185178 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 15:08:06.185534 (+ 356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:08:06.186280 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:08:06.188033 (+ 1753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:08:06.188273 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:08:06.188396 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:08:06.188738 (+ 342us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 15:08:06.188824 (+ 86us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 15:08:06.188877 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 15:08:06.189085 (+ 208us) server_negotiation.cc:299] Negotiation successful
0811 15:08:06.189146 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 15:08:06.189321 13628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:06.184724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44884 (local address 127.19.236.125:37623)
0811 15:08:06.184851 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0811 15:08:06.184857 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 15:08:06.185125 (+ 268us) server_negotiation.cc:407] Connection header received
0811 15:08:06.185238 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:08:06.185241 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:08:06.185297 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:08:06.185379 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 15:08:06.185672 (+ 293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:08:06.186297 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:08:06.187981 (+ 1684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:08:06.188299 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:08:06.188397 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:08:06.188796 (+ 399us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 15:08:06.188873 (+ 77us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 15:08:06.188921 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 15:08:06.189136 (+ 215us) server_negotiation.cc:299] Negotiation successful
0811 15:08:06.189198 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 15:08:06.192698 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 13231
I20260811 15:08:06.204116 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 13316
I20260811 15:08:06.213001 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 13400
2026-08-11T15:08:06Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (3295 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460596631409-20401-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 15:08:06 dist-test-slave-8n49 krb5kdc[13648](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 15:08:06 dist-test-slave-8n49 krb5kdc[13648](info): set up 2 sockets
Aug 11 15:08:06 dist-test-slave-8n49 krb5kdc[13648](info): commencing operation
krb5kdc: starting...
W20260811 15:08:07.331169 20401 mini_kdc.cc:121] Time spent starting KDC: real 1.094s user 0.007s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460596631409-20401-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460596631409-20401-0/krb5kdc/test-user.keytab.
Aug 11 15:08:07 dist-test-slave-8n49 krb5kdc[13648](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460887, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T15:08:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T15:08:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.236.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.236.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.236.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab.
Entry for principal kudu/127.19.236.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab.
I20260811 15:08:07.467269 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460596631409-20401-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460596631409-20401-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460596631409-20401-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:37115
--webserver_interface=127.19.236.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab
--principal=kudu/127.19.236.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:37497
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.236.126:37115,127.19.236.125:40903,127.19.236.124:39087
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 15:08:07.579375 13663 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 15:08:07.579702 13663 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:08:07.579780 13663 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:08:07.579862 13663 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:08:07.583854 13663 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:08:07.583938 13663 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:08:07.583977 13663 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:08:07.584038 13663 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:08:07.584086 13663 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:08:07.589318 13663 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:37497
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460596631409-20401-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460596631409-20401-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.236.126:37115,127.19.236.125:40903,127.19.236.124:39087
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.126.keytab
--principal=kudu/127.19.236.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.126:37115
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.236.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13663
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460596631409-20401-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:08:07.590368 13663 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:08:07.591408 13663 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:08:07.599900 13668 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:08:07.599900 13671 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:08:07.599938 13669 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:08:07.600368 13663 server_base.cc:1034] running on GCE node
I20260811 15:08:07.600970 13663 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:08:07.602044 13663 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:08:07.603216 13663 hybrid_clock.cc:648] HybridClock initialized: now 1786460887603198 us; error 31 us; skew 500 ppm
Aug 11 15:08:07 dist-test-slave-8n49 krb5kdc[13648](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460887, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:08:07.605981 13663 init.cc:377] Logged in from keytab as kudu/127.19.236.126@KRBTEST.COM (short username kudu)
I20260811 15:08:07.606876 13663 webserver.cc:460] Webserver started at http://127.19.236.126:34763/ using document root <none> and password file <none>
I20260811 15:08:07.607438 13663 fs_manager.cc:359] Metadata directory not provided
I20260811 15:08:07.607528 13663 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:08:07.607767 13663 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:08:07.609875 13663 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460596631409-20401-0/minicluster-data/master-0/data/instance:
uuid: "e64c7f4017a149398ab7159001333b2f"
format_stamp: "Formatted at 2026-08-11 15:08:07 on dist-test-slave-8n49"
server_key: "2568b4b97d55d8119a321e758fbbceee"
server_key_iv: "13569f83b08192e98bc62ad15d13eadc"
server_key_version: "encryptionkey@0"
I20260811 15:08:07.610440 13663 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460596631409-20401-0/minicluster-data/master-0/wal/instance:
uuid: "e64c7f4017a149398ab7159001333b2f"
format_stamp: "Formatted at 2026-08-11 15:08:07 on dist-test-slave-8n49"
server_key: "2568b4b97d55d8119a321e758fbbceee"
server_key_iv: "13569f83b08192e98bc62ad15d13eadc"
server_key_version: "encryptionkey@0"
I20260811 15:08:07.614152 13663 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260811 15:08:07.616657 13679 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:08:07.617862 13663 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 15:08:07.618000 13663 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460596631409-20401-0/minicluster-data/master-0/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460596631409-20401-0/minicluster-data/master-0/wal
uuid: "e64c7f4017a149398ab7159001333b2f"
format_stamp: "Formatted at 2026-08-11 15:08:07 on dist-test-slave-8n49"
server_key: "2568b4b97d55d8119a321e758fbbceee"
server_key_iv: "13569f83b08192e98bc62ad15d13eadc"
server_key_version: "encryptionkey@0"
I20260811 15:08:07.618109 13663 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460596631409-20401-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460596631409-20401-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460596631409-20401-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:08:07.630396 13663 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:08:07.633337 13663 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:08:07.633543 13663 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:08:07.640949 13663 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.126:37115
I20260811 15:08:07.641244 13737 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.126:37115 every 8 connection(s)
I20260811 15:08:07.641983 13663 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460596631409-20401-0/minicluster-data/master-0/data/info.pb
I20260811 15:08:07.644522 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 13663
I20260811 15:08:07.644675 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460596631409-20401-0/minicluster-data/master-0/wal/instance
I20260811 15:08:07.644802 13738 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:08:07.644999 20401 external_mini_cluster.cc:1428] Setting key 0f429e93577ff23bb018345fa591e4c4
I20260811 15:08:07.648726 13738 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.236.126" port: 37115 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.19.236.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.236.125@KRBTEST.COM" created.
Aug 11 15:08:07 dist-test-slave-8n49 krb5kdc[13648](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460887, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.126@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
I20260811 15:08:07.664127 13744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:07.651025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:37115 (local address 127.0.0.1:40554)
0811 15:08:07.651588 (+ 563us) negotiation.cc:107] Waiting for socket to connect
0811 15:08:07.651623 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 15:08:07.652461 (+ 838us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:08:07.653160 (+ 699us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:08:07.653165 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:08:07.653600 (+ 435us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:08:07.653836 (+ 236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:08:07.653848 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:08:07.655075 (+ 1227us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:08:07.655078 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:08:07.655782 (+ 704us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:08:07.655790 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:08:07.656438 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:08:07.656443 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:08:07.656616 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:08:07.657241 (+ 625us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:08:07.657258 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:08:07.658998 (+ 1740us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:08:07.661138 (+ 2140us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:08:07.661148 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:08:07.661159 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:08:07.661384 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:08:07.661723 (+ 339us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:08:07.661727 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:08:07.661729 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:08:07.661843 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:08:07.662421 (+ 578us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:08:07.662427 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:08:07.662574 (+ 147us) client_negotiation.cc:769] Sending connection context
0811 15:08:07.662742 (+ 168us) client_negotiation.cc:240] Negotiation successful
0811 15:08:07.663130 (+ 388us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":403,"mutex_wait_us":110,"spinlock_wait_cycles":768,"thread_start_us":152,"threads_started":1}
I20260811 15:08:07.664127 13743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:07.651024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40554 (local address 127.19.236.126:37115)
0811 15:08:07.651441 (+ 417us) server_negotiation.cc:206] Beginning negotiation
0811 15:08:07.651459 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 15:08:07.651729 (+ 270us) server_negotiation.cc:407] Connection header received
0811 15:08:07.652781 (+ 1052us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:08:07.652785 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:08:07.652976 (+ 191us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:08:07.653161 (+ 185us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:08:07.653984 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:08:07.654944 (+ 960us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:08:07.655912 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:08:07.656273 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:08:07.656444 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:08:07.659176 (+ 2732us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:08:07.659184 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:08:07.659195 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:08:07.659228 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:08:07.661012 (+ 1784us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:08:07.661500 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:08:07.661506 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:08:07.661508 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:08:07.661620 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:08:07.661941 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:08:07.661946 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:08:07.661948 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:08:07.662305 (+ 357us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:08:07.662457 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0811 15:08:07.662805 (+ 348us) server_negotiation.cc:299] Negotiation successful
0811 15:08:07.663077 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":81,"server-negotiator.queue_time_us":269,"thread_start_us":141,"threads_started":1}
I20260811 15:08:07.666761 13738 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.236.125" port: 40903 } has no permanent_uuid. Determining permanent_uuid...
I20260811 15:08:07.667544 13744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:07.667255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.125:40903 (local address 127.0.0.1:47570)
0811 15:08:07.667396 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0811 15:08:07.667476 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.125:40903: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260811 15:08:07.667744 13683 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.236.125:40903: connect: Connection refused (error 111)
I20260811 15:08:07.668716 13744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:07.668395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.125:40903 (local address 127.0.0.1:47572)
0811 15:08:07.668527 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0811 15:08:07.668628 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.125:40903: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
W20260811 15:08:07.668865 13738 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.236.125:40903: Network error: Client connection negotiation failed: client connection to 127.19.236.125:40903: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.236.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.125.keytab.
Entry for principal kudu/127.19.236.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.125.keytab.
I20260811 15:08:07.675056 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460596631409-20401-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460596631409-20401-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460596631409-20401-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460596631409-20401-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.125:40903
--webserver_interface=127.19.236.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.125.keytab
--principal=kudu/127.19.236.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:37497
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.236.126:37115,127.19.236.125:40903,127.19.236.124:39087
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 15:08:07.718134 13738 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.236.125" port: 40903 } attempt: 1
I20260811 15:08:07.719210 13744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:07.718868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.125:40903 (local address 127.0.0.1:47582)
0811 15:08:07.719054 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0811 15:08:07.719125 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.125:40903: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260811 15:08:07.720139 13744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:07.719857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.125:40903 (local address 127.0.0.1:47584)
0811 15:08:07.720014 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0811 15:08:07.720075 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.125:40903: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84}
W20260811 15:08:07.720335 13738 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.236.125:40903: Network error: Client connection negotiation failed: client connection to 127.19.236.125:40903: connect: Connection refused (error 111)
I20260811 15:08:07.788563 13738 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.236.125" port: 40903 } attempt: 2
W20260811 15:08:07.788769 13747 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 15:08:07.789167 13747 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:08:07.789218 13747 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:08:07.789273 13747 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260811 15:08:07.789623 13744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:07.789281 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.125:40903 (local address 127.0.0.1:47590)
0811 15:08:07.789458 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0811 15:08:07.789528 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.125:40903: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260811 15:08:07.790454 13744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:07.790214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.125:40903 (local address 127.0.0.1:47600)
0811 15:08:07.790345 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0811 15:08:07.790395 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.125:40903: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260811 15:08:07.790656 13738 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.236.125:40903: Network error: Client connection negotiation failed: client connection to 127.19.236.125:40903: connect: Connection refused (error 111)
W20260811 15:08:07.793751 13747 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:08:07.793805 13747 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:08:07.793825 13747 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:08:07.793879 13747 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:08:07.793913 13747 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:08:07.799180 13747 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:37497
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460596631409-20401-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460596631409-20401-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.19.236.126:37115,127.19.236.125:40903,127.19.236.124:39087
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.125.keytab
--principal=kudu/127.19.236.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.125:40903
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460596631409-20401-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.19.236.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13747
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460596631409-20401-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:08:07.800195 13747 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:08:07.801256 13747 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:08:07.809957 13752 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:08:07.810000 13755 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:08:07.809995 13753 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:08:07.810178 13747 server_base.cc:1034] running on GCE node
I20260811 15:08:07.810997 13747 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:08:07.812170 13747 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:08:07.813359 13747 hybrid_clock.cc:648] HybridClock initialized: now 1786460887813325 us; error 47 us; skew 500 ppm
Aug 11 15:08:07 dist-test-slave-8n49 krb5kdc[13648](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460887, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:08:07.816120 13747 init.cc:377] Logged in from keytab as kudu/127.19.236.125@KRBTEST.COM (short username kudu)
I20260811 15:08:07.817116 13747 webserver.cc:460] Webserver started at http://127.19.236.125:34805/ using document root <none> and password file <none>
I20260811 15:08:07.817682 13747 fs_manager.cc:359] Metadata directory not provided
I20260811 15:08:07.817778 13747 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:08:07.818018 13747 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:08:07.820051 13747 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460596631409-20401-0/minicluster-data/master-1/data/instance:
uuid: "5d5354c53a3a4c48844756c1fee55af3"
format_stamp: "Formatted at 2026-08-11 15:08:07 on dist-test-slave-8n49"
server_key: "9ce0d282e37464d52c8f0ae74d599504"
server_key_iv: "bbc243f4dbac9432d26198b9a0be913b"
server_key_version: "encryptionkey@0"
I20260811 15:08:07.820694 13747 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460596631409-20401-0/minicluster-data/master-1/wal/instance:
uuid: "5d5354c53a3a4c48844756c1fee55af3"
format_stamp: "Formatted at 2026-08-11 15:08:07 on dist-test-slave-8n49"
server_key: "9ce0d282e37464d52c8f0ae74d599504"
server_key_iv: "bbc243f4dbac9432d26198b9a0be913b"
server_key_version: "encryptionkey@0"
I20260811 15:08:07.824673 13747 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260811 15:08:07.827111 13763 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:08:07.828297 13747 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 15:08:07.828472 13747 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460596631409-20401-0/minicluster-data/master-1/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460596631409-20401-0/minicluster-data/master-1/wal
uuid: "5d5354c53a3a4c48844756c1fee55af3"
format_stamp: "Formatted at 2026-08-11 15:08:07 on dist-test-slave-8n49"
server_key: "9ce0d282e37464d52c8f0ae74d599504"
server_key_iv: "bbc243f4dbac9432d26198b9a0be913b"
server_key_version: "encryptionkey@0"
I20260811 15:08:07.828615 13747 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460596631409-20401-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460596631409-20401-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460596631409-20401-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:08:07.847183 13747 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:08:07.850613 13747 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:08:07.850829 13747 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:08:07.857996 13747 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.125:40903
I20260811 15:08:07.858280 13821 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.125:40903 every 8 connection(s)
I20260811 15:08:07.859010 13747 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460596631409-20401-0/minicluster-data/master-1/data/info.pb
I20260811 15:08:07.861991 13823 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:08:07.862056 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 13747
I20260811 15:08:07.862169 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460596631409-20401-0/minicluster-data/master-1/wal/instance
I20260811 15:08:07.862529 20401 external_mini_cluster.cc:1428] Setting key b6caf8a8c95e4eff06a520cd6773bf2e
I20260811 15:08:07.866506 13823 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.236.126" port: 37115 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.19.236.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.236.124@KRBTEST.COM" created.
Aug 11 15:08:07 dist-test-slave-8n49 krb5kdc[13648](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460887, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.125@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
I20260811 15:08:07.881831 13738 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.236.125" port: 40903 } attempt: 3
I20260811 15:08:07.882019 13743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:07.868655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40556 (local address 127.19.236.126:37115)
0811 15:08:07.868801 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0811 15:08:07.868805 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:08:07.869889 (+ 1084us) server_negotiation.cc:407] Connection header received
0811 15:08:07.870844 (+ 955us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:08:07.870847 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:08:07.870916 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:08:07.871022 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:08:07.872226 (+ 1204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:08:07.873062 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:08:07.874393 (+ 1331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:08:07.874842 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:08:07.874938 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:08:07.877844 (+ 2906us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:08:07.877850 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:08:07.877856 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:08:07.877893 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:08:07.879651 (+ 1758us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:08:07.880175 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:08:07.880181 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:08:07.880186 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:08:07.880285 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:08:07.880666 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:08:07.880671 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:08:07.880676 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:08:07.880958 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:08:07.881075 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0811 15:08:07.881629 (+ 554us) server_negotiation.cc:299] Negotiation successful
0811 15:08:07.881772 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 15:08:07.882910 13826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:07.869175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:37115 (local address 127.0.0.1:40556)
0811 15:08:07.869728 (+ 553us) negotiation.cc:107] Waiting for socket to connect
0811 15:08:07.869771 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 15:08:07.870632 (+ 861us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:08:07.871202 (+ 570us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:08:07.871209 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:08:07.871597 (+ 388us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:08:07.872069 (+ 472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:08:07.872083 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:08:07.873229 (+ 1146us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:08:07.873233 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:08:07.874221 (+ 988us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:08:07.874232 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:08:07.875016 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:08:07.875023 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:08:07.875267 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:08:07.875942 (+ 675us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:08:07.875970 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:08:07.877668 (+ 1698us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:08:07.879775 (+ 2107us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:08:07.879781 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:08:07.879794 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:08:07.880065 (+ 271us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:08:07.880390 (+ 325us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:08:07.880392 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:08:07.880394 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:08:07.880534 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:08:07.881080 (+ 546us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:08:07.881086 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:08:07.881335 (+ 249us) client_negotiation.cc:769] Sending connection context
0811 15:08:07.881498 (+ 163us) client_negotiation.cc:240] Negotiation successful
0811 15:08:07.881757 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":359,"thread_start_us":171,"threads_started":1}
I20260811 15:08:07.884788 13823 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.236.125" port: 40903 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 15:08:07 dist-test-slave-8n49 krb5kdc[13648](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460887, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.126@KRBTEST.COM for kudu/127.19.236.125@KRBTEST.COM
Aug 11 15:08:07 dist-test-slave-8n49 krb5kdc[13648](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460887, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.125@KRBTEST.COM for kudu/127.19.236.125@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.236.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.124.keytab.
Entry for principal kudu/127.19.236.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.124.keytab.
I20260811 15:08:07.893119 13744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:07.882290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.125:40903 (local address 127.0.0.1:47614)
0811 15:08:07.882447 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0811 15:08:07.882466 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 15:08:07.882551 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:08:07.883402 (+ 851us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:08:07.883405 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:08:07.883593 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:08:07.884188 (+ 595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:08:07.884198 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:08:07.885443 (+ 1245us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:08:07.885446 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:08:07.886163 (+ 717us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:08:07.886173 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:08:07.886829 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:08:07.886832 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:08:07.886941 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:08:07.887461 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:08:07.887475 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:08:07.888906 (+ 1431us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:08:07.891238 (+ 2332us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:08:07.891243 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:08:07.891247 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:08:07.891451 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:08:07.891760 (+ 309us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:08:07.891763 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:08:07.891765 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:08:07.891859 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:08:07.892524 (+ 665us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:08:07.892527 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:08:07.892678 (+ 151us) client_negotiation.cc:769] Sending connection context
0811 15:08:07.892801 (+ 123us) client_negotiation.cc:240] Negotiation successful
0811 15:08:07.892942 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":62}
I20260811 15:08:07.893313 13828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:07.882599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47614 (local address 127.19.236.125:40903)
0811 15:08:07.882936 (+ 337us) server_negotiation.cc:206] Beginning negotiation
0811 15:08:07.882949 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 15:08:07.882973 (+ 24us) server_negotiation.cc:407] Connection header received
0811 15:08:07.883021 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:08:07.883028 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:08:07.883246 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:08:07.883404 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:08:07.884310 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:08:07.885324 (+ 1014us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:08:07.886276 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:08:07.886729 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:08:07.886812 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:08:07.889038 (+ 2226us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:08:07.889048 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:08:07.889062 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:08:07.889097 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:08:07.891098 (+ 2001us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:08:07.891572 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:08:07.891581 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:08:07.891583 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:08:07.891662 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:08:07.891974 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:08:07.891977 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:08:07.891979 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:08:07.892399 (+ 420us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:08:07.892561 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0811 15:08:07.892923 (+ 362us) server_negotiation.cc:299] Negotiation successful
0811 15:08:07.893090 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":221,"spinlock_wait_cycles":15232,"thread_start_us":98,"threads_started":1}
I20260811 15:08:07.894220 20401 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
/tmp/dist-test-taskAUi0lq/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460596631409-20401-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460596631409-20401-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460596631409-20401-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460596631409-20401-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.124:39087
--webserver_interface=127.19.236.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.124.keytab
--principal=kudu/127.19.236.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.236.84:37497
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.236.126:37115,127.19.236.125:40903,127.19.236.124:39087
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460596631409-20401-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460596631409-20401-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460596631409-20401-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 15:08:07.894726 13826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:07.885295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.125:40903 (local address 127.0.0.1:47620)
0811 15:08:07.885397 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0811 15:08:07.885413 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 15:08:07.885481 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:08:07.885957 (+ 476us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:08:07.885960 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:08:07.886140 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:08:07.886243 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:08:07.886253 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:08:07.887272 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:08:07.887278 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:08:07.887850 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:08:07.887860 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:08:07.888473 (+ 613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:08:07.888480 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:08:07.888625 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:08:07.889124 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:08:07.889139 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:08:07.890487 (+ 1348us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:08:07.893047 (+ 2560us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:08:07.893050 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:08:07.893052 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:08:07.893314 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:08:07.893622 (+ 308us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:08:07.893625 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:08:07.893628 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:08:07.893703 (+ 75us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:08:07.894153 (+ 450us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:08:07.894157 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:08:07.894244 (+ 87us) client_negotiation.cc:769] Sending connection context
0811 15:08:07.894353 (+ 109us) client_negotiation.cc:240] Negotiation successful
0811 15:08:07.894496 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":24}
I20260811 15:08:07.895340 13830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:07.885437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47620 (local address 127.19.236.125:40903)
0811 15:08:07.885762 (+ 325us) server_negotiation.cc:206] Beginning negotiation
0811 15:08:07.885771 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 15:08:07.885790 (+ 19us) server_negotiation.cc:407] Connection header received
0811 15:08:07.885817 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:08:07.885819 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:08:07.885852 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:08:07.885948 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:08:07.886357 (+ 409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:08:07.887155 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:08:07.888003 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:08:07.888356 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:08:07.888436 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:08:07.890649 (+ 2213us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:08:07.890653 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:08:07.890655 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:08:07.890684 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:08:07.892872 (+ 2188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:08:07.893425 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:08:07.893430 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:08:07.893435 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:08:07.893517 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:08:07.893791 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:08:07.893794 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:08:07.893795 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:08:07.894011 (+ 216us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:08:07.894109 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0811 15:08:07.894929 (+ 820us) server_negotiation.cc:299] Negotiation successful
0811 15:08:07.895069 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":227,"thread_start_us":102,"threads_started":1}
I20260811 15:08:07.895473 13738 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.236.124" port: 39087 } has no permanent_uuid. Determining permanent_uuid...
I20260811 15:08:07.895967 13823 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.236.124" port: 39087 } has no permanent_uuid. Determining permanent_uuid...
I20260811 15:08:07.896660 13744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:07.895918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.124:39087 (local address 127.0.0.1:41428)
0811 15:08:07.896509 (+ 591us) negotiation.cc:107] Waiting for socket to connect
0811 15:08:07.896587 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.124:39087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":488}
I20260811 15:08:07.896674 13826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:07.896400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.124:39087 (local address 127.0.0.1:41430)
0811 15:08:07.896516 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0811 15:08:07.896617 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.124:39087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260811 15:08:07.896873 13767 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.236.124:39087: connect: Connection refused (error 111)
I20260811 15:08:07.897485 13744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:07.897243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.124:39087 (local address 127.0.0.1:41432)
0811 15:08:07.897380 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0811 15:08:07.897433 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.124:39087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
W20260811 15:08:07.897620 13738 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.236.124:39087: Network error: Client connection negotiation failed: client connection to 127.19.236.124:39087: connect: Connection refused (error 111)
I20260811 15:08:07.897941 13826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:07.897753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.124:39087 (local address 127.0.0.1:41436)
0811 15:08:07.897855 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0811 15:08:07.897896 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.124:39087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260811 15:08:07.898120 13823 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.236.124:39087: Network error: Client connection negotiation failed: client connection to 127.19.236.124:39087: connect: Connection refused (error 111)
I20260811 15:08:07.928766 13738 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.236.124" port: 39087 } attempt: 1
I20260811 15:08:07.929627 13744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:07.929324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.124:39087 (local address 127.0.0.1:41446)
0811 15:08:07.929479 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 15:08:07.929548 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.124:39087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260811 15:08:07.930351 13744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:07.930131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.124:39087 (local address 127.0.0.1:41452)
0811 15:08:07.930242 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0811 15:08:07.930294 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.124:39087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260811 15:08:07.930495 13738 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.236.124:39087: Network error: Client connection negotiation failed: client connection to 127.19.236.124:39087: connect: Connection refused (error 111)
I20260811 15:08:07.947368 13823 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.236.124" port: 39087 } attempt: 1
I20260811 15:08:07.948333 13826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:07.947971 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.124:39087 (local address 127.0.0.1:41458)
0811 15:08:07.948155 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0811 15:08:07.948232 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.124:39087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260811 15:08:07.949216 13826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:07.948985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.124:39087 (local address 127.0.0.1:41464)
0811 15:08:07.949096 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0811 15:08:07.949149 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.124:39087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260811 15:08:07.949405 13823 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.236.124:39087: Network error: Client connection negotiation failed: client connection to 127.19.236.124:39087: connect: Connection refused (error 111)
I20260811 15:08:08.005679 13738 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.236.124" port: 39087 } attempt: 2
I20260811 15:08:08.006603 13744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:08.006272 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.124:39087 (local address 127.0.0.1:41468)
0811 15:08:08.006445 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0811 15:08:08.006520 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.124:39087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260811 15:08:08.007485 13744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:08.007203 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.124:39087 (local address 127.0.0.1:41470)
0811 15:08:08.007361 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0811 15:08:08.007410 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.124:39087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
W20260811 15:08:08.007680 13738 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.236.124:39087: Network error: Client connection negotiation failed: client connection to 127.19.236.124:39087: connect: Connection refused (error 111)
W20260811 15:08:08.010464 13831 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 15:08:08.010807 13831 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 15:08:08.010854 13831 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 15:08:08.010919 13831 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 15:08:08.014995 13831 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 15:08:08.015045 13831 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 15:08:08.015064 13831 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 15:08:08.015081 13831 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 15:08:08.015136 13831 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 15:08:08.017601 13823 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.236.124" port: 39087 } attempt: 2
I20260811 15:08:08.018375 13826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:08.018079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.124:39087 (local address 127.0.0.1:41486)
0811 15:08:08.018232 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0811 15:08:08.018294 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.124:39087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260811 15:08:08.019119 13826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:08.018895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.124:39087 (local address 127.0.0.1:41500)
0811 15:08:08.019009 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0811 15:08:08.019059 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.236.124:39087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260811 15:08:08.019269 13823 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.236.124:39087: Network error: Client connection negotiation failed: client connection to 127.19.236.124:39087: connect: Connection refused (error 111)
I20260811 15:08:08.021018 13831 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.236.84:37497
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460596631409-20401-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460596631409-20401-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.19.236.126:37115,127.19.236.125:40903,127.19.236.124:39087
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460596631409-20401-0/krb5kdc/kudu_127.19.236.124.keytab
--principal=kudu/127.19.236.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.236.124:39087
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460596631409-20401-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.19.236.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13831
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460596631409-20401-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 13:59:13 UTC on ccycloud.quasar-sqcett.root.comops.site
build id 4580140
I20260811 15:08:08.022126 13831 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 15:08:08.023169 13831 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 15:08:08.031982 13838 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 15:08:08.031989 13837 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:08:08.032068 13831 server_base.cc:1034] running on GCE node
W20260811 15:08:08.032018 13840 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 15:08:08.032909 13831 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 15:08:08.034169 13831 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 15:08:08.035380 13831 hybrid_clock.cc:648] HybridClock initialized: now 1786460888035350 us; error 39 us; skew 500 ppm
Aug 11 15:08:08 dist-test-slave-8n49 krb5kdc[13648](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460888, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 15:08:08.039158 13831 init.cc:377] Logged in from keytab as kudu/127.19.236.124@KRBTEST.COM (short username kudu)
I20260811 15:08:08.040419 13831 webserver.cc:460] Webserver started at http://127.19.236.124:33535/ using document root <none> and password file <none>
I20260811 15:08:08.041217 13831 fs_manager.cc:359] Metadata directory not provided
I20260811 15:08:08.041297 13831 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 15:08:08.041495 13831 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 15:08:08.044391 13831 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460596631409-20401-0/minicluster-data/master-2/data/instance:
uuid: "2caad9e7f10c4c1aa2ba47f5e0e1c292"
format_stamp: "Formatted at 2026-08-11 15:08:08 on dist-test-slave-8n49"
server_key: "ca852b1ed97db18445b4d36ec950a8c2"
server_key_iv: "dd64ac509214c0a2c9fb8ec2e0a6c089"
server_key_version: "encryptionkey@0"
I20260811 15:08:08.045218 13831 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460596631409-20401-0/minicluster-data/master-2/wal/instance:
uuid: "2caad9e7f10c4c1aa2ba47f5e0e1c292"
format_stamp: "Formatted at 2026-08-11 15:08:08 on dist-test-slave-8n49"
server_key: "ca852b1ed97db18445b4d36ec950a8c2"
server_key_iv: "dd64ac509214c0a2c9fb8ec2e0a6c089"
server_key_version: "encryptionkey@0"
I20260811 15:08:08.050674 13831 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 15:08:08.054113 13847 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 15:08:08.056209 13831 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.000s
I20260811 15:08:08.056336 13831 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460596631409-20401-0/minicluster-data/master-2/data,/tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460596631409-20401-0/minicluster-data/master-2/wal
uuid: "2caad9e7f10c4c1aa2ba47f5e0e1c292"
format_stamp: "Formatted at 2026-08-11 15:08:08 on dist-test-slave-8n49"
server_key: "ca852b1ed97db18445b4d36ec950a8c2"
server_key_iv: "dd64ac509214c0a2c9fb8ec2e0a6c089"
server_key_version: "encryptionkey@0"
I20260811 15:08:08.056478 13831 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460596631409-20401-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460596631409-20401-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460596631409-20401-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 15:08:08.077973 13831 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 15:08:08.082485 13831 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 15:08:08.082707 13831 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 15:08:08.089955 13831 rpc_server.cc:307] RPC server started. Bound to: 127.19.236.124:39087
I20260811 15:08:08.090245 13904 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.236.124:39087 every 8 connection(s)
I20260811 15:08:08.090965 13831 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460596631409-20401-0/minicluster-data/master-2/data/info.pb
I20260811 15:08:08.092728 20401 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu as pid 13831
I20260811 15:08:08.092859 20401 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskAUi0lq/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786460596631409-20401-0/minicluster-data/master-2/wal/instance
I20260811 15:08:08.093204 20401 external_mini_cluster.cc:1428] Setting key e0af0134f3579bae6f9ef944e37a82e8
I20260811 15:08:08.094278 13905 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 15:08:08.098660 13905 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.236.126" port: 37115 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 15:08:08 dist-test-slave-8n49 krb5kdc[13648](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460887, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.236.124@KRBTEST.COM
Aug 11 15:08:08 dist-test-slave-8n49 krb5kdc[13648](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460888, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.124@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
I20260811 15:08:08.106854 13738 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.236.124" port: 39087 } attempt: 3
I20260811 15:08:08.108170 13910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:08.094617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41504 (local address 127.19.236.124:39087)
0811 15:08:08.095016 (+ 399us) server_negotiation.cc:206] Beginning negotiation
0811 15:08:08.095041 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0811 15:08:08.095076 (+ 35us) server_negotiation.cc:407] Connection header received
0811 15:08:08.095733 (+ 657us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:08:08.095750 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:08:08.096072 (+ 322us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:08:08.096345 (+ 273us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:08:08.097298 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:08:08.098276 (+ 978us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:08:08.099487 (+ 1211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:08:08.099937 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:08:08.100067 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:08:08.103064 (+ 2997us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:08:08.103068 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:08:08.103077 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:08:08.103103 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:08:08.104913 (+ 1810us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:08:08.105348 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:08:08.105358 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:08:08.105362 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:08:08.105476 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:08:08.105757 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:08:08.105761 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:08:08.105762 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:08:08.106187 (+ 425us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:08:08.106396 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0811 15:08:08.106686 (+ 290us) server_negotiation.cc:299] Negotiation successful
0811 15:08:08.106960 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":263,"thread_start_us":140,"threads_started":1}
I20260811 15:08:08.110330 13743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:08.100667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40572 (local address 127.19.236.126:37115)
0811 15:08:08.100829 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0811 15:08:08.100834 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:08:08.101153 (+ 319us) server_negotiation.cc:407] Connection header received
0811 15:08:08.101328 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:08:08.101331 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:08:08.101384 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:08:08.101484 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:08:08.102248 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:08:08.102799 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:08:08.103885 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:08:08.104233 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:08:08.104356 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:08:08.106435 (+ 2079us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:08:08.106444 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:08:08.106447 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:08:08.106476 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:08:08.108369 (+ 1893us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:08:08.108909 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:08:08.108912 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:08:08.108914 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:08:08.109009 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:08:08.109332 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:08:08.109336 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:08:08.109338 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:08:08.109566 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:08:08.109648 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 15:08:08.110063 (+ 415us) server_negotiation.cc:299] Negotiation successful
0811 15:08:08.110184 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 15:08:08.110527 13823 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.236.124" port: 39087 } attempt: 3
I20260811 15:08:08.111552 13911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:08.100603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.126:37115 (local address 127.0.0.1:40572)
0811 15:08:08.101023 (+ 420us) negotiation.cc:107] Waiting for socket to connect
0811 15:08:08.101065 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 15:08:08.101215 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:08:08.101536 (+ 321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:08:08.101541 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:08:08.101924 (+ 383us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:08:08.102104 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:08:08.102111 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:08:08.102945 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:08:08.102950 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:08:08.103761 (+ 811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:08:08.103771 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:08:08.104369 (+ 598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:08:08.104373 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:08:08.104462 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:08:08.105037 (+ 575us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:08:08.105049 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:08:08.106291 (+ 1242us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:08:08.108489 (+ 2198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:08:08.108498 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:08:08.108503 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:08:08.108803 (+ 300us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:08:08.109112 (+ 309us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:08:08.109118 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:08:08.109122 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:08:08.109231 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:08:08.109717 (+ 486us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:08:08.109722 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:08:08.109826 (+ 104us) client_negotiation.cc:769] Sending connection context
0811 15:08:08.109952 (+ 126us) client_negotiation.cc:240] Negotiation successful
0811 15:08:08.110122 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":177,"threads_started":1}
Aug 11 15:08:08 dist-test-slave-8n49 krb5kdc[13648](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460887, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.126@KRBTEST.COM for kudu/127.19.236.124@KRBTEST.COM
I20260811 15:08:08.113795 13905 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.236.125" port: 40903 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 15:08:08 dist-test-slave-8n49 krb5kdc[13648](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460887, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.125@KRBTEST.COM for kudu/127.19.236.124@KRBTEST.COM
I20260811 15:08:08.117658 13744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:08.107261 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.124:39087 (local address 127.0.0.1:41506)
0811 15:08:08.107529 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0811 15:08:08.107545 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 15:08:08.107619 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:08:08.107894 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:08:08.107897 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:08:08.108076 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:08:08.108188 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:08:08.108197 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:08:08.109238 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:08:08.109242 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:08:08.110027 (+ 785us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:08:08.110039 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:08:08.110616 (+ 577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:08:08.110619 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:08:08.110697 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:08:08.111155 (+ 458us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:08:08.111171 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:08:08.112498 (+ 1327us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:08:08.115754 (+ 3256us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:08:08.115760 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:08:08.115764 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:08:08.116018 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:08:08.116420 (+ 402us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:08:08.116424 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:08:08.116428 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:08:08.116544 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:08:08.117128 (+ 584us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:08:08.117134 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:08:08.117242 (+ 108us) client_negotiation.cc:769] Sending connection context
0811 15:08:08.117338 (+ 96us) client_negotiation.cc:240] Negotiation successful
0811 15:08:08.117486 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":166}
Aug 11 15:08:08 dist-test-slave-8n49 krb5kdc[13648](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460887, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.236.126@KRBTEST.COM
I20260811 15:08:08.118320 13912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:08.107341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41506 (local address 127.19.236.124:39087)
0811 15:08:08.107649 (+ 308us) server_negotiation.cc:206] Beginning negotiation
0811 15:08:08.107657 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 15:08:08.107686 (+ 29us) server_negotiation.cc:407] Connection header received
0811 15:08:08.107719 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:08:08.107721 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:08:08.107760 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:08:08.107847 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:08:08.108335 (+ 488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:08:08.109094 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:08:08.110168 (+ 1074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:08:08.110480 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:08:08.111769 (+ 1289us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:08:08.112661 (+ 892us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:08:08.112666 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:08:08.112669 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:08:08.112716 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:08:08.115623 (+ 2907us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:08:08.116161 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:08:08.116164 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:08:08.116166 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:08:08.116296 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:08:08.116706 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:08:08.116710 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:08:08.116711 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:08:08.117010 (+ 299us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:08:08.117925 (+ 915us) server_negotiation.cc:1035] Waiting for connection context
0811 15:08:08.118013 (+ 88us) server_negotiation.cc:299] Negotiation successful
0811 15:08:08.118138 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":49,"server-negotiator.queue_time_us":247,"thread_start_us":138,"threads_started":1}
Aug 11 15:08:08 dist-test-slave-8n49 krb5kdc[13648](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460888, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.124@KRBTEST.COM for kudu/127.19.236.125@KRBTEST.COM
I20260811 15:08:08.120796 13826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:08.110958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.124:39087 (local address 127.0.0.1:41516)
0811 15:08:08.111162 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0811 15:08:08.111176 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 15:08:08.111258 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:08:08.111745 (+ 487us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:08:08.111748 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:08:08.111939 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:08:08.112066 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:08:08.112075 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:08:08.113305 (+ 1230us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:08:08.113309 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:08:08.114135 (+ 826us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:08:08.114146 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:08:08.114757 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:08:08.114761 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:08:08.114856 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:08:08.115300 (+ 444us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:08:08.115320 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:08:08.116898 (+ 1578us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:08:08.119108 (+ 2210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:08:08.119115 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:08:08.119119 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:08:08.119349 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:08:08.119712 (+ 363us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:08:08.119716 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:08:08.119718 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:08:08.119811 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:08:08.120246 (+ 435us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:08:08.120249 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:08:08.120343 (+ 94us) client_negotiation.cc:769] Sending connection context
0811 15:08:08.120430 (+ 87us) client_negotiation.cc:240] Negotiation successful
0811 15:08:08.120604 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111}
I20260811 15:08:08.121454 13910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:08.110985 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41516 (local address 127.19.236.124:39087)
0811 15:08:08.111413 (+ 428us) server_negotiation.cc:206] Beginning negotiation
0811 15:08:08.111417 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:08:08.111427 (+ 10us) server_negotiation.cc:407] Connection header received
0811 15:08:08.111464 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:08:08.111467 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:08:08.111508 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:08:08.112326 (+ 818us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:08:08.112436 (+ 110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:08:08.113182 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:08:08.114295 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:08:08.114630 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:08:08.115057 (+ 427us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:08:08.117031 (+ 1974us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:08:08.117034 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:08:08.117037 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:08:08.117060 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:08:08.118978 (+ 1918us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:08:08.119501 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:08:08.119506 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:08:08.119511 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:08:08.119594 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:08:08.119934 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:08:08.119938 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:08:08.119939 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:08:08.120126 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:08:08.121086 (+ 960us) server_negotiation.cc:1035] Waiting for connection context
0811 15:08:08.121162 (+ 76us) server_negotiation.cc:299] Negotiation successful
0811 15:08:08.121274 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":350}
I20260811 15:08:08.122135 13738 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e64c7f4017a149398ab7159001333b2f: Bootstrap starting.
I20260811 15:08:08.124083 13743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:08.111218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40586 (local address 127.19.236.126:37115)
0811 15:08:08.111333 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0811 15:08:08.111337 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:08:08.111351 (+ 14us) server_negotiation.cc:407] Connection header received
0811 15:08:08.111416 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:08:08.111419 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:08:08.111462 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:08:08.111534 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:08:08.112720 (+ 1186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:08:08.113393 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:08:08.114444 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:08:08.114773 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:08:08.114866 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:08:08.119174 (+ 4308us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:08:08.119178 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:08:08.119182 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:08:08.119208 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:08:08.121739 (+ 2531us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:08:08.122340 (+ 601us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:08:08.122343 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:08:08.122346 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:08:08.122433 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:08:08.122768 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:08:08.122774 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:08:08.122776 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:08:08.122992 (+ 216us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:08:08.123186 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0811 15:08:08.123814 (+ 628us) server_negotiation.cc:299] Negotiation successful
0811 15:08:08.123927 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 15:08:08.124269 13823 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5d5354c53a3a4c48844756c1fee55af3: Bootstrap starting.
I20260811 15:08:08.124511 13911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:08.114567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.125:40903 (local address 127.0.0.1:47628)
0811 15:08:08.115020 (+ 453us) negotiation.cc:107] Waiting for socket to connect
0811 15:08:08.115036 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 15:08:08.115124 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:08:08.115446 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:08:08.115449 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:08:08.115663 (+ 214us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:08:08.115770 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:08:08.115780 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:08:08.116840 (+ 1060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:08:08.116845 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:08:08.117766 (+ 921us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:08:08.117779 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:08:08.118238 (+ 459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:08:08.118242 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:08:08.118334 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:08:08.119032 (+ 698us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:08:08.119050 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:08:08.120429 (+ 1379us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:08:08.122830 (+ 2401us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:08:08.122833 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:08:08.122835 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:08:08.123079 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:08:08.123406 (+ 327us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:08:08.123410 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:08:08.123415 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:08:08.123506 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:08:08.124041 (+ 535us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:08:08.124044 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:08:08.124130 (+ 86us) client_negotiation.cc:769] Sending connection context
0811 15:08:08.124247 (+ 117us) client_negotiation.cc:240] Negotiation successful
0811 15:08:08.124364 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":387,"mutex_wait_us":23}
I20260811 15:08:08.124572 13830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:08.114806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47628 (local address 127.19.236.125:40903)
0811 15:08:08.114937 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0811 15:08:08.114941 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:08:08.115118 (+ 177us) server_negotiation.cc:407] Connection header received
0811 15:08:08.115203 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:08:08.115205 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:08:08.115252 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:08:08.115331 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:08:08.115913 (+ 582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:08:08.116701 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:08:08.117868 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:08:08.118123 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:08:08.118235 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:08:08.120589 (+ 2354us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:08:08.120593 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:08:08.120595 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:08:08.120617 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:08:08.122691 (+ 2074us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:08:08.123191 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:08:08.123195 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:08:08.123198 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:08:08.123284 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:08:08.123617 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:08:08.123621 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:08:08.123624 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:08:08.123875 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:08:08.123964 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 15:08:08.124300 (+ 336us) server_negotiation.cc:299] Negotiation successful
0811 15:08:08.124407 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260811 15:08:08.125259 13738 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e64c7f4017a149398ab7159001333b2f: Neither blocks nor log segments found. Creating new log.
I20260811 15:08:08.126170 13738 log.cc:824] T 00000000000000000000000000000000 P e64c7f4017a149398ab7159001333b2f: Log is configured to *not* fsync() on all Append() calls
I20260811 15:08:08.126767 13823 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5d5354c53a3a4c48844756c1fee55af3: Neither blocks nor log segments found. Creating new log.
I20260811 15:08:08.127571 13823 log.cc:824] T 00000000000000000000000000000000 P 5d5354c53a3a4c48844756c1fee55af3: Log is configured to *not* fsync() on all Append() calls
I20260811 15:08:08.128361 13738 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e64c7f4017a149398ab7159001333b2f: No bootstrap required, opened a new log
I20260811 15:08:08.129281 13905 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.236.124" port: 39087 } has no permanent_uuid. Determining permanent_uuid...
I20260811 15:08:08.129886 13823 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5d5354c53a3a4c48844756c1fee55af3: No bootstrap required, opened a new log
I20260811 15:08:08.133263 13738 raft_consensus.cc:348] T 00000000000000000000000000000000 P e64c7f4017a149398ab7159001333b2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e64c7f4017a149398ab7159001333b2f" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 37115 } } peers { permanent_uuid: "5d5354c53a3a4c48844756c1fee55af3" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 40903 } } peers { permanent_uuid: "2caad9e7f10c4c1aa2ba47f5e0e1c292" member_type: VOTER last_known_addr { host: "127.19.236.124" port: 39087 } }
I20260811 15:08:08.133518 13738 raft_consensus.cc:729] T 00000000000000000000000000000000 P e64c7f4017a149398ab7159001333b2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e64c7f4017a149398ab7159001333b2f, State: Initialized, Role: FOLLOWER
I20260811 15:08:08.133873 13738 consensus_queue.cc:260] T 00000000000000000000000000000000 P e64c7f4017a149398ab7159001333b2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e64c7f4017a149398ab7159001333b2f" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 37115 } } peers { permanent_uuid: "5d5354c53a3a4c48844756c1fee55af3" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 40903 } } peers { permanent_uuid: "2caad9e7f10c4c1aa2ba47f5e0e1c292" member_type: VOTER last_known_addr { host: "127.19.236.124" port: 39087 } }
I20260811 15:08:08.133936 13823 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5d5354c53a3a4c48844756c1fee55af3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e64c7f4017a149398ab7159001333b2f" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 37115 } } peers { permanent_uuid: "5d5354c53a3a4c48844756c1fee55af3" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 40903 } } peers { permanent_uuid: "2caad9e7f10c4c1aa2ba47f5e0e1c292" member_type: VOTER last_known_addr { host: "127.19.236.124" port: 39087 } }
I20260811 15:08:08.134141 13823 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5d5354c53a3a4c48844756c1fee55af3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d5354c53a3a4c48844756c1fee55af3, State: Initialized, Role: FOLLOWER
I20260811 15:08:08.134440 13823 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5d5354c53a3a4c48844756c1fee55af3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e64c7f4017a149398ab7159001333b2f" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 37115 } } peers { permanent_uuid: "5d5354c53a3a4c48844756c1fee55af3" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 40903 } } peers { permanent_uuid: "2caad9e7f10c4c1aa2ba47f5e0e1c292" member_type: VOTER last_known_addr { host: "127.19.236.124" port: 39087 } }
Aug 11 15:08:08 dist-test-slave-8n49 krb5kdc[13648](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460888, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.236.124@KRBTEST.COM for kudu/127.19.236.124@KRBTEST.COM
W20260811 15:08:08.135109 13685 tablet.cc:2369] T 00000000000000000000000000000000 P e64c7f4017a149398ab7159001333b2f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 15:08:08.135895 13823 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5d5354c53a3a4c48844756c1fee55af3 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:08:08.135958 13738 sys_catalog.cc:564] T 00000000000000000000000000000000 P e64c7f4017a149398ab7159001333b2f [sys.catalog]: configured and running, proceeding with master startup.
Aug 11 15:08:08 dist-test-slave-8n49 krb5kdc[13648](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786460887, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.236.125@KRBTEST.COM
I20260811 15:08:08.139087 13911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:08.129790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.236.124:39087 (local address 127.0.0.1:41520)
0811 15:08:08.130008 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0811 15:08:08.130020 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 15:08:08.130089 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 15:08:08.130507 (+ 418us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 15:08:08.130509 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 15:08:08.130675 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0811 15:08:08.130764 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:08:08.130771 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:08:08.131820 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:08:08.131823 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:08:08.132683 (+ 860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 15:08:08.132696 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 15:08:08.133293 (+ 597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 15:08:08.133297 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 15:08:08.133374 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:08:08.133847 (+ 473us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 15:08:08.133862 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 15:08:08.135376 (+ 1514us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 15:08:08.137428 (+ 2052us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:08:08.137434 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:08:08.137439 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:08:08.137691 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:08:08.137992 (+ 301us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 15:08:08.137995 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 15:08:08.137997 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 15:08:08.138084 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 15:08:08.138545 (+ 461us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 15:08:08.138548 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 15:08:08.138643 (+ 95us) client_negotiation.cc:769] Sending connection context
0811 15:08:08.138731 (+ 88us) client_negotiation.cc:240] Negotiation successful
0811 15:08:08.138872 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146}
I20260811 15:08:08.139739 13910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:08.130226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41520 (local address 127.19.236.124:39087)
0811 15:08:08.130318 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0811 15:08:08.130322 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:08:08.130333 (+ 11us) server_negotiation.cc:407] Connection header received
0811 15:08:08.130364 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:08:08.130366 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:08:08.130404 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:08:08.130865 (+ 461us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:08:08.130929 (+ 64us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:08:08.131710 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:08:08.132848 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:08:08.133179 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:08:08.133577 (+ 398us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:08:08.135515 (+ 1938us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:08:08.135519 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:08:08.135521 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:08:08.135543 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:08:08.137305 (+ 1762us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:08:08.137811 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:08:08.137814 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:08:08.137816 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:08:08.137886 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:08:08.138196 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:08:08.138202 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:08:08.138207 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:08:08.138437 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:08:08.139443 (+ 1006us) server_negotiation.cc:1035] Waiting for connection context
0811 15:08:08.139514 (+ 71us) server_negotiation.cc:299] Negotiation successful
0811 15:08:08.139617 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
W20260811 15:08:08.142133 13936 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e64c7f4017a149398ab7159001333b2f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 15:08:08.142216 13936 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 15:08:08.142709 13916 sys_catalog.cc:455] T 00000000000000000000000000000000 P e64c7f4017a149398ab7159001333b2f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e64c7f4017a149398ab7159001333b2f" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 37115 } } peers { permanent_uuid: "5d5354c53a3a4c48844756c1fee55af3" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 40903 } } peers { permanent_uuid: "2caad9e7f10c4c1aa2ba47f5e0e1c292" member_type: VOTER last_known_addr { host: "127.19.236.124" port: 39087 } } }
I20260811 15:08:08.142828 13916 sys_catalog.cc:458] T 00000000000000000000000000000000 P e64c7f4017a149398ab7159001333b2f [sys.catalog]: This master's current role is: FOLLOWER
I20260811 15:08:08.143038 13917 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d5354c53a3a4c48844756c1fee55af3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e64c7f4017a149398ab7159001333b2f" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 37115 } } peers { permanent_uuid: "5d5354c53a3a4c48844756c1fee55af3" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 40903 } } peers { permanent_uuid: "2caad9e7f10c4c1aa2ba47f5e0e1c292" member_type: VOTER last_known_addr { host: "127.19.236.124" port: 39087 } } }
I20260811 15:08:08.143175 13917 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d5354c53a3a4c48844756c1fee55af3 [sys.catalog]: This master's current role is: FOLLOWER
W20260811 15:08:08.146209 13940 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 5d5354c53a3a4c48844756c1fee55af3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 15:08:08.146293 13940 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 15:08:08.143852 13663 master_runner.cc:186] Error getting master registration for 127.19.236.124:39087: OK, instance_id { permanent_uuid: "2caad9e7f10c4c1aa2ba47f5e0e1c292" instance_seqno: 1786460888087936 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 15:08:08.147262 13663 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 15:08:08.144451 13747 master_runner.cc:186] Error getting master registration for 127.19.236.124:39087: OK, instance_id { permanent_uuid: "2caad9e7f10c4c1aa2ba47f5e0e1c292" instance_seqno: 1786460888087936 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 15:08:08.147668 13747 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 15:08:08.150117 13905 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2caad9e7f10c4c1aa2ba47f5e0e1c292: Bootstrap starting.
I20260811 15:08:08.150776 13830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:08.129304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47632 (local address 127.19.236.125:40903)
0811 15:08:08.129419 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0811 15:08:08.129423 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:08:08.129748 (+ 325us) server_negotiation.cc:407] Connection header received
0811 15:08:08.129921 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:08:08.129924 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:08:08.129978 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:08:08.130025 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:08:08.130942 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:08:08.131672 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:08:08.132818 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:08:08.133127 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:08:08.133204 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:08:08.137874 (+ 4670us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:08:08.137880 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:08:08.137884 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:08:08.137912 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:08:08.142454 (+ 4542us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:08:08.149285 (+ 6831us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:08:08.149288 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:08:08.149290 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:08:08.149380 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:08:08.149712 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:08:08.149717 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:08:08.149718 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:08:08.149929 (+ 211us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:08:08.150112 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0811 15:08:08.150517 (+ 405us) server_negotiation.cc:299] Negotiation successful
0811 15:08:08.150641 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 15:08:08.153564 13905 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2caad9e7f10c4c1aa2ba47f5e0e1c292: Neither blocks nor log segments found. Creating new log.
I20260811 15:08:08.154364 20401 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 15:08:08.154475 13905 log.cc:824] T 00000000000000000000000000000000 P 2caad9e7f10c4c1aa2ba47f5e0e1c292: Log is configured to *not* fsync() on all Append() calls
I20260811 15:08:08.155654 13709 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "e64c7f4017a149398ab7159001333b2f"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40586
I20260811 15:08:08.155879 13709 raft_consensus.cc:482] T 00000000000000000000000000000000 P e64c7f4017a149398ab7159001333b2f [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 15:08:08.156023 13709 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e64c7f4017a149398ab7159001333b2f [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:08:08.157145 13709 raft_consensus.cc:504] T 00000000000000000000000000000000 P e64c7f4017a149398ab7159001333b2f [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e64c7f4017a149398ab7159001333b2f" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 37115 } } peers { permanent_uuid: "5d5354c53a3a4c48844756c1fee55af3" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 40903 } } peers { permanent_uuid: "2caad9e7f10c4c1aa2ba47f5e0e1c292" member_type: VOTER last_known_addr { host: "127.19.236.124" port: 39087 } }
I20260811 15:08:08.157996 13709 leader_election.cc:288] T 00000000000000000000000000000000 P e64c7f4017a149398ab7159001333b2f [CANDIDATE]: Term 1 election: Requested vote from peers 5d5354c53a3a4c48844756c1fee55af3 (127.19.236.125:40903), 2caad9e7f10c4c1aa2ba47f5e0e1c292 (127.19.236.124:39087)
I20260811 15:08:08.158622 13791 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e64c7f4017a149398ab7159001333b2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "5d5354c53a3a4c48844756c1fee55af3"
I20260811 15:08:08.158860 13791 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5d5354c53a3a4c48844756c1fee55af3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:08:08.160178 13791 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 5d5354c53a3a4c48844756c1fee55af3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e64c7f4017a149398ab7159001333b2f in term 1.
I20260811 15:08:08.160729 13683 leader_election.cc:302] T 00000000000000000000000000000000 P e64c7f4017a149398ab7159001333b2f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d5354c53a3a4c48844756c1fee55af3, e64c7f4017a149398ab7159001333b2f; no voters:
I20260811 15:08:08.160997 13916 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e64c7f4017a149398ab7159001333b2f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 15:08:08.161176 13905 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2caad9e7f10c4c1aa2ba47f5e0e1c292: No bootstrap required, opened a new log
I20260811 15:08:08.161250 13916 raft_consensus.cc:686] T 00000000000000000000000000000000 P e64c7f4017a149398ab7159001333b2f [term 1 LEADER]: Becoming Leader. State: Replica: e64c7f4017a149398ab7159001333b2f, State: Running, Role: LEADER
I20260811 15:08:08.161587 13916 consensus_queue.cc:237] T 00000000000000000000000000000000 P e64c7f4017a149398ab7159001333b2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e64c7f4017a149398ab7159001333b2f" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 37115 } } peers { permanent_uuid: "5d5354c53a3a4c48844756c1fee55af3" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 40903 } } peers { permanent_uuid: "2caad9e7f10c4c1aa2ba47f5e0e1c292" member_type: VOTER last_known_addr { host: "127.19.236.124" port: 39087 } }
I20260811 15:08:08.163656 13948 sys_catalog.cc:455] T 00000000000000000000000000000000 P e64c7f4017a149398ab7159001333b2f [sys.catalog]: SysCatalogTable state changed. Reason: New leader e64c7f4017a149398ab7159001333b2f. Latest consensus state: current_term: 1 leader_uuid: "e64c7f4017a149398ab7159001333b2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e64c7f4017a149398ab7159001333b2f" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 37115 } } peers { permanent_uuid: "5d5354c53a3a4c48844756c1fee55af3" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 40903 } } peers { permanent_uuid: "2caad9e7f10c4c1aa2ba47f5e0e1c292" member_type: VOTER last_known_addr { host: "127.19.236.124" port: 39087 } } }
I20260811 15:08:08.163774 13948 sys_catalog.cc:458] T 00000000000000000000000000000000 P e64c7f4017a149398ab7159001333b2f [sys.catalog]: This master's current role is: LEADER
I20260811 15:08:08.165570 13905 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2caad9e7f10c4c1aa2ba47f5e0e1c292 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e64c7f4017a149398ab7159001333b2f" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 37115 } } peers { permanent_uuid: "5d5354c53a3a4c48844756c1fee55af3" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 40903 } } peers { permanent_uuid: "2caad9e7f10c4c1aa2ba47f5e0e1c292" member_type: VOTER last_known_addr { host: "127.19.236.124" port: 39087 } }
I20260811 15:08:08.165812 13905 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2caad9e7f10c4c1aa2ba47f5e0e1c292 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2caad9e7f10c4c1aa2ba47f5e0e1c292, State: Initialized, Role: FOLLOWER
I20260811 15:08:08.166149 13905 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2caad9e7f10c4c1aa2ba47f5e0e1c292 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e64c7f4017a149398ab7159001333b2f" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 37115 } } peers { permanent_uuid: "5d5354c53a3a4c48844756c1fee55af3" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 40903 } } peers { permanent_uuid: "2caad9e7f10c4c1aa2ba47f5e0e1c292" member_type: VOTER last_known_addr { host: "127.19.236.124" port: 39087 } }
I20260811 15:08:08.166683 13951 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2caad9e7f10c4c1aa2ba47f5e0e1c292 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e64c7f4017a149398ab7159001333b2f" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 37115 } } peers { permanent_uuid: "5d5354c53a3a4c48844756c1fee55af3" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 40903 } } peers { permanent_uuid: "2caad9e7f10c4c1aa2ba47f5e0e1c292" member_type: VOTER last_known_addr { host: "127.19.236.124" port: 39087 } } }
I20260811 15:08:08.166937 13951 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2caad9e7f10c4c1aa2ba47f5e0e1c292 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 15:08:08.167590 13905 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2caad9e7f10c4c1aa2ba47f5e0e1c292 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 15:08:08.167868 13878 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e64c7f4017a149398ab7159001333b2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "2caad9e7f10c4c1aa2ba47f5e0e1c292"
I20260811 15:08:08.168079 13878 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2caad9e7f10c4c1aa2ba47f5e0e1c292 [term 0 FOLLOWER]: Advancing to term 1
I20260811 15:08:08.168792 13950 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 15:08:08.169488 13878 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 2caad9e7f10c4c1aa2ba47f5e0e1c292 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e64c7f4017a149398ab7159001333b2f in term 1.
I20260811 15:08:08.169694 13950 catalog_manager.cc:1484] Initializing Kudu cluster ID...
W20260811 15:08:08.174784 13964 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2caad9e7f10c4c1aa2ba47f5e0e1c292: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 15:08:08.174857 13964 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 15:08:08.174990 13878 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2caad9e7f10c4c1aa2ba47f5e0e1c292 [term 1 FOLLOWER]: Refusing update from remote peer e64c7f4017a149398ab7159001333b2f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:08:08.176043 13791 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 5d5354c53a3a4c48844756c1fee55af3 [term 1 FOLLOWER]: Refusing update from remote peer e64c7f4017a149398ab7159001333b2f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 15:08:08.177006 13916 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e64c7f4017a149398ab7159001333b2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2caad9e7f10c4c1aa2ba47f5e0e1c292" member_type: VOTER last_known_addr { host: "127.19.236.124" port: 39087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:08:08.177479 13916 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e64c7f4017a149398ab7159001333b2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d5354c53a3a4c48844756c1fee55af3" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 40903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 15:08:08.181110 13917 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d5354c53a3a4c48844756c1fee55af3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e64c7f4017a149398ab7159001333b2f. Latest consensus state: current_term: 1 leader_uuid: "e64c7f4017a149398ab7159001333b2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e64c7f4017a149398ab7159001333b2f" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 37115 } } peers { permanent_uuid: "5d5354c53a3a4c48844756c1fee55af3" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 40903 } } peers { permanent_uuid: "2caad9e7f10c4c1aa2ba47f5e0e1c292" member_type: VOTER last_known_addr { host: "127.19.236.124" port: 39087 } } }
I20260811 15:08:08.181239 13917 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d5354c53a3a4c48844756c1fee55af3 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 15:08:08.181372 13951 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2caad9e7f10c4c1aa2ba47f5e0e1c292 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e64c7f4017a149398ab7159001333b2f. Latest consensus state: current_term: 1 leader_uuid: "e64c7f4017a149398ab7159001333b2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e64c7f4017a149398ab7159001333b2f" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 37115 } } peers { permanent_uuid: "5d5354c53a3a4c48844756c1fee55af3" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 40903 } } peers { permanent_uuid: "2caad9e7f10c4c1aa2ba47f5e0e1c292" member_type: VOTER last_known_addr { host: "127.19.236.124" port: 39087 } } }
I20260811 15:08:08.181484 13951 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2caad9e7f10c4c1aa2ba47f5e0e1c292 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 15:08:08.187692 13951 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2caad9e7f10c4c1aa2ba47f5e0e1c292 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e64c7f4017a149398ab7159001333b2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e64c7f4017a149398ab7159001333b2f" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 37115 } } peers { permanent_uuid: "5d5354c53a3a4c48844756c1fee55af3" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 40903 } } peers { permanent_uuid: "2caad9e7f10c4c1aa2ba47f5e0e1c292" member_type: VOTER last_known_addr { host: "127.19.236.124" port: 39087 } } }
I20260811 15:08:08.187806 13951 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2caad9e7f10c4c1aa2ba47f5e0e1c292 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 15:08:08.188385 13972 mvcc.cc:205] Tried to move back new op lower bound from 7317343797957689344 to 7317343797913079808. Current Snapshot: MvccSnapshot[applied={T|T < 7317343797957689344}]
I20260811 15:08:08.188651 13916 sys_catalog.cc:455] T 00000000000000000000000000000000 P e64c7f4017a149398ab7159001333b2f [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e64c7f4017a149398ab7159001333b2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e64c7f4017a149398ab7159001333b2f" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 37115 } } peers { permanent_uuid: "5d5354c53a3a4c48844756c1fee55af3" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 40903 } } peers { permanent_uuid: "2caad9e7f10c4c1aa2ba47f5e0e1c292" member_type: VOTER last_known_addr { host: "127.19.236.124" port: 39087 } } }
I20260811 15:08:08.188768 13916 sys_catalog.cc:458] T 00000000000000000000000000000000 P e64c7f4017a149398ab7159001333b2f [sys.catalog]: This master's current role is: LEADER
I20260811 15:08:08.188987 13965 mvcc.cc:205] Tried to move back new op lower bound from 7317343797957689344 to 7317343797913079808. Current Snapshot: MvccSnapshot[applied={T|T < 7317343797957689344}]
I20260811 15:08:08.193459 13743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:08.172127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40600 (local address 127.19.236.126:37115)
0811 15:08:08.172244 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0811 15:08:08.172248 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:08:08.176162 (+ 3914us) server_negotiation.cc:407] Connection header received
0811 15:08:08.176443 (+ 281us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:08:08.176446 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:08:08.176499 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:08:08.176594 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:08:08.177872 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:08:08.178635 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:08:08.179765 (+ 1130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:08:08.180092 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:08:08.180180 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:08:08.182044 (+ 1864us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:08:08.182048 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:08:08.182051 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:08:08.182077 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:08:08.183570 (+ 1493us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:08:08.184000 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:08:08.184004 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:08:08.184006 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:08:08.184089 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:08:08.184379 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:08:08.184383 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:08:08.184385 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:08:08.184625 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:08:08.184791 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0811 15:08:08.193114 (+ 8323us) server_negotiation.cc:299] Negotiation successful
0811 15:08:08.193262 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 15:08:08.197868 13830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:08.175734 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47644 (local address 127.19.236.125:40903)
0811 15:08:08.176488 (+ 754us) server_negotiation.cc:206] Beginning negotiation
0811 15:08:08.176493 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:08:08.186125 (+ 9632us) server_negotiation.cc:407] Connection header received
0811 15:08:08.188612 (+ 2487us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:08:08.188616 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:08:08.188672 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:08:08.188726 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:08:08.189580 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:08:08.190356 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:08:08.191539 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:08:08.191878 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:08:08.191953 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:08:08.194039 (+ 2086us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:08:08.194043 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:08:08.194046 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:08:08.194074 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:08:08.195829 (+ 1755us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:08:08.196330 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:08:08.196335 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:08:08.196339 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:08:08.196426 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:08:08.196786 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:08:08.196790 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:08:08.196792 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:08:08.197005 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:08:08.197133 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0811 15:08:08.197571 (+ 438us) server_negotiation.cc:299] Negotiation successful
0811 15:08:08.197712 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":670}
I20260811 15:08:08.207422 13910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:08.176619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41536 (local address 127.19.236.124:39087)
0811 15:08:08.176824 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0811 15:08:08.176829 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:08:08.192804 (+ 15975us) server_negotiation.cc:407] Connection header received
0811 15:08:08.192976 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:08:08.192979 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:08:08.193028 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:08:08.193076 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:08:08.194131 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:08:08.194888 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:08:08.196014 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:08:08.196344 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:08:08.196412 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:08:08.201059 (+ 4647us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 15:08:08.201063 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 15:08:08.201065 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 15:08:08.201092 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 15:08:08.202735 (+ 1643us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:08:08.204652 (+ 1917us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:08:08.204656 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:08:08.204658 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:08:08.204746 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 15:08:08.206467 (+ 1721us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 15:08:08.206471 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 15:08:08.206473 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 15:08:08.206693 (+ 220us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 15:08:08.206806 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0811 15:08:08.207138 (+ 332us) server_negotiation.cc:299] Negotiation successful
0811 15:08:08.207259 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133}
I20260811 15:08:08.209656 13948 sys_catalog.cc:455] T 00000000000000000000000000000000 P e64c7f4017a149398ab7159001333b2f [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e64c7f4017a149398ab7159001333b2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e64c7f4017a149398ab7159001333b2f" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 37115 } } peers { permanent_uuid: "5d5354c53a3a4c48844756c1fee55af3" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 40903 } } peers { permanent_uuid: "2caad9e7f10c4c1aa2ba47f5e0e1c292" member_type: VOTER last_known_addr { host: "127.19.236.124" port: 39087 } } }
I20260811 15:08:08.209789 13948 sys_catalog.cc:458] T 00000000000000000000000000000000 P e64c7f4017a149398ab7159001333b2f [sys.catalog]: This master's current role is: LEADER
I20260811 15:08:08.210959 13917 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d5354c53a3a4c48844756c1fee55af3 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e64c7f4017a149398ab7159001333b2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e64c7f4017a149398ab7159001333b2f" member_type: VOTER last_known_addr { host: "127.19.236.126" port: 37115 } } peers { permanent_uuid: "5d5354c53a3a4c48844756c1fee55af3" member_type: VOTER last_known_addr { host: "127.19.236.125" port: 40903 } } peers { permanent_uuid: "2caad9e7f10c4c1aa2ba47f5e0e1c292" member_type: VOTER last_known_addr { host: "127.19.236.124" port: 39087 } } }
I20260811 15:08:08.211088 13917 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d5354c53a3a4c48844756c1fee55af3 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 15:08:08.211795 13974 mvcc.cc:205] Tried to move back new op lower bound from 7317343797957689344 to 7317343797913079808. Current Snapshot: MvccSnapshot[applied={T|T < 7317343797957689344}]
I20260811 15:08:08.213702 13950 catalog_manager.cc:1347] Generated new cluster ID: 128d6477f4034c34ba521e7a61f0f827
I20260811 15:08:08.213768 13950 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 15:08:08.246251 13950 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 15:08:08.247552 13950 catalog_manager.cc:1504] Loading token signing keys...
I20260811 15:08:08.277933 13950 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e64c7f4017a149398ab7159001333b2f: Generated new TSK 0
I20260811 15:08:08.278757 13950 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 15:08:08.313791 13743 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:08:08.309974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40606 (local address 127.19.236.126:37115)
0811 15:08:08.310127 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0811 15:08:08.310132 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:08:08.312212 (+ 2080us) server_negotiation.cc:407] Connection header received
0811 15:08:08.312775 (+ 563us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:08:08.312779 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:08:08.312843 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:08:08.312908 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:08:08.313647 (+ 739us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40606: BlockingRecv error: recv got EOF from 127.0.0.1:40606 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
W20260811 15:08:08.315371 13830 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:08:08.310816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47650 (local address 127.19.236.125:40903)
0811 15:08:08.310945 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0811 15:08:08.310950 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:08:08.312671 (+ 1721us) server_negotiation.cc:407] Connection header received
0811 15:08:08.314423 (+ 1752us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:08:08.314427 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:08:08.314497 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:08:08.314554 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:08:08.315241 (+ 687us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47650: BlockingRecv error: recv got EOF from 127.0.0.1:47650 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
W20260811 15:08:08.316500 13910 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:08:08.311486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41548 (local address 127.19.236.124:39087)
0811 15:08:08.311614 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0811 15:08:08.311619 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:08:08.314220 (+ 2601us) server_negotiation.cc:407] Connection header received
0811 15:08:08.315674 (+ 1454us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:08:08.315678 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:08:08.315740 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:08:08.315798 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:08:08.316365 (+ 567us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41548: BlockingRecv error: recv got EOF from 127.0.0.1:41548 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
W20260811 15:08:08.321878 13830 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:08:08.320123 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47660 (local address 127.19.236.125:40903)
0811 15:08:08.320240 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0811 15:08:08.320245 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:08:08.320784 (+ 539us) server_negotiation.cc:407] Connection header received
0811 15:08:08.321017 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:08:08.321020 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:08:08.321117 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:08:08.321176 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:08:08.321769 (+ 593us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47660: BlockingRecv error: recv got EOF from 127.0.0.1:47660 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
W20260811 15:08:08.327529 13830 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:08:08.325753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47674 (local address 127.19.236.125:40903)
0811 15:08:08.325864 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0811 15:08:08.325868 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:08:08.326398 (+ 530us) server_negotiation.cc:407] Connection header received
0811 15:08:08.326772 (+ 374us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:08:08.326775 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:08:08.326832 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:08:08.326887 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:08:08.327413 (+ 526us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47674: BlockingRecv error: recv got EOF from 127.0.0.1:47674 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
W20260811 15:08:08.333389 13830 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:08:08.331633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47682 (local address 127.19.236.125:40903)
0811 15:08:08.331729 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0811 15:08:08.331733 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:08:08.332250 (+ 517us) server_negotiation.cc:407] Connection header received
0811 15:08:08.332455 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:08:08.332459 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:08:08.332505 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:08:08.332689 (+ 184us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:08:08.333287 (+ 598us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47682: BlockingRecv error: recv got EOF from 127.0.0.1:47682 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
W20260811 15:08:08.341329 13830 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:08:08.339663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47690 (local address 127.19.236.125:40903)
0811 15:08:08.339808 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0811 15:08:08.339812 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:08:08.340306 (+ 494us) server_negotiation.cc:407] Connection header received
0811 15:08:08.340515 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:08:08.340518 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:08:08.340645 (+ 127us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:08:08.340699 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:08:08.341222 (+ 523us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47690: BlockingRecv error: recv got EOF from 127.0.0.1:47690 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
W20260811 15:08:08.353976 13830 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:08:08.351565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47692 (local address 127.19.236.125:40903)
0811 15:08:08.351667 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0811 15:08:08.351671 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:08:08.352185 (+ 514us) server_negotiation.cc:407] Connection header received
0811 15:08:08.353231 (+ 1046us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:08:08.353234 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:08:08.353285 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:08:08.353333 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:08:08.353864 (+ 531us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47692: BlockingRecv error: recv got EOF from 127.0.0.1:47692 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
W20260811 15:08:08.373781 13830 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:08:08.372448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47708 (local address 127.19.236.125:40903)
0811 15:08:08.372609 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0811 15:08:08.372615 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 15:08:08.372826 (+ 211us) server_negotiation.cc:407] Connection header received
0811 15:08:08.373003 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:08:08.373007 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:08:08.373068 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:08:08.373168 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:08:08.373654 (+ 486us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47708: BlockingRecv error: recv got EOF from 127.0.0.1:47708 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
W20260811 15:08:08.408896 13830 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:08:08.407777 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47720 (local address 127.19.236.125:40903)
0811 15:08:08.407943 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0811 15:08:08.407946 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 15:08:08.408082 (+ 136us) server_negotiation.cc:407] Connection header received
0811 15:08:08.408191 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:08:08.408194 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:08:08.408244 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:08:08.408325 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:08:08.408796 (+ 471us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47720: BlockingRecv error: recv got EOF from 127.0.0.1:47720 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
W20260811 15:08:08.476262 13830 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:08:08.475198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47730 (local address 127.19.236.125:40903)
0811 15:08:08.475364 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0811 15:08:08.475368 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:08:08.475510 (+ 142us) server_negotiation.cc:407] Connection header received
0811 15:08:08.475583 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:08:08.475586 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:08:08.475641 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:08:08.475726 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:08:08.476146 (+ 420us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47730: BlockingRecv error: recv got EOF from 127.0.0.1:47730 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
W20260811 15:08:08.607849 13830 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:08:08.606539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47742 (local address 127.19.236.125:40903)
0811 15:08:08.606700 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0811 15:08:08.606705 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:08:08.606834 (+ 129us) server_negotiation.cc:407] Connection header received
0811 15:08:08.607076 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:08:08.607080 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:08:08.607133 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:08:08.607215 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:08:08.607695 (+ 480us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47742: BlockingRecv error: recv got EOF from 127.0.0.1:47742 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
W20260811 15:08:08.867514 13830 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 15:08:08.866256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47756 (local address 127.19.236.125:40903)
0811 15:08:08.866390 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0811 15:08:08.866395 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:08:08.866530 (+ 135us) server_negotiation.cc:407] Connection header received
0811 15:08:08.866649 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:08:08.866651 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:08:08.866706 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:08:08.866780 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 15:08:08.867394 (+ 614us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47756: BlockingRecv error: recv got EOF from 127.0.0.1:47756 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 15:08:09.147614 13940 catalog_manager.cc:1259] Loaded cluster ID: 128d6477f4034c34ba521e7a61f0f827
I20260811 15:08:09.147706 13940 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 5d5354c53a3a4c48844756c1fee55af3: loading cluster ID for follower catalog manager: success
I20260811 15:08:09.149467 13940 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 5d5354c53a3a4c48844756c1fee55af3: acquiring CA information for follower catalog manager: success
I20260811 15:08:09.150655 13940 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 5d5354c53a3a4c48844756c1fee55af3: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 15:08:09.176183 13964 catalog_manager.cc:1259] Loaded cluster ID: 128d6477f4034c34ba521e7a61f0f827
I20260811 15:08:09.176301 13964 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 2caad9e7f10c4c1aa2ba47f5e0e1c292: loading cluster ID for follower catalog manager: success
I20260811 15:08:09.178004 13964 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 2caad9e7f10c4c1aa2ba47f5e0e1c292: acquiring CA information for follower catalog manager: success
I20260811 15:08:09.179179 13964 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 2caad9e7f10c4c1aa2ba47f5e0e1c292: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 15:08:09.385702 14056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:09.381586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47770 (local address 127.19.236.125:40903)
0811 15:08:09.381851 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0811 15:08:09.381855 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:08:09.381928 (+ 73us) server_negotiation.cc:407] Connection header received
0811 15:08:09.382071 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:08:09.382073 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:08:09.382203 (+ 130us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:08:09.382315 (+ 112us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 15:08:09.382558 (+ 243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:08:09.383086 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:08:09.384001 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:08:09.384261 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:08:09.384365 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:08:09.384734 (+ 369us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 15:08:09.385224 (+ 490us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 15:08:09.385329 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 15:08:09.385400 (+ 71us) server_negotiation.cc:299] Negotiation successful
0811 15:08:09.385471 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":185,"thread_start_us":109,"threads_started":1}
I20260811 15:08:09.392871 14062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:09.389136 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41560 (local address 127.19.236.124:39087)
0811 15:08:09.389361 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0811 15:08:09.389368 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 15:08:09.389385 (+ 17us) server_negotiation.cc:407] Connection header received
0811 15:08:09.389480 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:08:09.389482 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:08:09.389600 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:08:09.389727 (+ 127us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 15:08:09.389964 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:08:09.390481 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:08:09.391341 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:08:09.391566 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:08:09.391674 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:08:09.391994 (+ 320us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 15:08:09.392430 (+ 436us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 15:08:09.392590 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0811 15:08:09.392650 (+ 60us) server_negotiation.cc:299] Negotiation successful
0811 15:08:09.392708 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":58,"threads_started":1}
I20260811 15:08:09.400285 14056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:09.395934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47774 (local address 127.19.236.125:40903)
0811 15:08:09.396063 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0811 15:08:09.396068 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:08:09.396285 (+ 217us) server_negotiation.cc:407] Connection header received
0811 15:08:09.396510 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:08:09.396514 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:08:09.396611 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:08:09.396701 (+ 90us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 15:08:09.396938 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:08:09.397691 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:08:09.399013 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:08:09.399352 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:08:09.399451 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:08:09.399784 (+ 333us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 15:08:09.399872 (+ 88us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 15:08:09.399980 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0811 15:08:09.400064 (+ 84us) server_negotiation.cc:299] Negotiation successful
0811 15:08:09.400121 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 15:08:09.400311 14062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:09.396388 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41566 (local address 127.19.236.124:39087)
0811 15:08:09.396512 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0811 15:08:09.396516 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 15:08:09.396727 (+ 211us) server_negotiation.cc:407] Connection header received
0811 15:08:09.396904 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:08:09.396909 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:08:09.396968 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:08:09.397057 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 15:08:09.397287 (+ 230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:08:09.397859 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:08:09.399021 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:08:09.399349 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:08:09.399438 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:08:09.399832 (+ 394us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 15:08:09.399892 (+ 60us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 15:08:09.399983 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 15:08:09.400138 (+ 155us) server_negotiation.cc:299] Negotiation successful
0811 15:08:09.400187 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 15:08:09.400470 14068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 15:08:09.395649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40620 (local address 127.19.236.126:37115)
0811 15:08:09.395928 (+ 279us) server_negotiation.cc:206] Beginning negotiation
0811 15:08:09.395933 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 15:08:09.395949 (+ 16us) server_negotiation.cc:407] Connection header received
0811 15:08:09.396045 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 15:08:09.396048 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 15:08:09.396211 (+ 163us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 15:08:09.396629 (+ 418us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 15:08:09.396766 (+ 137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:08:09.397595 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:08:09.398543 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 15:08:09.398833 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 15:08:09.399189 (+ 356us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 15:08:09.399295 (+ 106us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 15:08:09.399646 (+ 351us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 15:08:09.399742 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0811 15:08:09.400262 (+ 520us) server_negotiation.cc:299] Negotiation successful
0811 15:08:09.400324 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":183,"thread_start_us":85,"threads_started":1}
I20260811 15:08:09.412914 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 13663
I20260811 15:08:09.423116 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 13747
I20260811 15:08:09.432833 20401 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskAUi0lq/build/debug/bin/kudu with pid 13831
2026-08-11T15:08:09Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (3219 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (6515 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (292797 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST